-- Logs begin at Tue 2022-07-19 11:51:33 UTC, end at Tue 2022-07-19 13:01:56 UTC. -- Jul 19 12:16:50.484012 dv-cinder-820994-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 19 12:16:50.497925 dv-cinder-820994-4-smb devstack@keystone.service[80220]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 19 12:16:50.497925 dv-cinder-820994-4-smb devstack@keystone.service[80220]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 12:16:50 2022] *** Jul 19 12:16:50.497925 dv-cinder-820994-4-smb devstack@keystone.service[80220]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 12:16:50.497925 dv-cinder-820994-4-smb devstack@keystone.service[80220]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 12:16:50.497925 dv-cinder-820994-4-smb devstack@keystone.service[80220]: nodename: dv-cinder-820994-4-smb Jul 19 12:16:50.497925 dv-cinder-820994-4-smb devstack@keystone.service[80220]: machine: x86_64 Jul 19 12:16:50.497925 dv-cinder-820994-4-smb devstack@keystone.service[80220]: clock source: unix Jul 19 12:16:50.497925 dv-cinder-820994-4-smb devstack@keystone.service[80220]: pcre jit disabled Jul 19 12:16:50.497925 dv-cinder-820994-4-smb devstack@keystone.service[80220]: detected number of CPU cores: 4 Jul 19 12:16:50.497925 dv-cinder-820994-4-smb devstack@keystone.service[80220]: current working directory: / Jul 19 12:16:50.497925 dv-cinder-820994-4-smb devstack@keystone.service[80220]: detected binary path: /usr/bin/uwsgi-core Jul 19 12:16:50.497925 dv-cinder-820994-4-smb devstack@keystone.service[80220]: your processes number limit is 47680 Jul 19 12:16:50.497925 dv-cinder-820994-4-smb devstack@keystone.service[80220]: your memory page size is 4096 bytes Jul 19 12:16:50.497925 dv-cinder-820994-4-smb devstack@keystone.service[80220]: detected max file descriptor number: 2048 Jul 19 12:16:50.497925 dv-cinder-820994-4-smb devstack@keystone.service[80220]: lock engine: pthread robust mutexes Jul 19 12:16:50.497925 dv-cinder-820994-4-smb devstack@keystone.service[80220]: thunder lock: enabled Jul 19 12:16:50.497925 dv-cinder-820994-4-smb devstack@keystone.service[80220]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 19 12:16:50.497925 dv-cinder-820994-4-smb devstack@keystone.service[80220]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 12:16:50.542162 dv-cinder-820994-4-smb devstack@keystone.service[80220]: Python main interpreter initialized at 0x55c8d3aed9c0 Jul 19 12:16:50.542162 dv-cinder-820994-4-smb devstack@keystone.service[80220]: python threads support enabled Jul 19 12:16:50.542162 dv-cinder-820994-4-smb devstack@keystone.service[80220]: your server socket listen backlog is limited to 100 connections Jul 19 12:16:50.542162 dv-cinder-820994-4-smb devstack@keystone.service[80220]: your mercy for graceful operations on workers is 90 seconds Jul 19 12:16:50.542485 dv-cinder-820994-4-smb devstack@keystone.service[80220]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 12:16:50.542588 dv-cinder-820994-4-smb devstack@keystone.service[80220]: *** Operational MODE: preforking *** Jul 19 12:16:50.542892 dv-cinder-820994-4-smb devstack@keystone.service[80220]: *** uWSGI is running in multiple interpreter mode *** Jul 19 12:16:50.542892 dv-cinder-820994-4-smb devstack@keystone.service[80220]: spawned uWSGI master process (pid: 80220) Jul 19 12:16:50.543085 dv-cinder-820994-4-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 19 12:16:50.545142 dv-cinder-820994-4-smb devstack@keystone.service[80220]: spawned uWSGI worker 1 (pid: 80230, cores: 1) Jul 19 12:16:50.545142 dv-cinder-820994-4-smb devstack@keystone.service[80220]: spawned uWSGI worker 2 (pid: 80231, cores: 1) Jul 19 12:16:50.545142 dv-cinder-820994-4-smb devstack@keystone.service[80220]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 12:16:55.971124 dv-cinder-820994-4-smb devstack@keystone.service[80231]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 12:16:55.971124 dv-cinder-820994-4-smb devstack@keystone.service[80231]: from cryptography.utils import int_from_bytes Jul 19 12:16:55.971878 dv-cinder-820994-4-smb devstack@keystone.service[80230]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 12:16:55.971878 dv-cinder-820994-4-smb devstack@keystone.service[80230]: from cryptography.utils import int_from_bytes Jul 19 12:16:55.972284 dv-cinder-820994-4-smb devstack@keystone.service[80231]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 12:16:55.972284 dv-cinder-820994-4-smb devstack@keystone.service[80231]: from cryptography.utils import int_from_bytes Jul 19 12:16:55.972381 dv-cinder-820994-4-smb devstack@keystone.service[80230]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 12:16:55.972381 dv-cinder-820994-4-smb devstack@keystone.service[80230]: from cryptography.utils import int_from_bytes Jul 19 12:16:56.021047 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 12:16:56.021256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 12:16:56.021352 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 12:16:56.021469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 12:16:56.021686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] command line args: [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 12:16:56.021774 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] command line args: [] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 12:16:56.021987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 12:16:56.022112 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 12:16:56.022190 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ================================================================================ {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 12:16:56.022294 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ================================================================================ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 12:16:56.022411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] admin_token = **** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.022551 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] admin_token = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.022661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] config_dir = [] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.022832 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] config_dir = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.022962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.023037 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.023105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] config_source = [] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.023173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] config_source = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.023239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] debug = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.023355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] debug = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.023451 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.023704 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.023790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.023849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.023905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.023960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.024164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.024279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.024413 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.024526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.024648 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] list_limit = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.024751 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.024861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_config_append = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.024962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] log_config_append = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.025061 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.025160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.025261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_dir = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.025359 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] log_dir = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.025464 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_file = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.025564 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] log_file = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.025667 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.025788 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.025862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.025983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.026068 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.026139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.026202 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.026277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.026402 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.026477 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.026606 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.026692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.026788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.026913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.027034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.027116 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.027236 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.027320 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.027467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.027549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.027697 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.027833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.027928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.028006 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.028171 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.028295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.028414 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.028499 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.028691 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.028963 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.029206 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.029393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] publish_errors = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.029480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.029632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.029753 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] publish_errors = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.029862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.029939 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.030055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.030127 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.030240 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.030311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.030488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.030574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.030720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] standard_threads = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.030818 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.030976 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.031120 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] standard_threads = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.031199 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.031274 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.031384 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.031459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.031560 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] use_journal = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.031644 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.031742 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] use_json = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.031825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_journal = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.031896 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_json = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.031964 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] use_stderr = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.032071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_stderr = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.032154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] use_syslog = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.032231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_syslog = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.032301 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.032460 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 12:16:56.032536 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.032715 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.032795 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.032952 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.033034 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.033209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.033292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.033446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.033523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.033693 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.033771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.033930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.034007 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.034167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.034244 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.034400 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.034479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.034650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.034752 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.034921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.035001 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.035181 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.035332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.035957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.036078 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.036204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.036376 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.036526 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.036636 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.036710 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.036846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.037002 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.037085 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.037161 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.037316 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.037394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.037570 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.037659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.037817 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.037893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.038061 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.038141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.038296 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.038387 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.038547 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.038631 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.038827 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.038909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.039064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.039157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.039298 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.039375 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.039529 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.039607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.039755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.039840 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.039983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.040067 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.040217 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.040293 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.040451 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.040528 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.040682 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.040765 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.040909 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.040986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.041138 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.041217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.041383 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.041459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.041628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.041711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.041856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.041933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.042092 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.042169 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.042319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.042395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.042542 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.042621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.042792 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.042873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.043026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.043112 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.043257 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.043341 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.043482 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.043559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.043711 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.043794 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.043946 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.044024 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.044180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.044255 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.044412 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.044494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.044646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.044723 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.044873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.044948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.045106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.045182 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.045341 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.045417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.045580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.045656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.045805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.045912 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.046041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.046155 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.046276 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.046380 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.046508 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.046618 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.046722 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.046849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.046986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.047100 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.047224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.047341 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.047458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.047557 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.047679 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.047763 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.047899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.047979 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.048127 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.048213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.048358 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.048434 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.048604 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.048682 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.048829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.048905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.049064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.049143 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.049298 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.049375 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.049560 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.049636 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.049793 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.049878 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.050030 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.050106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.050268 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.050356 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.050501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.050576 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.050946 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.051089 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.051089 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.051369 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.051491 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.051556 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.051621 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.051691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.051755 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.051837 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.051934 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.052012 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.052172 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.052248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.052409 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.052497 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.052641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.052718 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.052875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.052952 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.053110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.053195 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.053369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.053446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.053607 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.053684 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.053846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.053996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.054070 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.054139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.054306 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.054383 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.054544 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.054633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.054798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.054896 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.055034 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.055111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.055261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.055337 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.055493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.055579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.055720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.055796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.055952 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.056028 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.056182 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.056267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.056423 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.056501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.056658 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.056743 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.056905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.056991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.057149 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.057226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.057392 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.057469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.057626 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] auth.external = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.057711 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.057859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.057937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.058079 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.external = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.058153 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.058308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.058414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.058598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] auth.password = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.058685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.058850 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.058931 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] auth.token = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.059082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.password = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.059159 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.059311 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.token = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.059391 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.059551 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.059629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.059781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.059865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.060025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.060104 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.060256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.060334 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.060492 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.060568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.060730 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] credential.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.060809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.060957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.061033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.061191 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.061269 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.061436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.061524 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.061678 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.061755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.061921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.062003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.062156 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.062230 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.062395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.062473 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.062629 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.062706 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.062914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.062994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.063167 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.063245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.063403 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.063480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.063655 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.063734 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.063932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.064008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.064175 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.064252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.064432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.064510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.064669 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] federation.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.064753 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.064914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.065001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.065147 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.065226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.065381 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.065460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.065617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.065693 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.065859 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.065937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.066085 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.066163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.066330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.066409 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.066626 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.066807 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.066920 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.067056 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.067209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.067380 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.067474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.067614 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.067693 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.067860 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.067939 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.068095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.068254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.068329 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.068400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.068577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.068656 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.068811 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.068891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.069045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.069169 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.069398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.069517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.069633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.069713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.069871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.069950 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.070122 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.070200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.070357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.070437 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.070591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.070669 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.070847 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.070927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.071081 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.071168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.071327 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.071405 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.071575 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.071653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.071820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.071899 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.072075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.072154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.072321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.072399 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.072573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.072653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.072813 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.072891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.073046 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.073124 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.073274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.073353 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.073506 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.073583 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.073733 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.073810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.073968 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.074047 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.074206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.074284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.074448 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.074526 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.074680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.074806 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.074939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.075017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.075188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.075276 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.075425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.075504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.075658 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.075736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.075904 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.075982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.076134 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.076213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.076367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.076445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.076597 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.076674 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.076823 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.076903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.077059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.077139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.077293 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.077371 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.077528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.077606 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.077759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.077837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.077994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.078072 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.078239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.078318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.078467 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.078544 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.078698 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.078796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.078948 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.079028 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.079197 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.079275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.079432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.079508 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.079662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.079741 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.079895 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.079973 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.080125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.080202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.080353 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.080433 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.080591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.080669 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.080831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.080916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.081065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.081143 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.081310 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.081388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.081554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.081645 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.081795 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.081873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.082531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.082617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.082912 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.083074 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.083214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.083325 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.083400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.083470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.083607 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.083696 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.083867 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.083945 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.084123 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.084202 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.084370 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.084457 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.084616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.084693 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.084862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.084940 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.085092 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.085178 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.085321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.085399 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.085565 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.085642 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.085799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.085885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.086033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.086118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.086266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.086351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.086499 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.086586 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.086787 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.086870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.087004 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.087081 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.087238 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.087328 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.087483 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.087561 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.087712 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.087789 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.087953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.088038 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.088187 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.088265 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.088421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.088499 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.088658 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.088746 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.088899 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.088976 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.089133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.089211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.089360 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.089446 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.089596 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.089674 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] resource.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.089834 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.089912 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.090082 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.090171 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.090322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.090401 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.090552 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.090630 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.090823 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.090918 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.091062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.091140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.091297 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.091375 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.091536 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.091689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.091765 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.091835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.091993 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.092071 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] role.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.092225 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] role.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.092312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] role.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.092468 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.092546 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] role.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.092695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.092773 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.092942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.093032 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.093187 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.093265 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.093431 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.093508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.093677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.093762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.093918 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.093996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.094162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.094240 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.094406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.094486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.094635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.094712 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.094898 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.094975 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.095145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.095225 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.095386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.095464 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.095631 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.095709 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.095873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.096027 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.096262 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.096340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.096496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.096575 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.096746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.096826 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.096991 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.097076 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.097234 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.097312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.097468 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.097547 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.097770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.098402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.098569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.098709 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.098893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.098975 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.099073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.099152 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.099305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.099384 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.099535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.099616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.099766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.099845 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.100014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.100101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.100270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.100350 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.100517 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.100596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.100753 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.100840 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.100988 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.101067 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.101217 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.101295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] token.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.101451 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.101538 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.101686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.101764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.101913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.102007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.102151 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.102238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.102404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.102481 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.102645 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.102724 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.102903 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.102994 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.103148 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.103226 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.103386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.103464 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.103620 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.103707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.103853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.103931 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.104087 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.104166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.104318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.104404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.104562 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.104641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.104791 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.104868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.105037 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.105124 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.105279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.105357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.105569 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.105649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.connection = **** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.105819 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.105906 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.106059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.106146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.106293 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.106373 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.106526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.106604 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.106778 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.106861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.107061 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.107150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.107299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.107378 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.107533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.107610 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.107764 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.107844 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.108000 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.108078 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.108231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.108376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.108461 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.108534 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.108693 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.108772 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.108927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.109004 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.109157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.109236 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.109386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.109463 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.109610 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.109688 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.109845 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.109932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.110005 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 12:16:56.110076 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 12:16:56.110229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 12:16:56.140900 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.141124 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.141350 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.141683 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.141916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.142148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.150174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.150974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.178645 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.178895 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.178981 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.179129 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.321438 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.321678 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.370209 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.370444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.370943 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.371180 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.435233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.435459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.435689 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.435775 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.435913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.435997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.436132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.436214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.436348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.436439 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.436580 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.436793 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.461351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.461576 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.461720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.461799 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.461879 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.462006 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.462087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.462227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.462309 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.462444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.462524 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.462653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.462752 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.462896 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.474343 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.474510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.486842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.486988 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.487096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.487217 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.487301 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.487436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.487519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.487656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.487740 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.487873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.487955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.488085 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.488167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.488381 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 12:16:56.505831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.506041 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 12:16:56.506377 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.506460 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.506576 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 12:16:56.506660 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 12:16:56.506871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.506968 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.507125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 12:16:56.507207 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.507379 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.507462 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.507630 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.507711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.507882 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.508133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.519019 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.519296 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.519415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.519623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.519833 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.520071 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.520210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.520364 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.528168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.528405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.531455 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.531658 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.531742 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.531931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.532015 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.532206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.532378 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.532588 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.532671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.532865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.532956 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.533118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.533200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.533380 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.533461 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.533661 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.533751 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.533929 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.534161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.534243 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.534433 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.534693 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.560981 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.561559 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.562579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.562889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.563168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.563446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.568185 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.568463 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.568679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.568763 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.568955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.569228 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.575998 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.576238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.576401 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.576678 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.580896 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.581184 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.581267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.581459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.581554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.581733 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.581816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.582003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.582588 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.582817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.582914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.583085 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.583174 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.583347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.583428 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.583607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.601769 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.602036 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.602121 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.602307 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.606612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.607160 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.610233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.610521 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.610724 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.611029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.616052 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.616525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.619661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.620091 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.623414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.623712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.623831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.624005 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.624124 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.624289 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.624418 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.624562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.624695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.624836 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.624971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.625241 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.644709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.644951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.645093 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.645319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.645416 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.645582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.645665 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.645838 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.653493 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.653661 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.655217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.655340 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.655489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.655572 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.658528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.658627 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.658830 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.658930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.659110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.659194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.659379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.659463 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.659657 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.659740 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.672922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.673038 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.673199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.673297 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.673488 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.673625 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.673750 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.673837 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.674025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.674108 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.674299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.674390 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.674570 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.674652 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.694753 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.695066 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.697996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.698357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.701447 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.701668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.703131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.703289 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.704743 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.704919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.705009 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.705197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.705301 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.705479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.712893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.713107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.714660 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.714993 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.717960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.718254 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.718535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.718832 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.720907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.721402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.721897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.722386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.728773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.729244 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.729706 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.733490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.733781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.734068 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.742488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.742792 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.742879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 12:16:56.743072 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.743156 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.743341 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.743424 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.743608 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.743693 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.743881 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.743963 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.744153 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.744243 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.744412 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.744494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.744677 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.744816 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.744938 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.745021 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.745203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.745283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.745458 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.745541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.745716 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.745798 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.745977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.746056 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.746241 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 12:16:56.784503 dv-cinder-820994-4-smb devstack@keystone.service[80231]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c8d3aed9c0 pid: 80231 (default app) Jul 19 12:16:56.784689 dv-cinder-820994-4-smb devstack@keystone.service[80230]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c8d3aed9c0 pid: 80230 (default app) Jul 19 12:16:56.787988 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117f8fb-e1a8-4944-8075-c4f9a197c9a5 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:56.788277 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117f8fb-e1a8-4944-8075-c4f9a197c9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:56.788549 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117f8fb-e1a8-4944-8075-c4f9a197c9a5 None None] PATH_INFO: `/v3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:56.792819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Tue Jul 19 12:16:56 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:04.549126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1595eb-e9ae-4ff5-ba04-052568010c4a None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:04.549688 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1595eb-e9ae-4ff5-ba04-052568010c4a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:04.549688 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1595eb-e9ae-4ff5-ba04-052568010c4a None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:04.554063 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:04.559306 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729c12e-554b-4986-bd5d-e3e524acd02c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:04.559711 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729c12e-554b-4986-bd5d-e3e524acd02c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:04.559850 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729c12e-554b-4986-bd5d-e3e524acd02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:04.629263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: INFO dbcounter [None req-7729c12e-554b-4986-bd5d-e3e524acd02c None None] Registered counter for database keystone Jul 19 12:17:04.650643 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG oslo_db.sqlalchemy.engines [None req-7729c12e-554b-4986-bd5d-e3e524acd02c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 12:17:04.656835 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writer thread running {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 12:17:04.833487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG passlib.handlers.bcrypt [None req-7729c12e-554b-4986-bd5d-e3e524acd02c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80231) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 19 12:17:04.833834 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG passlib.handlers.bcrypt [None req-7729c12e-554b-4986-bd5d-e3e524acd02c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80231) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 19 12:17:04.888261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7729c12e-554b-4986-bd5d-e3e524acd02c None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:04.889888 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7729c12e-554b-4986-bd5d-e3e524acd02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:05.011173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 19 12:17:05.078983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1595eb-e9ae-4ff5-ba04-052568010c4a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:05.150364 dv-cinder-820994-4-smb devstack@keystone.service[80230]: INFO dbcounter [None req-6d1595eb-e9ae-4ff5-ba04-052568010c4a None None] Registered counter for database keystone Jul 19 12:17:05.169553 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG oslo_db.sqlalchemy.engines [None req-6d1595eb-e9ae-4ff5-ba04-052568010c4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 12:17:05.175776 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writer thread running {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 12:17:05.294002 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1595eb-e9ae-4ff5-ba04-052568010c4a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:05.298322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666894d-5c27-403a-a3d1-080457c73130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:05.299015 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666894d-5c27-403a-a3d1-080457c73130 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:05.299303 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666894d-5c27-403a-a3d1-080457c73130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:05.299584 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666894d-5c27-403a-a3d1-080457c73130 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:05.307739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666894d-5c27-403a-a3d1-080457c73130 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:05.359949 dv-cinder-820994-4-smb devstack@keystone.service[80230]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e666894d-5c27-403a-a3d1-080457c73130 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 19 12:17:05.360292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666894d-5c27-403a-a3d1-080457c73130 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:05.370020 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Jul 19 12:17:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:17:05.376114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729c12e-554b-4986-bd5d-e3e524acd02c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:05.391285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729c12e-554b-4986-bd5d-e3e524acd02c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:05.396265 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925de18c-757f-4ec0-be5b-880a004e7128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:05.397372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925de18c-757f-4ec0-be5b-880a004e7128 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:05.397658 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925de18c-757f-4ec0-be5b-880a004e7128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:05.397929 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925de18c-757f-4ec0-be5b-880a004e7128 admin admin] PATH_INFO: `/v3/projects/0a118b268db6472d8ac22365fb14ce5a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:05.402023 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925de18c-757f-4ec0-be5b-880a004e7128 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a118b268db6472d8ac22365fb14ce5a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:05.452922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: WARNING keystone.common.rbac_enforcer.enforcer [None req-925de18c-757f-4ec0-be5b-880a004e7128 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 19 12:17:05.453259 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925de18c-757f-4ec0-be5b-880a004e7128 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:05.458597 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Tue Jul 19 12:17:05 2022] GET /identity/v3/projects/0a118b268db6472d8ac22365fb14ce5a => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:07.449905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1155b6-c6e8-4df7-82ac-0c28963d5f23 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:07.450450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1155b6-c6e8-4df7-82ac-0c28963d5f23 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:07.450450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1155b6-c6e8-4df7-82ac-0c28963d5f23 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:07.454574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:07.460630 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a815d-faa5-4dcb-9a4e-cd566c316964 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:07.461007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a815d-faa5-4dcb-9a4e-cd566c316964 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:07.461187 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a815d-faa5-4dcb-9a4e-cd566c316964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:07.479697 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5c2a815d-faa5-4dcb-9a4e-cd566c316964 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:07.481215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5c2a815d-faa5-4dcb-9a4e-cd566c316964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:07.489050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 19 12:17:07.511740 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1155b6-c6e8-4df7-82ac-0c28963d5f23 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:07.524704 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1155b6-c6e8-4df7-82ac-0c28963d5f23 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:07.528833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571de3ba-1ae2-426e-9212-f17ed6a2742d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:07.529460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571de3ba-1ae2-426e-9212-f17ed6a2742d admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:07.529741 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571de3ba-1ae2-426e-9212-f17ed6a2742d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:07.530013 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571de3ba-1ae2-426e-9212-f17ed6a2742d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:07.537632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571de3ba-1ae2-426e-9212-f17ed6a2742d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:07.539416 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571de3ba-1ae2-426e-9212-f17ed6a2742d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:07.548355 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Jul 19 12:17:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 12:17:07.553715 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a815d-faa5-4dcb-9a4e-cd566c316964 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:07.562677 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a815d-faa5-4dcb-9a4e-cd566c316964 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:07.567641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433489a7-7c51-483a-80eb-38d6579bace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:07.568516 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433489a7-7c51-483a-80eb-38d6579bace7 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:07.568802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433489a7-7c51-483a-80eb-38d6579bace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:07.569075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433489a7-7c51-483a-80eb-38d6579bace7 admin admin] PATH_INFO: `/v3/users/f6b1bae44b87419cac105e8b3296eaae` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:07.570458 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433489a7-7c51-483a-80eb-38d6579bace7 admin admin] RBAC: Authorizing `identity:get_user(user_id=f6b1bae44b87419cac105e8b3296eaae)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:07.572306 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433489a7-7c51-483a-80eb-38d6579bace7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:07.573852 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Tue Jul 19 12:17:07 2022] GET /identity/v3/users/f6b1bae44b87419cac105e8b3296eaae => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:09.665688 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614460c-05ab-47ce-b4fa-2d4384ee8cae None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:09.666231 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614460c-05ab-47ce-b4fa-2d4384ee8cae None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:09.666231 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614460c-05ab-47ce-b4fa-2d4384ee8cae None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:09.667636 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:09.673441 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f5eb0-f601-416c-b479-6e6ce2558e2c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:09.673828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f5eb0-f601-416c-b479-6e6ce2558e2c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:09.674001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f5eb0-f601-416c-b479-6e6ce2558e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:09.690769 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-db0f5eb0-f601-416c-b479-6e6ce2558e2c None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:09.692511 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-db0f5eb0-f601-416c-b479-6e6ce2558e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:09.701615 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d1028-1177-4332-b01b-2a6cab807bab None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:09.701905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d1028-1177-4332-b01b-2a6cab807bab None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:09.702191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d1028-1177-4332-b01b-2a6cab807bab None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:09.703578 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:17:09.709041 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d953235-def6-4156-976e-d9df4fdb78f4 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:09.709390 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d953235-def6-4156-976e-d9df4fdb78f4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:09.709733 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d953235-def6-4156-976e-d9df4fdb78f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:09.748385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG passlib.handlers.bcrypt [None req-6d953235-def6-4156-976e-d9df4fdb78f4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80230) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 19 12:17:09.748798 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG passlib.handlers.bcrypt [None req-6d953235-def6-4156-976e-d9df4fdb78f4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80230) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 19 12:17:09.775926 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:17:09.794947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6d953235-def6-4156-976e-d9df4fdb78f4 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:09.796540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6d953235-def6-4156-976e-d9df4fdb78f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:09.798273 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f5eb0-f601-416c-b479-6e6ce2558e2c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:09.823211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:09.897870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:17:09.903632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f5eb0-f601-416c-b479-6e6ce2558e2c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:09.919418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d953235-def6-4156-976e-d9df4fdb78f4 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:09.936564 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae400079-583b-472e-ac2b-54c774ce5103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:09.937362 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae400079-583b-472e-ac2b-54c774ce5103 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:09.937643 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae400079-583b-472e-ac2b-54c774ce5103 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:09.937917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae400079-583b-472e-ac2b-54c774ce5103 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:09.950472 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae400079-583b-472e-ac2b-54c774ce5103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:09.962281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ae400079-583b-472e-ac2b-54c774ce5103 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:17:09.962281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:09.962281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:09.962281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:09.962281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:09.962281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:09.962281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:09.962281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:09.962281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:09.962281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:09.962281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:09.962281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:09.962281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:09.962281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:09.962281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:09.962281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:09.963286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:09.963286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:09.963286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:09.963286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:09.963286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:09.963286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:09.963286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:09.963286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:09.963286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:09.963286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:09.963286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:09.963286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:09.963286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:09.963286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:09.963286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:09.963286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:09.964069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:09.964069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:09.964069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:09.964069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:09.964069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:09.964069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:09.964069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:09.964069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:09.964069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:09.964069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:09.964069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:17:09.964069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:09.964069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:17:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:17:09.969357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae400079-583b-472e-ac2b-54c774ce5103 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:10.022486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d953235-def6-4156-976e-d9df4fdb78f4 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:10.025033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:10.051811 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:10.062177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230380a-9ca3-4b92-b239-8cedaa893d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:10.063113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230380a-9ca3-4b92-b239-8cedaa893d4a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:10.063405 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230380a-9ca3-4b92-b239-8cedaa893d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:10.063681 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230380a-9ca3-4b92-b239-8cedaa893d4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:10.070921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae400079-583b-472e-ac2b-54c774ce5103 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:10.105299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ad094-58b7-4375-804e-7ae4de4a961c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:10.105974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ad094-58b7-4375-804e-7ae4de4a961c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:10.106260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ad094-58b7-4375-804e-7ae4de4a961c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:10.106536 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ad094-58b7-4375-804e-7ae4de4a961c None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:10.107315 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ad094-58b7-4375-804e-7ae4de4a961c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:10.107623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ad094-58b7-4375-804e-7ae4de4a961c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:10.109017 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ad094-58b7-4375-804e-7ae4de4a961c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:10.121407 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:10.127042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ad094-58b7-4375-804e-7ae4de4a961c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:10.135514 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230380a-9ca3-4b92-b239-8cedaa893d4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:10.137022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230380a-9ca3-4b92-b239-8cedaa893d4a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:10.225400 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ad094-58b7-4375-804e-7ae4de4a961c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:10.237102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 12:17:10.243502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230380a-9ca3-4b92-b239-8cedaa893d4a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:10.246204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:10.260893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ba311-bd9a-43a7-9943-f31753f6f90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:10.261773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ba311-bd9a-43a7-9943-f31753f6f90c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:10.262062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ba311-bd9a-43a7-9943-f31753f6f90c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:10.262338 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ba311-bd9a-43a7-9943-f31753f6f90c None admin] PATH_INFO: `/v3/users/f6b1bae44b87419cac105e8b3296eaae` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:10.263837 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ba311-bd9a-43a7-9943-f31753f6f90c None admin] RBAC: Authorizing `identity:get_user(user_id=f6b1bae44b87419cac105e8b3296eaae)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:10.265295 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ba311-bd9a-43a7-9943-f31753f6f90c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:10.266950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:10 2022] GET /identity/v3/users/f6b1bae44b87419cac105e8b3296eaae => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:10.272525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ba311-bd9a-43a7-9943-f31753f6f90c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:10.286902 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:10.342639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230380a-9ca3-4b92-b239-8cedaa893d4a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:10.373693 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ba311-bd9a-43a7-9943-f31753f6f90c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:10.376703 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc965c4f-addd-46e1-9678-3b4b20c86292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:10.377501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc965c4f-addd-46e1-9678-3b4b20c86292 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:10.377787 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc965c4f-addd-46e1-9678-3b4b20c86292 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:10.378062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc965c4f-addd-46e1-9678-3b4b20c86292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:10.399055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc965c4f-addd-46e1-9678-3b4b20c86292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:10.400712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc965c4f-addd-46e1-9678-3b4b20c86292 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:10.409239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb2c25-9fcc-4a7d-a0c6-a8a487e392e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:10.410122 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb2c25-9fcc-4a7d-a0c6-a8a487e392e7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:10.410405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb2c25-9fcc-4a7d-a0c6-a8a487e392e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:10.410678 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb2c25-9fcc-4a7d-a0c6-a8a487e392e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:10.411900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb2c25-9fcc-4a7d-a0c6-a8a487e392e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:10.413340 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb2c25-9fcc-4a7d-a0c6-a8a487e392e7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:10.414979 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 10/18] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:17:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:10.420693 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb2c25-9fcc-4a7d-a0c6-a8a487e392e7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:10.421272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-bc965c4f-addd-46e1-9678-3b4b20c86292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:17:10.421272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:10.421272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:10.421272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:10.421272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:10.421272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:10.421272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:10.421272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:10.421272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:10.421272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:10.421272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:10.421272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:10.421272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:17:10.421272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:17:10.421272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:17:10.422091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:17:10.422091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:10.422091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:10.422091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:10.422091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:10.422091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:10.422091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:10.422091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:10.422091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:10.422091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:10.422091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:10.422091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:10.422091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:10.422091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:10.422091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:10.422091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:10.422091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:10.422924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:17:10.422924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:17:10.422924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:17:10.422924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:17:10.422924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 9/19] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:17:10.428435 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc965c4f-addd-46e1-9678-3b4b20c86292 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:10.487278 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:10.501966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:10.522574 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb2c25-9fcc-4a7d-a0c6-a8a487e392e7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:10.533593 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc965c4f-addd-46e1-9678-3b4b20c86292 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:10.556470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4091c7-7cbe-40dc-91be-1417f9080bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:10.557127 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4091c7-7cbe-40dc-91be-1417f9080bee None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:10.557410 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4091c7-7cbe-40dc-91be-1417f9080bee None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:10.557688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4091c7-7cbe-40dc-91be-1417f9080bee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:10.558511 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4091c7-7cbe-40dc-91be-1417f9080bee None admin] RBAC: Adding query filter params (role.id=386cb814e8464fda8832b13c75eabdaf, scope.domain.id=default, user.id=f6b1bae44b87419cac105e8b3296eaae) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:10.558850 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4091c7-7cbe-40dc-91be-1417f9080bee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:10.560274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4091c7-7cbe-40dc-91be-1417f9080bee None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:10.567876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 11/20] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Jul 19 12:17:10 2022] GET /identity/v3/role_assignments?user.id=f6b1bae44b87419cac105e8b3296eaae&scope.domain.id=default&role.id=386cb814e8464fda8832b13c75eabdaf => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:10.568007 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ded6c-4d63-46fe-bc4c-2e602f8e4633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:10.568381 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ded6c-4d63-46fe-bc4c-2e602f8e4633 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:10.568666 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ded6c-4d63-46fe-bc4c-2e602f8e4633 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:10.568946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ded6c-4d63-46fe-bc4c-2e602f8e4633 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:10.569704 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ded6c-4d63-46fe-bc4c-2e602f8e4633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:10.569990 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ded6c-4d63-46fe-bc4c-2e602f8e4633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:10.571437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ded6c-4d63-46fe-bc4c-2e602f8e4633 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:10.592009 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 10/21] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:12.685310 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7eb4e-30b7-402a-b398-f0e483464b73 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:12.686347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7eb4e-30b7-402a-b398-f0e483464b73 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:12.686893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7eb4e-30b7-402a-b398-f0e483464b73 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:12.688908 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 12/22] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:12.695353 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb46ed-aae6-4a5f-8637-1ef9b8fb4ba4 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:12.696187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb46ed-aae6-4a5f-8637-1ef9b8fb4ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:12.696674 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb46ed-aae6-4a5f-8637-1ef9b8fb4ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:12.723733 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-92fb46ed-aae6-4a5f-8637-1ef9b8fb4ba4 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:12.725028 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-92fb46ed-aae6-4a5f-8637-1ef9b8fb4ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:12.815053 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 11/23] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:17:12.848851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7eb4e-30b7-402a-b398-f0e483464b73 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:12.969287 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7eb4e-30b7-402a-b398-f0e483464b73 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:13.005686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115fed-c56a-4f50-89e6-754a55bde07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:13.006480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115fed-c56a-4f50-89e6-754a55bde07f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:13.006777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115fed-c56a-4f50-89e6-754a55bde07f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:13.007057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115fed-c56a-4f50-89e6-754a55bde07f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:13.018096 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc115fed-c56a-4f50-89e6-754a55bde07f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:13.026671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-cc115fed-c56a-4f50-89e6-754a55bde07f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:17:13.026671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:13.026671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:13.026671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:13.026671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:13.026671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:13.026671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:13.026671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:13.026671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:13.026671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:13.026671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:13.026671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:13.026671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:13.026671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:13.026671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:13.026671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:13.027504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:13.027504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:13.027504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:13.027504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:13.027504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:13.027504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:13.027504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:13.027504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:13.027504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:13.027504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:13.027504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:13.027504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:13.027504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:13.027504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:13.027504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:13.027504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:13.028745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:13.028745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:13.028745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:13.028745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:13.028745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:13.028745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:13.028745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:13.028745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:13.028745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:13.028745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:13.028745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:17:13.028745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:13.028745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 13/24] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:17:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:13.033824 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb46ed-aae6-4a5f-8637-1ef9b8fb4ba4 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:13.101077 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:13.172239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb46ed-aae6-4a5f-8637-1ef9b8fb4ba4 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:13.214472 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f733f-03b0-45c1-a8a1-701fd06f6f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:13.215191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f733f-03b0-45c1-a8a1-701fd06f6f5d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:13.215477 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f733f-03b0-45c1-a8a1-701fd06f6f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:13.215755 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f733f-03b0-45c1-a8a1-701fd06f6f5d None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:13.216523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f733f-03b0-45c1-a8a1-701fd06f6f5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:13.216830 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f733f-03b0-45c1-a8a1-701fd06f6f5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:13.218234 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f733f-03b0-45c1-a8a1-701fd06f6f5d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:13.231439 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 12/25] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:13.237228 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115fed-c56a-4f50-89e6-754a55bde07f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:13.249392 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:13.413152 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adad66-683a-4fd1-a8a6-530b2e244e66 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:13.413928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adad66-683a-4fd1-a8a6-530b2e244e66 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:13.414420 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adad66-683a-4fd1-a8a6-530b2e244e66 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:13.416262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 13/26] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:17:13.422570 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8456b-e029-4578-b994-5bd2c9cee659 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:13.423115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8456b-e029-4578-b994-5bd2c9cee659 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:13.423591 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8456b-e029-4578-b994-5bd2c9cee659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:13.428058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115fed-c56a-4f50-89e6-754a55bde07f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:13.453701 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-57e8456b-e029-4578-b994-5bd2c9cee659 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:13.456075 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-57e8456b-e029-4578-b994-5bd2c9cee659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:13.493244 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e57a7-4be4-4651-aff6-d6f755ecc9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:13.494446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e57a7-4be4-4651-aff6-d6f755ecc9ef None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:13.494943 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e57a7-4be4-4651-aff6-d6f755ecc9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:13.495424 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e57a7-4be4-4651-aff6-d6f755ecc9ef None admin] PATH_INFO: `/v3/users/f6b1bae44b87419cac105e8b3296eaae` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:13.496934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e57a7-4be4-4651-aff6-d6f755ecc9ef None admin] RBAC: Authorizing `identity:get_user(user_id=f6b1bae44b87419cac105e8b3296eaae)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:13.498585 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e57a7-4be4-4651-aff6-d6f755ecc9ef None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:13.501284 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 14/27] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:13 2022] GET /identity/v3/users/f6b1bae44b87419cac105e8b3296eaae => generated 247 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:13.502844 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06bfc8-26a5-4f19-81da-f1bc17c6c4a2 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:13.505050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06bfc8-26a5-4f19-81da-f1bc17c6c4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:13.506260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06bfc8-26a5-4f19-81da-f1bc17c6c4a2 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:13.508448 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 15/28] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:13.509522 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06bfc8-26a5-4f19-81da-f1bc17c6c4a2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:13.579787 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 14/29] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:17:13.586362 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1d3af-d082-4a97-9716-2ca853acdbe6 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:13.586917 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1d3af-d082-4a97-9716-2ca853acdbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:13.587403 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1d3af-d082-4a97-9716-2ca853acdbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:13.615465 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-12e1d3af-d082-4a97-9716-2ca853acdbe6 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:13.617954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-12e1d3af-d082-4a97-9716-2ca853acdbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:13.647805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:13.680799 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:13.716216 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06bfc8-26a5-4f19-81da-f1bc17c6c4a2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:13.770177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 15/30] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:13.771685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1d3af-d082-4a97-9716-2ca853acdbe6 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:13.798323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57214b23-de91-4cb7-a824-da5e86fe182c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:13.799587 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57214b23-de91-4cb7-a824-da5e86fe182c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:13.801595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57214b23-de91-4cb7-a824-da5e86fe182c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:13.802106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57214b23-de91-4cb7-a824-da5e86fe182c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:13.803845 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57214b23-de91-4cb7-a824-da5e86fe182c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:13.808040 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57214b23-de91-4cb7-a824-da5e86fe182c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:13.814900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 16/31] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:17:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:13.821329 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57214b23-de91-4cb7-a824-da5e86fe182c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:13.916119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1d3af-d082-4a97-9716-2ca853acdbe6 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:13.952930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d11f7-a4d6-4b18-af88-d478d43d0ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:13.953963 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d11f7-a4d6-4b18-af88-d478d43d0ef9 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:13.954081 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57214b23-de91-4cb7-a824-da5e86fe182c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:13.954545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d11f7-a4d6-4b18-af88-d478d43d0ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:13.955049 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d11f7-a4d6-4b18-af88-d478d43d0ef9 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:13.956147 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d11f7-a4d6-4b18-af88-d478d43d0ef9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:13.958610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d11f7-a4d6-4b18-af88-d478d43d0ef9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:13.992745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a754b-ff52-4dba-92f0-a4a22d894a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:13.993863 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a754b-ff52-4dba-92f0-a4a22d894a34 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:13.994292 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a754b-ff52-4dba-92f0-a4a22d894a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:13.994756 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a754b-ff52-4dba-92f0-a4a22d894a34 None admin] PATH_INFO: `/v3/domains/default/users/f6b1bae44b87419cac105e8b3296eaae/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:13.996953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a754b-ff52-4dba-92f0-a4a22d894a34 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f6b1bae44b87419cac105e8b3296eaae, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:13.998566 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a754b-ff52-4dba-92f0-a4a22d894a34 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:14.015419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:14.093494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 16/32] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Jul 19 12:17:13 2022] POST /identity/v3/roles => generated 219 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:17:14.094855 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d11f7-a4d6-4b18-af88-d478d43d0ef9 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:14.131238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:14.136401 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 17/33] 10.222.0.25 () {58 vars in 1361 bytes} [Tue Jul 19 12:17:13 2022] PUT /identity/v3/domains/default/users/f6b1bae44b87419cac105e8b3296eaae/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:17:14.140762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5859fb5-c395-48fd-b9e8-35957d5432b5 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:14.141404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5859fb5-c395-48fd-b9e8-35957d5432b5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:14.141901 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5859fb5-c395-48fd-b9e8-35957d5432b5 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:14.147679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 18/34] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:14.156446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c498-5623-4404-b453-c7a806c51b21 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:14.160545 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c498-5623-4404-b453-c7a806c51b21 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:14.161163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c498-5623-4404-b453-c7a806c51b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:14.201115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a262c498-5623-4404-b453-c7a806c51b21 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:14.204620 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a262c498-5623-4404-b453-c7a806c51b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:14.265605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d11f7-a4d6-4b18-af88-d478d43d0ef9 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:14.356515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edf350-294d-44d4-94d4-221783e28372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:14.357776 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edf350-294d-44d4-94d4-221783e28372 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:14.358336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edf350-294d-44d4-94d4-221783e28372 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:14.358922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edf350-294d-44d4-94d4-221783e28372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:14.363772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 19/35] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:14.366316 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f242f-2486-4f65-8026-789b8ee09b5a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:14.366871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f242f-2486-4f65-8026-789b8ee09b5a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:14.367355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f242f-2486-4f65-8026-789b8ee09b5a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:14.372810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 20/36] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:14.374677 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed228fe-b9b5-4b75-a425-5be69df869ae None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:14.375212 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed228fe-b9b5-4b75-a425-5be69df869ae None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:14.375729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed228fe-b9b5-4b75-a425-5be69df869ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:14.376091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edf350-294d-44d4-94d4-221783e28372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:14.377898 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edf350-294d-44d4-94d4-221783e28372 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:14.400102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-f1edf350-294d-44d4-94d4-221783e28372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:17:14.400102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:14.400102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:14.400102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:14.400102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:14.400102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:14.400102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:14.400102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:14.400102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:14.400102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:14.400102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:14.400102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:14.400102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:17:14.400102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:17:14.400102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:17:14.400926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:17:14.400926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:14.400926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:14.400926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:14.400926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:14.400926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:14.400926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:14.400926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:14.400926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:14.400926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:14.400926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:14.400926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:14.400926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:14.400926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:14.400926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:14.400926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:14.400926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:14.401723 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:17:14.401723 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:17:14.401723 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:17:14.401723 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:17:14.401723 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 17/37] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:14.402111 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edf350-294d-44d4-94d4-221783e28372 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:14.402505 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1ed228fe-b9b5-4b75-a425-5be69df869ae None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:14.404151 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1ed228fe-b9b5-4b75-a425-5be69df869ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:14.493330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 21/38] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:17:14.494919 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed228fe-b9b5-4b75-a425-5be69df869ae None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:14.512217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:14.533817 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edf350-294d-44d4-94d4-221783e28372 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:14.570750 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13605e-fe4e-40b9-9168-1d5b7c98a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:14.572136 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13605e-fe4e-40b9-9168-1d5b7c98a6aa None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:14.572670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13605e-fe4e-40b9-9168-1d5b7c98a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:14.573145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13605e-fe4e-40b9-9168-1d5b7c98a6aa None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:14.574154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13605e-fe4e-40b9-9168-1d5b7c98a6aa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:14.575487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:14.577251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b13605e-fe4e-40b9-9168-1d5b7c98a6aa None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:14.594582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 18/39] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Jul 19 12:17:14 2022] POST /identity/v3/roles => generated 225 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:17:14.604262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13605e-fe4e-40b9-9168-1d5b7c98a6aa None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:14.642177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed228fe-b9b5-4b75-a425-5be69df869ae None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:14.683308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d61cc-cfc1-4f38-80b8-46e4feb84b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:14.683996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d61cc-cfc1-4f38-80b8-46e4feb84b0f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:14.684284 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d61cc-cfc1-4f38-80b8-46e4feb84b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:14.684563 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d61cc-cfc1-4f38-80b8-46e4feb84b0f None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:14.685318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d61cc-cfc1-4f38-80b8-46e4feb84b0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:14.685629 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d61cc-cfc1-4f38-80b8-46e4feb84b0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:14.687249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d61cc-cfc1-4f38-80b8-46e4feb84b0f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:14.708426 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 22/40] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:14.709825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07388a89-9395-4526-aa8c-6148fd5876e5 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:14.710119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07388a89-9395-4526-aa8c-6148fd5876e5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:14.710400 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07388a89-9395-4526-aa8c-6148fd5876e5 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:14.716723 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 23/41] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:14.717408 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07388a89-9395-4526-aa8c-6148fd5876e5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:14.759554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b13605e-fe4e-40b9-9168-1d5b7c98a6aa None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:14.802440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028758b-f717-466a-8086-863054638dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:14.803233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028758b-f717-466a-8086-863054638dae None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:14.804332 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028758b-f717-466a-8086-863054638dae None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:14.804332 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028758b-f717-466a-8086-863054638dae None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:14.804499 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028758b-f717-466a-8086-863054638dae None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:14.807592 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028758b-f717-466a-8086-863054638dae None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:14.820543 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:14.827203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 19/42] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Jul 19 12:17:14 2022] POST /identity/v3/roles => generated 223 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:17:14.829082 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d56fa-f031-4231-8677-7fd599f3d16b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:14.829383 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d56fa-f031-4231-8677-7fd599f3d16b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:14.829967 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d56fa-f031-4231-8677-7fd599f3d16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:14.858871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-dd2d56fa-f031-4231-8677-7fd599f3d16b None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:14.860797 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-dd2d56fa-f031-4231-8677-7fd599f3d16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:14.868833 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07388a89-9395-4526-aa8c-6148fd5876e5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:14.902944 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:14.922138 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbec2c-a912-48a9-a711-edf83ecd8f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:14.922948 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbec2c-a912-48a9-a711-edf83ecd8f3e None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:14.923265 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbec2c-a912-48a9-a711-edf83ecd8f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:14.923610 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbec2c-a912-48a9-a711-edf83ecd8f3e None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:14.924453 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbec2c-a912-48a9-a711-edf83ecd8f3e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:14.926148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbec2c-a912-48a9-a711-edf83ecd8f3e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:14.956031 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 20/43] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:14.979880 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d56fa-f031-4231-8677-7fd599f3d16b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:15.080584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 24/44] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 19 12:17:14 2022] POST /identity/v3/projects => generated 301 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:17:15.101150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d56fa-f031-4231-8677-7fd599f3d16b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:15.139315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:15.147096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffb397-420d-453f-b9da-6e9a9d8b24c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:15.147928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffb397-420d-453f-b9da-6e9a9d8b24c7 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:15.148217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffb397-420d-453f-b9da-6e9a9d8b24c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:15.148513 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffb397-420d-453f-b9da-6e9a9d8b24c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:15.150038 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffb397-420d-453f-b9da-6e9a9d8b24c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:15.151620 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffb397-420d-453f-b9da-6e9a9d8b24c7 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:15.153592 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 21/45] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:17:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:15.160697 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbec2c-a912-48a9-a711-edf83ecd8f3e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:15.275258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbec2c-a912-48a9-a711-edf83ecd8f3e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:15.310073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6aff34-fa62-4c82-9178-e3abc5dfe98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:15.310723 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aff34-fa62-4c82-9178-e3abc5dfe98d None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:15.311032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aff34-fa62-4c82-9178-e3abc5dfe98d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:15.311309 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aff34-fa62-4c82-9178-e3abc5dfe98d None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:15.312020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6aff34-fa62-4c82-9178-e3abc5dfe98d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:15.313449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6aff34-fa62-4c82-9178-e3abc5dfe98d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:15.338706 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 25/46] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 19 12:17:15 2022] POST /identity/v3/projects => generated 312 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:17:16.430474 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40302830-1a6f-4fb9-add4-80f02832ed18 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:16.431033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40302830-1a6f-4fb9-add4-80f02832ed18 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:16.431127 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40302830-1a6f-4fb9-add4-80f02832ed18 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:16.432456 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 22/47] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:16.438411 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263e32c-55d4-40b4-9018-b8183dd1cf3f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:16.438949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263e32c-55d4-40b4-9018-b8183dd1cf3f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:16.439032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263e32c-55d4-40b4-9018-b8183dd1cf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:16.456254 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b263e32c-55d4-40b4-9018-b8183dd1cf3f None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:16.457521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b263e32c-55d4-40b4-9018-b8183dd1cf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:16.475484 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:16.526642 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 26/48] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:16.550306 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40302830-1a6f-4fb9-add4-80f02832ed18 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:16.650870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40302830-1a6f-4fb9-add4-80f02832ed18 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:16.683408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd2c6c-04d1-4937-9081-1b3cf4afacfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:16.684139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd2c6c-04d1-4937-9081-1b3cf4afacfb None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:16.684430 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd2c6c-04d1-4937-9081-1b3cf4afacfb None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:16.684709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd2c6c-04d1-4937-9081-1b3cf4afacfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:16.698365 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd2c6c-04d1-4937-9081-1b3cf4afacfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:16.707922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-dfcd2c6c-04d1-4937-9081-1b3cf4afacfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:17:16.707922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:16.707922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:16.707922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:16.707922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:16.707922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:16.707922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:16.707922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:16.707922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:16.707922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:16.707922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:16.707922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:16.707922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:16.707922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:16.707922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:16.707922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:16.708901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:16.708901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:16.708901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:16.708901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:16.708901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:16.708901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:16.708901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:16.708901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:16.708901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:16.708901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:16.708901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:16.708901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:16.708901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:16.708901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:16.708901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:16.708901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:16.709671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:16.709671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:16.709671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:16.709671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:16.709671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:16.709671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:16.709671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:16.709671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:16.709671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:16.709671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:16.709671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:17:16.709671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:17:16.709671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 23/49] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:17:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:16.715133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263e32c-55d4-40b4-9018-b8183dd1cf3f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:16.813694 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263e32c-55d4-40b4-9018-b8183dd1cf3f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:16.847791 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55285765-8fd4-4ea8-89da-fa118d77a1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:16.848457 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55285765-8fd4-4ea8-89da-fa118d77a1fb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:16.848746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55285765-8fd4-4ea8-89da-fa118d77a1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:16.849026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55285765-8fd4-4ea8-89da-fa118d77a1fb None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:16.849776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55285765-8fd4-4ea8-89da-fa118d77a1fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:16.850085 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55285765-8fd4-4ea8-89da-fa118d77a1fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:16.851493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55285765-8fd4-4ea8-89da-fa118d77a1fb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:16.859683 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 27/50] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:16.866115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd2c6c-04d1-4937-9081-1b3cf4afacfb None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:16.925181 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:16.968205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd2c6c-04d1-4937-9081-1b3cf4afacfb None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:17.001696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fb620-0c44-4b89-b23d-eebe01e012c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:17.002575 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fb620-0c44-4b89-b23d-eebe01e012c8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:17.002894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fb620-0c44-4b89-b23d-eebe01e012c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:17.003172 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fb620-0c44-4b89-b23d-eebe01e012c8 None admin] PATH_INFO: `/v3/users/f6b1bae44b87419cac105e8b3296eaae` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:17.005465 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fb620-0c44-4b89-b23d-eebe01e012c8 None admin] RBAC: Authorizing `identity:get_user(user_id=f6b1bae44b87419cac105e8b3296eaae)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:17.006946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fb620-0c44-4b89-b23d-eebe01e012c8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:17.008578 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 24/51] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:16 2022] GET /identity/v3/users/f6b1bae44b87419cac105e8b3296eaae => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:17.014220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55285765-8fd4-4ea8-89da-fa118d77a1fb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:17.032675 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:17.114847 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55285765-8fd4-4ea8-89da-fa118d77a1fb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:17.148701 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ca120-123f-479d-899a-38dd05e56935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:17.149494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ca120-123f-479d-899a-38dd05e56935 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:17.149781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ca120-123f-479d-899a-38dd05e56935 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:17.150058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ca120-123f-479d-899a-38dd05e56935 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:17.151323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ca120-123f-479d-899a-38dd05e56935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:17.152773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ca120-123f-479d-899a-38dd05e56935 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:17.154407 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 28/52] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:17:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:17.160681 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fb620-0c44-4b89-b23d-eebe01e012c8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:17.364941 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c2647-d502-4372-9a13-7030bcfc2dae None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:17.365155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c2647-d502-4372-9a13-7030bcfc2dae None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:17.365429 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c2647-d502-4372-9a13-7030bcfc2dae None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:17.366936 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 29/53] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:17:17.371873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abefc3-b8d6-49b2-962c-7985698039ae None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:17.372168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abefc3-b8d6-49b2-962c-7985698039ae None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:17.372451 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abefc3-b8d6-49b2-962c-7985698039ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:17.373553 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fb620-0c44-4b89-b23d-eebe01e012c8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:17.388935 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d1abefc3-b8d6-49b2-962c-7985698039ae None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:17.390140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d1abefc3-b8d6-49b2-962c-7985698039ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:17.399645 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:17.409112 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb99503-4759-48e9-bd8d-8d6d497e1b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:17.410346 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb99503-4759-48e9-bd8d-8d6d497e1b41 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:17.410692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb99503-4759-48e9-bd8d-8d6d497e1b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:17.411047 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb99503-4759-48e9-bd8d-8d6d497e1b41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:17.411893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb99503-4759-48e9-bd8d-8d6d497e1b41 None admin] RBAC: Adding query filter params (role.id=386cb814e8464fda8832b13c75eabdaf, scope.domain.id=default, user.id=f6b1bae44b87419cac105e8b3296eaae) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:17.412204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb99503-4759-48e9-bd8d-8d6d497e1b41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:17.413672 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb99503-4759-48e9-bd8d-8d6d497e1b41 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:17.422386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 25/54] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Jul 19 12:17:17 2022] GET /identity/v3/role_assignments?user.id=f6b1bae44b87419cac105e8b3296eaae&scope.domain.id=default&role.id=386cb814e8464fda8832b13c75eabdaf => generated 530 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:17.463784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 30/55] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:17:17.488557 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb99503-4759-48e9-bd8d-8d6d497e1b41 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:17.596061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb99503-4759-48e9-bd8d-8d6d497e1b41 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:17.631843 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d47b0f-d0c7-4da6-8da1-8f1c77a45640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:17.632587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d47b0f-d0c7-4da6-8da1-8f1c77a45640 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:17.632869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d47b0f-d0c7-4da6-8da1-8f1c77a45640 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:17.633151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d47b0f-d0c7-4da6-8da1-8f1c77a45640 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:17.634338 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d47b0f-d0c7-4da6-8da1-8f1c77a45640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:17.635931 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d47b0f-d0c7-4da6-8da1-8f1c77a45640 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:17.637555 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 26/56] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:17:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:17.643553 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abefc3-b8d6-49b2-962c-7985698039ae None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:17.659189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:17.744833 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abefc3-b8d6-49b2-962c-7985698039ae None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:17.779024 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef40243-a25e-489c-ac35-2cdf206dfcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:17.779679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef40243-a25e-489c-ac35-2cdf206dfcfd None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:17.779966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef40243-a25e-489c-ac35-2cdf206dfcfd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:17.780246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef40243-a25e-489c-ac35-2cdf206dfcfd None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:17.780949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef40243-a25e-489c-ac35-2cdf206dfcfd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:17.782395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef40243-a25e-489c-ac35-2cdf206dfcfd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:17.806680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 31/57] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Jul 19 12:17:17 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:17:19.861259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6b9e-5861-47ae-be9f-862e667ead60 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:19.861758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6b9e-5861-47ae-be9f-862e667ead60 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:19.861867 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6b9e-5861-47ae-be9f-862e667ead60 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:19.863737 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 27/58] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:19.868963 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee49d53-5636-49f1-bab8-9bda7f8cc3ef None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:19.869319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee49d53-5636-49f1-bab8-9bda7f8cc3ef None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:19.869530 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee49d53-5636-49f1-bab8-9bda7f8cc3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:19.886552 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cee49d53-5636-49f1-bab8-9bda7f8cc3ef None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:19.888034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cee49d53-5636-49f1-bab8-9bda7f8cc3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:19.945188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:19.953372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 32/59] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:19.979224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea6b9e-5861-47ae-be9f-862e667ead60 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:20.038129 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:20.078267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea6b9e-5861-47ae-be9f-862e667ead60 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:20.111386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70887b4-9af3-4487-9f53-2baf52768072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:20.112174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70887b4-9af3-4487-9f53-2baf52768072 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:20.112461 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70887b4-9af3-4487-9f53-2baf52768072 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:20.112767 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70887b4-9af3-4487-9f53-2baf52768072 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:20.113951 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70887b4-9af3-4487-9f53-2baf52768072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:20.115412 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70887b4-9af3-4487-9f53-2baf52768072 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:20.117011 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 28/60] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:17:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:20.122589 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee49d53-5636-49f1-bab8-9bda7f8cc3ef None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:20.220512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee49d53-5636-49f1-bab8-9bda7f8cc3ef None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:20.253011 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ee5b6-490b-489d-9974-69ddfe8df963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:20.254190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ee5b6-490b-489d-9974-69ddfe8df963 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:20.254472 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ee5b6-490b-489d-9974-69ddfe8df963 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:20.254765 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ee5b6-490b-489d-9974-69ddfe8df963 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:20.255649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ee5b6-490b-489d-9974-69ddfe8df963 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:20.257080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ee5b6-490b-489d-9974-69ddfe8df963 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:20.282282 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 33/61] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 19 12:17:20 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:17:23.334611 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289159d4-9f6d-4089-ab93-6d345c5b1c47 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:23.334611 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289159d4-9f6d-4089-ab93-6d345c5b1c47 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:23.334611 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289159d4-9f6d-4089-ab93-6d345c5b1c47 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:23.334611 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 29/62] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:23.340072 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5538a-668f-4af3-80fa-90aec0fdf3e6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:23.340799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5538a-668f-4af3-80fa-90aec0fdf3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:23.341234 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5538a-668f-4af3-80fa-90aec0fdf3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:23.367713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a3f5538a-668f-4af3-80fa-90aec0fdf3e6 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:23.369114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a3f5538a-668f-4af3-80fa-90aec0fdf3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:23.430268 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:23.464104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 34/63] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:17:23.509706 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289159d4-9f6d-4089-ab93-6d345c5b1c47 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:23.645150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289159d4-9f6d-4089-ab93-6d345c5b1c47 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:23.654573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53baa64a-a524-4a5f-a692-a7966bd54b6e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:23.655185 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53baa64a-a524-4a5f-a692-a7966bd54b6e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:23.655655 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53baa64a-a524-4a5f-a692-a7966bd54b6e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:23.657308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 35/64] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:17:23.663000 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80074934-ee36-4912-9d3c-b5cc32d25e98 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:23.663520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80074934-ee36-4912-9d3c-b5cc32d25e98 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:23.663989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80074934-ee36-4912-9d3c-b5cc32d25e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:23.678899 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:23.689325 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ddeb7-a348-4a13-823e-bced6e915535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:23.690448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ddeb7-a348-4a13-823e-bced6e915535 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:23.691007 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ddeb7-a348-4a13-823e-bced6e915535 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:23.691477 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ddeb7-a348-4a13-823e-bced6e915535 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:23.701968 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-80074934-ee36-4912-9d3c-b5cc32d25e98 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:23.703164 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-80074934-ee36-4912-9d3c-b5cc32d25e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:23.712214 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ddeb7-a348-4a13-823e-bced6e915535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:23.720033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-ea7ddeb7-a348-4a13-823e-bced6e915535 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:23.720033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:23.720033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:23.720033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:23.720033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:23.720033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:23.720033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:23.720033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:23.720033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:23.720033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:23.720033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:23.720033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:23.720033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:23.720033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:23.720033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:23.720033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:23.720856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:23.720856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:23.720856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:23.720856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:23.720856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:23.720856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:23.720856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:23.720856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:23.720856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:23.720856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:23.720856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:23.720856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:23.720856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:23.720856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:23.720856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:23.720856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:23.721619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:23.721619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:23.721619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:23.721619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:23.721619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:23.721619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:23.721619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:23.721619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:23.721619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:23.721619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:23.721619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:23.721619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:17:23.721619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 30/65] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:23.732937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ddeb7-a348-4a13-823e-bced6e915535 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:23.840016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 36/66] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:23.869870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80074934-ee36-4912-9d3c-b5cc32d25e98 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:23.914581 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ddeb7-a348-4a13-823e-bced6e915535 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:23.980474 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885c050-0049-450e-a2c7-ec7dc561591c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:23.981619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885c050-0049-450e-a2c7-ec7dc561591c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:23.981915 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885c050-0049-450e-a2c7-ec7dc561591c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:23.982200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885c050-0049-450e-a2c7-ec7dc561591c None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:23.983427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885c050-0049-450e-a2c7-ec7dc561591c None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:23.984032 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885c050-0049-450e-a2c7-ec7dc561591c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:23.985695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885c050-0049-450e-a2c7-ec7dc561591c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:23.997501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 31/67] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:23.998978 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aa42e-b0e1-44de-aa1e-ab73b8c87e5b None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:23.999278 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aa42e-b0e1-44de-aa1e-ab73b8c87e5b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:23.999565 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aa42e-b0e1-44de-aa1e-ab73b8c87e5b None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:24.003742 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 32/68] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:24.005165 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d7ec5-fa45-4da2-8ec7-c27b7ef2e90f None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:24.005455 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d7ec5-fa45-4da2-8ec7-c27b7ef2e90f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:24.005912 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d7ec5-fa45-4da2-8ec7-c27b7ef2e90f None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:24.007274 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 33/69] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:24.008200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d7ec5-fa45-4da2-8ec7-c27b7ef2e90f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:24.013600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80074934-ee36-4912-9d3c-b5cc32d25e98 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:24.028961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:24.053101 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285e1d6-7a89-4a85-8a34-5d858dd72be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:24.053900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285e1d6-7a89-4a85-8a34-5d858dd72be9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:24.054178 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285e1d6-7a89-4a85-8a34-5d858dd72be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:24.054449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285e1d6-7a89-4a85-8a34-5d858dd72be9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:24.065341 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:24.065464 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285e1d6-7a89-4a85-8a34-5d858dd72be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:24.074132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-4285e1d6-7a89-4a85-8a34-5d858dd72be9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:17:24.074132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:24.074132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:24.074132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:24.074132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:24.074132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:24.074132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:24.074132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:24.074132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:24.074132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:24.074132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:24.074132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:24.074132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:24.074132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:24.074132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:24.074132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:24.075118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:24.075118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:24.075118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:24.075118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:24.075118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:24.075118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:24.075118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:24.075118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:24.075118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:24.075118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:24.075118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:24.075118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:24.075118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:24.075118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:24.075118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:24.075118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:24.075858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:24.075858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:24.075858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:24.075858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:24.075858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:24.075858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:24.075858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:24.075858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:24.075858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:24.075858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:24.075858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:17:24.075858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:24.075858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 37/70] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:17:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:17:24.077341 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87eda81-f74b-47f7-93b0-a14af08f6d06 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:24.077341 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87eda81-f74b-47f7-93b0-a14af08f6d06 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:24.077341 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87eda81-f74b-47f7-93b0-a14af08f6d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:24.095408 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b87eda81-f74b-47f7-93b0-a14af08f6d06 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:24.096597 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b87eda81-f74b-47f7-93b0-a14af08f6d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:24.126712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d7ec5-fa45-4da2-8ec7-c27b7ef2e90f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:24.165361 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e48e3f-20bf-4a4c-9b84-f072133791ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:24.166169 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e48e3f-20bf-4a4c-9b84-f072133791ad None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:24.166453 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e48e3f-20bf-4a4c-9b84-f072133791ad None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:24.166745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e48e3f-20bf-4a4c-9b84-f072133791ad None admin] PATH_INFO: `/v3/users/cab36057742a4256b2d6d72a97dec4da` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:24.168688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 38/71] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:24.172075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d46be2-45cf-4fcb-9c85-ffc1f6b06bad None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:24.172510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d46be2-45cf-4fcb-9c85-ffc1f6b06bad None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:24.172924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d46be2-45cf-4fcb-9c85-ffc1f6b06bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:24.186430 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e48e3f-20bf-4a4c-9b84-f072133791ad None admin] RBAC: Authorizing `identity:get_user(user_id=cab36057742a4256b2d6d72a97dec4da)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:24.188398 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e48e3f-20bf-4a4c-9b84-f072133791ad None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:24.190308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 34/72] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:24 2022] GET /identity/v3/users/cab36057742a4256b2d6d72a97dec4da => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:24.191810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e48e3f-20bf-4a4c-9b84-f072133791ad None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:24.197220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-62d46be2-45cf-4fcb-9c85-ffc1f6b06bad None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:24.198430 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-62d46be2-45cf-4fcb-9c85-ffc1f6b06bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:24.266895 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 39/73] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:24.267745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d46be2-45cf-4fcb-9c85-ffc1f6b06bad None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:24.295693 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e48e3f-20bf-4a4c-9b84-f072133791ad None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:24.299279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:24.303946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:24.330907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd636a-aa31-4fbd-b778-1b0e20c13878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:24.332404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd636a-aa31-4fbd-b778-1b0e20c13878 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:24.332750 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd636a-aa31-4fbd-b778-1b0e20c13878 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:24.333035 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd636a-aa31-4fbd-b778-1b0e20c13878 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:24.333789 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd636a-aa31-4fbd-b778-1b0e20c13878 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:24.334098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd636a-aa31-4fbd-b778-1b0e20c13878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:24.335527 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd636a-aa31-4fbd-b778-1b0e20c13878 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:24.343658 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 35/74] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:24.344454 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd636a-aa31-4fbd-b778-1b0e20c13878 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:24.374434 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d46be2-45cf-4fcb-9c85-ffc1f6b06bad None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:24.409782 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01034d-3a92-497d-ab03-b2d6f89a2001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:24.410590 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01034d-3a92-497d-ab03-b2d6f89a2001 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:24.410905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01034d-3a92-497d-ab03-b2d6f89a2001 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:24.411177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01034d-3a92-497d-ab03-b2d6f89a2001 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:24.421131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a01034d-3a92-497d-ab03-b2d6f89a2001 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:24.429932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9a01034d-3a92-497d-ab03-b2d6f89a2001 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:17:24.429932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:24.429932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:24.429932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:24.429932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:24.429932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:24.429932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:24.429932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:24.429932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:24.429932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:24.429932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:24.429932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:24.429932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:24.429932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:24.429932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:24.429932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:24.430853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:24.430853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:24.430853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:24.430853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:24.430853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:24.430853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:24.430853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:24.430853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:24.430853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:24.430853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:24.430853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:24.430853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:24.430853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:24.430853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:24.430853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:24.430853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:24.431602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:24.431602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:24.431602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:24.431602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:24.431602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:24.431602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:24.431602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:24.431602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:24.431602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:24.431602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:24.431602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:17:24.431602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:24.431602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 40/75] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:17:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:24.432382 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57368e-a1ba-4f1f-86de-3f227e863f13 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:24.432586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57368e-a1ba-4f1f-86de-3f227e863f13 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:24.432860 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57368e-a1ba-4f1f-86de-3f227e863f13 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:24.434120 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 41/76] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:24.434903 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57368e-a1ba-4f1f-86de-3f227e863f13 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:24.447390 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd636a-aa31-4fbd-b778-1b0e20c13878 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:24.480626 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e1f24-cd7f-4b8e-8202-886fe30ee581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:24.481278 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e1f24-cd7f-4b8e-8202-886fe30ee581 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:24.481564 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e1f24-cd7f-4b8e-8202-886fe30ee581 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:24.481841 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e1f24-cd7f-4b8e-8202-886fe30ee581 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:24.517359 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:24.527890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:24.537758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57368e-a1ba-4f1f-86de-3f227e863f13 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:24.550976 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e1f24-cd7f-4b8e-8202-886fe30ee581 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:24.552443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e1f24-cd7f-4b8e-8202-886fe30ee581 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:24.571563 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333645c-9d8a-4935-b03f-1b73db7289e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:24.572358 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333645c-9d8a-4935-b03f-1b73db7289e2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:24.572638 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333645c-9d8a-4935-b03f-1b73db7289e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:24.572912 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333645c-9d8a-4935-b03f-1b73db7289e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:24.583545 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333645c-9d8a-4935-b03f-1b73db7289e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:24.591106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6333645c-9d8a-4935-b03f-1b73db7289e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:24.591106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:24.591106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:24.591106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:24.591106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:24.591106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:24.591106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:24.591106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:24.591106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:24.591106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:24.591106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:24.591106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:24.591106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:24.591106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:24.591106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:24.591106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:24.591924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:24.591924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:24.591924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:24.591924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:24.591924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:24.591924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:24.591924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:24.591924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:24.591924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:24.591924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:24.591924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:24.591924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:24.591924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:24.591924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:24.591924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:24.591924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:24.592650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:24.592650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:24.592650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:24.592650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:24.592650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:24.592650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:24.592650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:24.592650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:24.592650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:24.592650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:24.592650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:24.592650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:24.592650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 42/77] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:24.593274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333645c-9d8a-4935-b03f-1b73db7289e2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:24.655562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 36/78] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:17:24.656847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b6b48-fc7e-4c5c-a41a-4e815eafc7d3 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:24.657135 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b6b48-fc7e-4c5c-a41a-4e815eafc7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:24.657415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b6b48-fc7e-4c5c-a41a-4e815eafc7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:24.673627 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ca6b6b48-fc7e-4c5c-a41a-4e815eafc7d3 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:24.674760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ca6b6b48-fc7e-4c5c-a41a-4e815eafc7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:24.697043 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333645c-9d8a-4935-b03f-1b73db7289e2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:24.731075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5808d6-9ade-4fcd-b8ff-61e88db66cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:24.731947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5808d6-9ade-4fcd-b8ff-61e88db66cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:24.732227 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5808d6-9ade-4fcd-b8ff-61e88db66cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:24.732499 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5808d6-9ade-4fcd-b8ff-61e88db66cc6 None admin] PATH_INFO: `/v3/users/f6b1bae44b87419cac105e8b3296eaae` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:24.733684 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5808d6-9ade-4fcd-b8ff-61e88db66cc6 None admin] RBAC: Authorizing `identity:get_user(user_id=f6b1bae44b87419cac105e8b3296eaae)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:24.735178 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5808d6-9ade-4fcd-b8ff-61e88db66cc6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:24.736829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 43/79] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:24 2022] GET /identity/v3/users/f6b1bae44b87419cac105e8b3296eaae => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:24.737621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5808d6-9ade-4fcd-b8ff-61e88db66cc6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:24.737738 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:24.758759 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 37/80] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:24.758759 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b6b48-fc7e-4c5c-a41a-4e815eafc7d3 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:24.764597 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:24.843778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5808d6-9ade-4fcd-b8ff-61e88db66cc6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:24.845003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b6b48-fc7e-4c5c-a41a-4e815eafc7d3 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:24.881515 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d94c1-f4a9-4258-8054-8073b519946e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:24.882195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d94c1-f4a9-4258-8054-8073b519946e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:24.882482 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d94c1-f4a9-4258-8054-8073b519946e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:24.882778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d94c1-f4a9-4258-8054-8073b519946e None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:24.883531 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d94c1-f4a9-4258-8054-8073b519946e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:24.883841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d94c1-f4a9-4258-8054-8073b519946e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:24.883934 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66924a60-61e4-4231-8578-2754df4285d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:24.884540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66924a60-61e4-4231-8578-2754df4285d8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:24.884820 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66924a60-61e4-4231-8578-2754df4285d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:24.885093 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66924a60-61e4-4231-8578-2754df4285d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:24.885238 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d94c1-f4a9-4258-8054-8073b519946e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:24.885850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66924a60-61e4-4231-8578-2754df4285d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:24.886153 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66924a60-61e4-4231-8578-2754df4285d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:24.887537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66924a60-61e4-4231-8578-2754df4285d8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:24.893566 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 44/81] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:17:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:24.895080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d94c1-f4a9-4258-8054-8073b519946e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:24.896792 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 38/82] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:24.897597 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66924a60-61e4-4231-8578-2754df4285d8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:24.957558 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:24.981698 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:24.999160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66924a60-61e4-4231-8578-2754df4285d8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:25.000137 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d94c1-f4a9-4258-8054-8073b519946e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:25.032905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e08d60-c62f-4b71-811d-71fa777003f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:25.033557 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e08d60-c62f-4b71-811d-71fa777003f3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:25.033842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e08d60-c62f-4b71-811d-71fa777003f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:25.034118 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e08d60-c62f-4b71-811d-71fa777003f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:25.034202 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d422c-28e0-4c61-b6f9-22245bf62d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:25.035154 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d422c-28e0-4c61-b6f9-22245bf62d23 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:25.035440 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d422c-28e0-4c61-b6f9-22245bf62d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:25.035721 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d422c-28e0-4c61-b6f9-22245bf62d23 None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:25.036925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d422c-28e0-4c61-b6f9-22245bf62d23 None admin] RBAC: Authorizing `identity:get_project(project_id=554f819c0ee841348da0445f933c4c69)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:25.038369 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d422c-28e0-4c61-b6f9-22245bf62d23 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:25.040113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 45/83] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:24 2022] GET /identity/v3/projects/554f819c0ee841348da0445f933c4c69 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:25.040885 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d422c-28e0-4c61-b6f9-22245bf62d23 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:25.102040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e08d60-c62f-4b71-811d-71fa777003f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:25.103509 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e08d60-c62f-4b71-811d-71fa777003f3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:25.141889 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d422c-28e0-4c61-b6f9-22245bf62d23 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:25.161086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:25.176232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a5053-a6b5-4a49-9301-96298a9ba8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:25.177032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a5053-a6b5-4a49-9301-96298a9ba8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:25.177321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a5053-a6b5-4a49-9301-96298a9ba8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:25.177592 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a5053-a6b5-4a49-9301-96298a9ba8d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:25.178780 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a5053-a6b5-4a49-9301-96298a9ba8d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:25.180214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a5053-a6b5-4a49-9301-96298a9ba8d0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:25.181827 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 46/84] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:17:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:25.182591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a5053-a6b5-4a49-9301-96298a9ba8d0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:25.202521 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 39/85] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:17:25.203389 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e08d60-c62f-4b71-811d-71fa777003f3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:25.208369 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:25.288635 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a5053-a6b5-4a49-9301-96298a9ba8d0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:25.303429 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e08d60-c62f-4b71-811d-71fa777003f3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:25.320886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c958ca2-e7d3-4329-8b11-ddd1102d3368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:25.321751 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c958ca2-e7d3-4329-8b11-ddd1102d3368 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:25.322030 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c958ca2-e7d3-4329-8b11-ddd1102d3368 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:25.322302 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c958ca2-e7d3-4329-8b11-ddd1102d3368 None admin] PATH_INFO: `/v3/users/cab36057742a4256b2d6d72a97dec4da` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:25.323507 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c958ca2-e7d3-4329-8b11-ddd1102d3368 None admin] RBAC: Authorizing `identity:get_user(user_id=cab36057742a4256b2d6d72a97dec4da)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:25.324938 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c958ca2-e7d3-4329-8b11-ddd1102d3368 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:25.326556 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 47/86] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:25 2022] GET /identity/v3/users/cab36057742a4256b2d6d72a97dec4da => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:25.327344 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c958ca2-e7d3-4329-8b11-ddd1102d3368 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:25.337527 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743c75e-6e18-49ae-b071-f563c6f1d604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:25.338417 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743c75e-6e18-49ae-b071-f563c6f1d604 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:25.338704 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743c75e-6e18-49ae-b071-f563c6f1d604 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:25.339016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743c75e-6e18-49ae-b071-f563c6f1d604 None admin] PATH_INFO: `/v3/users/cab36057742a4256b2d6d72a97dec4da` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:25.340233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743c75e-6e18-49ae-b071-f563c6f1d604 None admin] RBAC: Authorizing `identity:get_user(user_id=cab36057742a4256b2d6d72a97dec4da)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:25.341675 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743c75e-6e18-49ae-b071-f563c6f1d604 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:25.348260 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 40/87] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:25 2022] GET /identity/v3/users/cab36057742a4256b2d6d72a97dec4da => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:25.348260 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743c75e-6e18-49ae-b071-f563c6f1d604 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:25.372326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:25.414600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:25.430591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c958ca2-e7d3-4329-8b11-ddd1102d3368 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:25.445477 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743c75e-6e18-49ae-b071-f563c6f1d604 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:25.464712 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66ecff-6936-4d41-848c-769b7b67c66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:25.465306 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66ecff-6936-4d41-848c-769b7b67c66c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:25.465594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66ecff-6936-4d41-848c-769b7b67c66c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:25.465874 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66ecff-6936-4d41-848c-769b7b67c66c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:25.466713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66ecff-6936-4d41-848c-769b7b67c66c None admin] RBAC: Adding query filter params (role.id=61c33763c453452d82531c56aeb67287, scope.project.id=554f819c0ee841348da0445f933c4c69, user.id=cab36057742a4256b2d6d72a97dec4da) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:25.467068 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66ecff-6936-4d41-848c-769b7b67c66c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:25.468525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66ecff-6936-4d41-848c-769b7b67c66c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:25.474602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 48/88] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:17:25 2022] GET /identity/v3/role_assignments?user.id=cab36057742a4256b2d6d72a97dec4da&scope.project.id=554f819c0ee841348da0445f933c4c69&role.id=61c33763c453452d82531c56aeb67287 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:25.475343 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66ecff-6936-4d41-848c-769b7b67c66c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:25.486336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acb2d8-9118-423d-b016-5e68ac18bb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:25.487078 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acb2d8-9118-423d-b016-5e68ac18bb24 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:25.487361 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acb2d8-9118-423d-b016-5e68ac18bb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:25.487770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acb2d8-9118-423d-b016-5e68ac18bb24 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:25.488766 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05acb2d8-9118-423d-b016-5e68ac18bb24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:25.490293 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05acb2d8-9118-423d-b016-5e68ac18bb24 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:25.521707 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 41/89] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 19 12:17:25 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:17:25.535019 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acb2d8-9118-423d-b016-5e68ac18bb24 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:25.618291 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66ecff-6936-4d41-848c-769b7b67c66c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:25.636489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:25.658649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acb2d8-9118-423d-b016-5e68ac18bb24 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:25.665977 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b16bcd-8984-49ef-932b-d1d337fde845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:25.667156 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b16bcd-8984-49ef-932b-d1d337fde845 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:25.667536 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b16bcd-8984-49ef-932b-d1d337fde845 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:25.667910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b16bcd-8984-49ef-932b-d1d337fde845 None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:25.670017 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b16bcd-8984-49ef-932b-d1d337fde845 None admin] RBAC: Authorizing `identity:get_project(project_id=554f819c0ee841348da0445f933c4c69)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:25.672059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b16bcd-8984-49ef-932b-d1d337fde845 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:25.679480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 49/90] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:25 2022] GET /identity/v3/projects/554f819c0ee841348da0445f933c4c69 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:25.679480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b16bcd-8984-49ef-932b-d1d337fde845 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:25.705825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:25.720790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fef8a-e047-4a07-8c54-f609b03782db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:25.721386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fef8a-e047-4a07-8c54-f609b03782db None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:25.721671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fef8a-e047-4a07-8c54-f609b03782db None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:25.722466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fef8a-e047-4a07-8c54-f609b03782db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:25.811762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b16bcd-8984-49ef-932b-d1d337fde845 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:25.815751 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fef8a-e047-4a07-8c54-f609b03782db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:25.817529 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fef8a-e047-4a07-8c54-f609b03782db None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:25.859975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e4ebc-3a5c-4da5-bc4a-cbf27074a7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:25.861002 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e4ebc-3a5c-4da5-bc4a-cbf27074a7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:25.861514 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e4ebc-3a5c-4da5-bc4a-cbf27074a7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:25.862158 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e4ebc-3a5c-4da5-bc4a-cbf27074a7f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:25.928526 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:25.952042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e4ebc-3a5c-4da5-bc4a-cbf27074a7f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:25.953508 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e4ebc-3a5c-4da5-bc4a-cbf27074a7f8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:25.959994 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 42/91] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:17:25.960948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fef8a-e047-4a07-8c54-f609b03782db None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:25.974968 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:26.068519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 50/92] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:17:26.069381 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e4ebc-3a5c-4da5-bc4a-cbf27074a7f8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:26.092131 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fef8a-e047-4a07-8c54-f609b03782db None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:26.131566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711047fb-67c3-476a-9836-65f9f11046ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:26.132239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711047fb-67c3-476a-9836-65f9f11046ef None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:26.132528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711047fb-67c3-476a-9836-65f9f11046ef None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:26.132809 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711047fb-67c3-476a-9836-65f9f11046ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:26.133659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711047fb-67c3-476a-9836-65f9f11046ef None admin] RBAC: Adding query filter params (role.id=386cb814e8464fda8832b13c75eabdaf, scope.project.id=554f819c0ee841348da0445f933c4c69, user.id=f6b1bae44b87419cac105e8b3296eaae) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:26.133971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711047fb-67c3-476a-9836-65f9f11046ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:26.135598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711047fb-67c3-476a-9836-65f9f11046ef None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:26.142801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 43/93] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:17:25 2022] GET /identity/v3/role_assignments?user.id=f6b1bae44b87419cac105e8b3296eaae&scope.project.id=554f819c0ee841348da0445f933c4c69&role.id=386cb814e8464fda8832b13c75eabdaf => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:26.144769 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711047fb-67c3-476a-9836-65f9f11046ef None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:26.233113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:26.233991 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e4ebc-3a5c-4da5-bc4a-cbf27074a7f8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:26.262162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:26.293407 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f968a93-dbb5-46d9-894c-6ae99f66d37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:26.294296 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f968a93-dbb5-46d9-894c-6ae99f66d37b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:26.294580 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f968a93-dbb5-46d9-894c-6ae99f66d37b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:26.294879 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f968a93-dbb5-46d9-894c-6ae99f66d37b None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:26.297794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f968a93-dbb5-46d9-894c-6ae99f66d37b None admin] RBAC: Authorizing `identity:get_project(project_id=554f819c0ee841348da0445f933c4c69)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:26.299302 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f968a93-dbb5-46d9-894c-6ae99f66d37b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:26.301209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 51/94] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:26 2022] GET /identity/v3/projects/554f819c0ee841348da0445f933c4c69 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:26.308896 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f968a93-dbb5-46d9-894c-6ae99f66d37b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:26.345745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711047fb-67c3-476a-9836-65f9f11046ef None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:26.419504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f5b9b-c9f5-482c-995b-b2b76cac98c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:26.420762 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f5b9b-c9f5-482c-995b-b2b76cac98c5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:26.421239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f5b9b-c9f5-482c-995b-b2b76cac98c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:26.421728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f5b9b-c9f5-482c-995b-b2b76cac98c5 None admin] PATH_INFO: `/v3/projects/33838b6284394f989eab0b5fa952dda5` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:26.423261 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f5b9b-c9f5-482c-995b-b2b76cac98c5 None admin] RBAC: Authorizing `identity:get_project(project_id=33838b6284394f989eab0b5fa952dda5)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:26.424946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f5b9b-c9f5-482c-995b-b2b76cac98c5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:26.435310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 44/95] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:26 2022] GET /identity/v3/projects/33838b6284394f989eab0b5fa952dda5 => generated 312 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:26.456110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f5b9b-c9f5-482c-995b-b2b76cac98c5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:26.500134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f968a93-dbb5-46d9-894c-6ae99f66d37b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:26.549476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2eea9-f8d0-41a2-8c87-04ef71e78256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:26.551340 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2eea9-f8d0-41a2-8c87-04ef71e78256 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:26.551448 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2eea9-f8d0-41a2-8c87-04ef71e78256 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:26.551740 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2eea9-f8d0-41a2-8c87-04ef71e78256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:26.552595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2eea9-f8d0-41a2-8c87-04ef71e78256 None admin] RBAC: Adding query filter params (role.id=b929adc09fcc41daaf5cf39de856c1b6, scope.project.id=554f819c0ee841348da0445f933c4c69, user.id=cab36057742a4256b2d6d72a97dec4da) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:26.552912 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2eea9-f8d0-41a2-8c87-04ef71e78256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:26.554498 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2eea9-f8d0-41a2-8c87-04ef71e78256 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:26.565297 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 52/96] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:17:26 2022] GET /identity/v3/role_assignments?user.id=cab36057742a4256b2d6d72a97dec4da&scope.project.id=554f819c0ee841348da0445f933c4c69&role.id=b929adc09fcc41daaf5cf39de856c1b6 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:26.641871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f5b9b-c9f5-482c-995b-b2b76cac98c5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:26.661703 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:26.682195 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76b6fc-bb1d-4399-956e-701873f240f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:26.683311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76b6fc-bb1d-4399-956e-701873f240f1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:26.683797 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76b6fc-bb1d-4399-956e-701873f240f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:26.684264 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76b6fc-bb1d-4399-956e-701873f240f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:26.685332 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76b6fc-bb1d-4399-956e-701873f240f1 None admin] RBAC: Adding query filter params (role.id=61c33763c453452d82531c56aeb67287, scope.project.id=33838b6284394f989eab0b5fa952dda5, user.id=cab36057742a4256b2d6d72a97dec4da) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:26.685837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76b6fc-bb1d-4399-956e-701873f240f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:26.687549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76b6fc-bb1d-4399-956e-701873f240f1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:26.694313 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 45/97] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:17:26 2022] GET /identity/v3/role_assignments?user.id=cab36057742a4256b2d6d72a97dec4da&scope.project.id=33838b6284394f989eab0b5fa952dda5&role.id=61c33763c453452d82531c56aeb67287 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:28.182885 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dad272-dbaf-4508-a055-117698c24ec6 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:28.183917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dad272-dbaf-4508-a055-117698c24ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:28.184415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dad272-dbaf-4508-a055-117698c24ec6 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:28.186266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 53/98] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:28.193449 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37b50b-52ac-45cd-93ea-3f22014764ac None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:28.194335 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37b50b-52ac-45cd-93ea-3f22014764ac None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:28.194840 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37b50b-52ac-45cd-93ea-3f22014764ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:28.223822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-cc37b50b-52ac-45cd-93ea-3f22014764ac None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:28.225413 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cc37b50b-52ac-45cd-93ea-3f22014764ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:28.312067 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 46/99] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:28.337481 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3891cb-3262-4457-9a8c-8e593bfbdbc6 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:28.338054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3891cb-3262-4457-9a8c-8e593bfbdbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:28.338521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3891cb-3262-4457-9a8c-8e593bfbdbc6 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:28.340117 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 54/100] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:28.345519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b39de-063b-4659-90c4-27ac592e8a54 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:28.345819 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b39de-063b-4659-90c4-27ac592e8a54 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:28.346105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b39de-063b-4659-90c4-27ac592e8a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:28.347156 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3891cb-3262-4457-9a8c-8e593bfbdbc6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:28.375855 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0a5b39de-063b-4659-90c4-27ac592e8a54 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:28.377070 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0a5b39de-063b-4659-90c4-27ac592e8a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:28.442446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:28.520482 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 47/101] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:28.551847 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3891cb-3262-4457-9a8c-8e593bfbdbc6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:28.575476 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b39de-063b-4659-90c4-27ac592e8a54 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:28.612075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d3197-a072-464b-8cf7-6c51a178149f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:28.612941 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d3197-a072-464b-8cf7-6c51a178149f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:28.613401 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d3197-a072-464b-8cf7-6c51a178149f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:28.614278 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d3197-a072-464b-8cf7-6c51a178149f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:28.632937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d3197-a072-464b-8cf7-6c51a178149f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:28.650192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-149d3197-a072-464b-8cf7-6c51a178149f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:28.650192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:28.650192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:28.650192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:28.650192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:28.650192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:28.650192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:28.650192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:28.650192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:28.650192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:28.650192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:28.650192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:28.650192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:28.650192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:28.650192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:28.650192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:28.651087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:28.651087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:28.651087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:28.651087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:28.651087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:28.651087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:28.651087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:28.651087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:28.651087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:28.651087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:28.651087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:28.651087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:28.651087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:28.651087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:28.651087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:28.651087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:28.651814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:28.651814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:28.651814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:28.651814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:28.651814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:28.651814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:28.651814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:28.651814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:28.651814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:28.651814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:28.651814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:28.651814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:28.656293 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 55/102] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:28.657775 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d3197-a072-464b-8cf7-6c51a178149f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:28.679545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:28.804885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b39de-063b-4659-90c4-27ac592e8a54 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:28.823836 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d3197-a072-464b-8cf7-6c51a178149f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:28.839158 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:28.863830 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4811749-0f45-465b-b89b-1dffba9aacac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:28.864913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4811749-0f45-465b-b89b-1dffba9aacac None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:28.865407 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4811749-0f45-465b-b89b-1dffba9aacac None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:28.865890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4811749-0f45-465b-b89b-1dffba9aacac None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:28.866874 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4811749-0f45-465b-b89b-1dffba9aacac None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:28.867373 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4811749-0f45-465b-b89b-1dffba9aacac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:28.868328 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d156ec2-82d4-4c7d-88cb-7ef55bce201d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:28.869148 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d156ec2-82d4-4c7d-88cb-7ef55bce201d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:28.869395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4811749-0f45-465b-b89b-1dffba9aacac None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:28.869500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d156ec2-82d4-4c7d-88cb-7ef55bce201d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:28.869697 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d156ec2-82d4-4c7d-88cb-7ef55bce201d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:28.880113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 56/103] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:28.889631 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4811749-0f45-465b-b89b-1dffba9aacac None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:28.903434 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d156ec2-82d4-4c7d-88cb-7ef55bce201d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:28.911984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-5d156ec2-82d4-4c7d-88cb-7ef55bce201d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 12:17:28.911984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:28.911984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:28.911984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:28.911984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:28.911984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:28.911984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:28.911984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:28.911984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:28.911984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:28.911984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:28.911984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:28.911984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:28.911984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:28.911984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:28.911984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:28.912831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:28.912831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:28.912831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:28.912831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:28.912831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:28.912831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:28.912831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:28.912831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:28.912831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:28.912831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:28.912831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:28.912831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:28.912831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:28.912831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:28.912831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:28.912831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:28.913568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:28.913568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:28.913568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:28.913568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:28.913568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:28.913568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:28.913568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:28.913568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:28.913568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:28.913568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:28.913568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 12:17:28.913568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:17:28.913568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 48/104] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:17:28.919094 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d156ec2-82d4-4c7d-88cb-7ef55bce201d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:29.003111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4811749-0f45-465b-b89b-1dffba9aacac None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:29.063452 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007c114-cbc0-44ea-96c0-66b53e0a21b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:29.066129 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007c114-cbc0-44ea-96c0-66b53e0a21b2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:29.068176 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:29.069032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007c114-cbc0-44ea-96c0-66b53e0a21b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:29.070054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007c114-cbc0-44ea-96c0-66b53e0a21b2 None admin] PATH_INFO: `/v3/users/cab36057742a4256b2d6d72a97dec4da` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:29.072747 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d156ec2-82d4-4c7d-88cb-7ef55bce201d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:29.073627 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007c114-cbc0-44ea-96c0-66b53e0a21b2 None admin] RBAC: Authorizing `identity:get_user(user_id=cab36057742a4256b2d6d72a97dec4da)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:29.076899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007c114-cbc0-44ea-96c0-66b53e0a21b2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:29.079650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 57/105] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:28 2022] GET /identity/v3/users/cab36057742a4256b2d6d72a97dec4da => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:29.086419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007c114-cbc0-44ea-96c0-66b53e0a21b2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:29.144490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac0275-28c4-47ae-ae97-72bef275f6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:29.147008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac0275-28c4-47ae-ae97-72bef275f6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:29.147538 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac0275-28c4-47ae-ae97-72bef275f6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:29.148107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac0275-28c4-47ae-ae97-72bef275f6f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:29.149493 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac0275-28c4-47ae-ae97-72bef275f6f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:29.151594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac0275-28c4-47ae-ae97-72bef275f6f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:29.154636 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac0275-28c4-47ae-ae97-72bef275f6f1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:29.165316 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 49/106] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:29.165678 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:29.171050 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac0275-28c4-47ae-ae97-72bef275f6f1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:29.255109 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007c114-cbc0-44ea-96c0-66b53e0a21b2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:29.292052 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061f7d0-0780-4675-b093-d6e9ced19b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:29.293266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061f7d0-0780-4675-b093-d6e9ced19b51 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:29.293888 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061f7d0-0780-4675-b093-d6e9ced19b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:29.294376 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061f7d0-0780-4675-b093-d6e9ced19b51 None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:29.295804 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061f7d0-0780-4675-b093-d6e9ced19b51 None admin] RBAC: Authorizing `identity:get_project(project_id=554f819c0ee841348da0445f933c4c69)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:29.297428 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061f7d0-0780-4675-b093-d6e9ced19b51 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:29.299475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 58/107] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:29 2022] GET /identity/v3/projects/554f819c0ee841348da0445f933c4c69 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:29.300961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c698d-3efd-419f-ace5-deaa31ea7fd1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:29.301485 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c698d-3efd-419f-ace5-deaa31ea7fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:29.301950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c698d-3efd-419f-ace5-deaa31ea7fd1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:29.303484 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 59/108] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:29.304743 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bba033-9649-4caa-8e5f-6ca65e30b554 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:29.305466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bba033-9649-4caa-8e5f-6ca65e30b554 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:29.305955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bba033-9649-4caa-8e5f-6ca65e30b554 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:29.307427 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 60/109] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:29.308289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bba033-9649-4caa-8e5f-6ca65e30b554 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:29.338621 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac0275-28c4-47ae-ae97-72bef275f6f1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:29.375418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c848aa-94a9-4400-b5b5-ff1730678fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:29.376566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c848aa-94a9-4400-b5b5-ff1730678fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:29.376994 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c848aa-94a9-4400-b5b5-ff1730678fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:29.377411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c848aa-94a9-4400-b5b5-ff1730678fd6 None admin] PATH_INFO: `/v3/users/f4a06ad5e845499991fbdd7e95fb83e4` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:29.393379 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c848aa-94a9-4400-b5b5-ff1730678fd6 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a06ad5e845499991fbdd7e95fb83e4)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:29.395685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c848aa-94a9-4400-b5b5-ff1730678fd6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:29.397815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 50/110] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:29 2022] GET /identity/v3/users/f4a06ad5e845499991fbdd7e95fb83e4 => generated 289 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:29.399263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe4899-559b-48d2-a818-ff1c3c4f5607 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:29.399821 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe4899-559b-48d2-a818-ff1c3c4f5607 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:29.400313 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe4899-559b-48d2-a818-ff1c3c4f5607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:29.422404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-93fe4899-559b-48d2-a818-ff1c3c4f5607 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:29.424160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-93fe4899-559b-48d2-a818-ff1c3c4f5607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:29.426135 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bba033-9649-4caa-8e5f-6ca65e30b554 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:29.439014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:29.445180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:29.473955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21311b5-1c81-4096-b535-c3e073cc14a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:29.476101 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21311b5-1c81-4096-b535-c3e073cc14a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:29.476552 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21311b5-1c81-4096-b535-c3e073cc14a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:29.476964 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21311b5-1c81-4096-b535-c3e073cc14a1 None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69/users/cab36057742a4256b2d6d72a97dec4da/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:29.479214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21311b5-1c81-4096-b535-c3e073cc14a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=554f819c0ee841348da0445f933c4c69, user_id=cab36057742a4256b2d6d72a97dec4da, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:29.481385 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21311b5-1c81-4096-b535-c3e073cc14a1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:29.500440 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 61/111] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:17:29 2022] PUT /identity/v3/projects/554f819c0ee841348da0445f933c4c69/users/cab36057742a4256b2d6d72a97dec4da/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:17:29.502300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd79ff-2172-469a-9d57-73c370ed88e7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:29.503774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd79ff-2172-469a-9d57-73c370ed88e7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:29.504210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd79ff-2172-469a-9d57-73c370ed88e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:29.513352 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 51/112] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:29.514358 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe4899-559b-48d2-a818-ff1c3c4f5607 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:29.530410 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-eedd79ff-2172-469a-9d57-73c370ed88e7 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:29.532155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-eedd79ff-2172-469a-9d57-73c370ed88e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:29.639233 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 62/113] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:29.640410 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd79ff-2172-469a-9d57-73c370ed88e7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:29.658945 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe4899-559b-48d2-a818-ff1c3c4f5607 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:29.701730 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5644fb8-a77d-4730-a3eb-8c6f15dc6447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:29.701730 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5644fb8-a77d-4730-a3eb-8c6f15dc6447 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:29.701730 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5644fb8-a77d-4730-a3eb-8c6f15dc6447 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:29.701730 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5644fb8-a77d-4730-a3eb-8c6f15dc6447 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:29.721264 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:29.764788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:29.770627 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd79ff-2172-469a-9d57-73c370ed88e7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:29.781990 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5644fb8-a77d-4730-a3eb-8c6f15dc6447 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:29.784010 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5644fb8-a77d-4730-a3eb-8c6f15dc6447 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:29.810830 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfe064-2537-4f73-bb87-39d54df07945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:29.812030 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfe064-2537-4f73-bb87-39d54df07945 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:29.812417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfe064-2537-4f73-bb87-39d54df07945 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:29.812800 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfe064-2537-4f73-bb87-39d54df07945 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:29.814126 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfe064-2537-4f73-bb87-39d54df07945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:29.816282 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfe064-2537-4f73-bb87-39d54df07945 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:29.818319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 63/114] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:17:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:29.824082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405468a-fb23-472f-9e30-5a7f6d750f97 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:29.824514 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405468a-fb23-472f-9e30-5a7f6d750f97 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:29.824901 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405468a-fb23-472f-9e30-5a7f6d750f97 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:29.826391 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 64/115] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:29.827549 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405468a-fb23-472f-9e30-5a7f6d750f97 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:29.913595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 52/116] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:17:29.914830 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5644fb8-a77d-4730-a3eb-8c6f15dc6447 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:29.959220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405468a-fb23-472f-9e30-5a7f6d750f97 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:29.983479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:30.002459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d177c-ec19-484f-8a24-32d38c30b0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:30.003899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d177c-ec19-484f-8a24-32d38c30b0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:30.004191 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d177c-ec19-484f-8a24-32d38c30b0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:30.004470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d177c-ec19-484f-8a24-32d38c30b0f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:30.017342 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d177c-ec19-484f-8a24-32d38c30b0f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:30.027332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b23d177c-ec19-484f-8a24-32d38c30b0f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:17:30.027332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:30.027332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:30.027332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:30.027332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:30.027332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:30.027332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:30.027332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:30.027332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:30.027332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:30.027332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:30.027332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:30.027332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:30.027332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:30.027332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:30.027332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:30.028210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:30.028210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:30.028210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:30.028210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:30.028210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:30.028210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:30.028210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:30.028210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:30.028210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:30.028210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:30.028210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:30.028210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:30.028210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:30.028210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:30.028210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:30.028210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:30.028987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:30.028987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:30.028987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:30.028987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:30.028987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:30.028987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:30.028987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:30.028987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:30.028987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:30.028987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:30.028987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:17:30.028987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:30.029574 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 65/117] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:17:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:30.031482 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76f4a6-bf96-4df2-ba5a-fade631b4199 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:30.031880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76f4a6-bf96-4df2-ba5a-fade631b4199 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:30.032228 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76f4a6-bf96-4df2-ba5a-fade631b4199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:30.044552 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5644fb8-a77d-4730-a3eb-8c6f15dc6447 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:30.049329 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2b76f4a6-bf96-4df2-ba5a-fade631b4199 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:30.050719 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2b76f4a6-bf96-4df2-ba5a-fade631b4199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:30.076352 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:30.083296 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f261e-d1a7-4d2b-bab7-f5a229f05135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:30.083970 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f261e-d1a7-4d2b-bab7-f5a229f05135 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:30.084255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f261e-d1a7-4d2b-bab7-f5a229f05135 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:30.084533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f261e-d1a7-4d2b-bab7-f5a229f05135 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:30.085249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f261e-d1a7-4d2b-bab7-f5a229f05135 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:30.086760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f261e-d1a7-4d2b-bab7-f5a229f05135 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:30.120220 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 53/118] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 19 12:17:29 2022] POST /identity/v3/projects => generated 302 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:17:30.121468 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f261e-d1a7-4d2b-bab7-f5a229f05135 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:30.151340 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 66/119] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:30.153164 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedb67a-ee5b-49b8-b05d-68239e94c933 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:30.153819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedb67a-ee5b-49b8-b05d-68239e94c933 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:30.154042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedb67a-ee5b-49b8-b05d-68239e94c933 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:30.155882 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 67/120] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:30.160806 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedb67a-ee5b-49b8-b05d-68239e94c933 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:30.258864 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f261e-d1a7-4d2b-bab7-f5a229f05135 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:30.261096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:30.304252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedb67a-ee5b-49b8-b05d-68239e94c933 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:30.307436 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1ca9c-c5c6-4d19-8467-4f2ef065cf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:30.308590 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1ca9c-c5c6-4d19-8467-4f2ef065cf0f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:30.308938 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1ca9c-c5c6-4d19-8467-4f2ef065cf0f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:30.309223 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1ca9c-c5c6-4d19-8467-4f2ef065cf0f None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:30.310458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1ca9c-c5c6-4d19-8467-4f2ef065cf0f None admin] RBAC: Authorizing `identity:get_project(project_id=554f819c0ee841348da0445f933c4c69)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:30.311986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1ca9c-c5c6-4d19-8467-4f2ef065cf0f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:30.314073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 54/121] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:30 2022] GET /identity/v3/projects/554f819c0ee841348da0445f933c4c69 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:30.315500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d443807-ab5c-43e6-912b-898858e73b61 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:30.315914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d443807-ab5c-43e6-912b-898858e73b61 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:30.316217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d443807-ab5c-43e6-912b-898858e73b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:30.335033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9d443807-ab5c-43e6-912b-898858e73b61 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:30.336244 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9d443807-ab5c-43e6-912b-898858e73b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:30.352078 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6e0ab-4d5e-41d3-ac30-44de3fc20f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:30.353384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6e0ab-4d5e-41d3-ac30-44de3fc20f80 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:30.353763 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6e0ab-4d5e-41d3-ac30-44de3fc20f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:30.354621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6e0ab-4d5e-41d3-ac30-44de3fc20f80 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:30.355772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6e0ab-4d5e-41d3-ac30-44de3fc20f80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:30.356355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6e0ab-4d5e-41d3-ac30-44de3fc20f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:30.358328 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6e0ab-4d5e-41d3-ac30-44de3fc20f80 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:30.368704 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 68/122] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:30.368874 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6e0ab-4d5e-41d3-ac30-44de3fc20f80 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:30.396990 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:30.444676 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 55/123] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:30.445358 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d443807-ab5c-43e6-912b-898858e73b61 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:30.503929 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6e0ab-4d5e-41d3-ac30-44de3fc20f80 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:30.552094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a6dca-b8db-4ebe-9b07-66016a58e308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:30.553466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a6dca-b8db-4ebe-9b07-66016a58e308 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:30.554132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a6dca-b8db-4ebe-9b07-66016a58e308 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:30.555089 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a6dca-b8db-4ebe-9b07-66016a58e308 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:30.555300 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:30.559750 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d443807-ab5c-43e6-912b-898858e73b61 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:30.567376 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a6dca-b8db-4ebe-9b07-66016a58e308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:30.575487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-817a6dca-b8db-4ebe-9b07-66016a58e308 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:30.575487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:30.575487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:30.575487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:30.575487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:30.575487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:30.575487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:30.575487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:30.575487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:30.575487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:30.575487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:30.575487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:30.575487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:30.575487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:30.575487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:30.575487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:30.576349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:30.576349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:30.576349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:30.576349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:30.576349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:30.576349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:30.576349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:30.576349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:30.576349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:30.576349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:30.576349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:30.576349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:30.576349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:30.576349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:30.576349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:30.576349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:30.577075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:30.577075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:30.577075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:30.577075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:30.577075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:30.577075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:30.577075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:30.577075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:30.577075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:30.577075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:30.577075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:30.577075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:30.577075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 69/124] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:30.578477 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a6dca-b8db-4ebe-9b07-66016a58e308 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:30.607118 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dac4de-221c-4858-b07a-c1e4935894de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:30.608632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dac4de-221c-4858-b07a-c1e4935894de None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:30.609351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dac4de-221c-4858-b07a-c1e4935894de None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:30.609813 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dac4de-221c-4858-b07a-c1e4935894de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:30.611566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dac4de-221c-4858-b07a-c1e4935894de None admin] RBAC: Adding query filter params (role.id=eb94b5e764af483db56184d52333f6da, scope.project.id=554f819c0ee841348da0445f933c4c69, user.id=f4a06ad5e845499991fbdd7e95fb83e4) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:30.612078 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dac4de-221c-4858-b07a-c1e4935894de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:30.614801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dac4de-221c-4858-b07a-c1e4935894de None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:30.623492 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 56/125] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:17:30 2022] GET /identity/v3/role_assignments?user.id=f4a06ad5e845499991fbdd7e95fb83e4&scope.project.id=554f819c0ee841348da0445f933c4c69&role.id=eb94b5e764af483db56184d52333f6da => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:30.624262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dac4de-221c-4858-b07a-c1e4935894de None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:30.683269 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:30.714110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a6dca-b8db-4ebe-9b07-66016a58e308 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:30.760081 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dac4de-221c-4858-b07a-c1e4935894de None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:30.791246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffac46-94d7-427c-9e8b-2b77c42b14d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:30.792149 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffac46-94d7-427c-9e8b-2b77c42b14d0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:30.792433 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffac46-94d7-427c-9e8b-2b77c42b14d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:30.792711 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffac46-94d7-427c-9e8b-2b77c42b14d0 None admin] PATH_INFO: `/v3/users/f6b1bae44b87419cac105e8b3296eaae` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:30.799748 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffac46-94d7-427c-9e8b-2b77c42b14d0 None admin] RBAC: Authorizing `identity:get_user(user_id=f6b1bae44b87419cac105e8b3296eaae)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:30.801447 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffac46-94d7-427c-9e8b-2b77c42b14d0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:30.802647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80f8ac-2d9c-45cf-b40a-20419369efff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:30.803444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 70/126] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:30 2022] GET /identity/v3/users/f6b1bae44b87419cac105e8b3296eaae => generated 247 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:30.804237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80f8ac-2d9c-45cf-b40a-20419369efff None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:30.804784 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80f8ac-2d9c-45cf-b40a-20419369efff None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:30.805306 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80f8ac-2d9c-45cf-b40a-20419369efff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:30.809036 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffac46-94d7-427c-9e8b-2b77c42b14d0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:30.819352 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80f8ac-2d9c-45cf-b40a-20419369efff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:30.829739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-5a80f8ac-2d9c-45cf-b40a-20419369efff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:17:30.829739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:30.829739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:30.829739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:30.829739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:30.829739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:30.829739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:30.829739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:30.829739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:30.829739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:30.829739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:30.829739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:30.829739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:30.829739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:30.829739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:30.829739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:30.830643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:30.830643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:30.830643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:30.830643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:30.830643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:30.830643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:30.830643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:30.830643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:30.830643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:30.830643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:30.830643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:30.830643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:30.830643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:30.830643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:30.830643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:30.830643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:30.831502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:30.831502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:30.831502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:30.831502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:30.831502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:30.831502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:30.831502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:30.831502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:30.831502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:30.831502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:30.831502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:17:30.831502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:17:30.834548 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 57/127] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:17:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:30.835703 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80f8ac-2d9c-45cf-b40a-20419369efff None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:30.866466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:30.968275 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffac46-94d7-427c-9e8b-2b77c42b14d0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:31.012151 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10c1eb-f94e-4879-9c07-3eb23e8dd267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:31.012831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10c1eb-f94e-4879-9c07-3eb23e8dd267 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:31.013371 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10c1eb-f94e-4879-9c07-3eb23e8dd267 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:31.013717 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10c1eb-f94e-4879-9c07-3eb23e8dd267 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:31.014483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10c1eb-f94e-4879-9c07-3eb23e8dd267 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:31.014822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10c1eb-f94e-4879-9c07-3eb23e8dd267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:31.016205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10c1eb-f94e-4879-9c07-3eb23e8dd267 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:31.026193 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 71/128] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:31.027170 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10c1eb-f94e-4879-9c07-3eb23e8dd267 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:31.040487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:31.100944 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80f8ac-2d9c-45cf-b40a-20419369efff None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:31.147163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10c1eb-f94e-4879-9c07-3eb23e8dd267 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:31.187414 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b3549-98c6-4192-9b1b-54bd87f4a260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:31.188104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b3549-98c6-4192-9b1b-54bd87f4a260 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:31.188389 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b3549-98c6-4192-9b1b-54bd87f4a260 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:31.188665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b3549-98c6-4192-9b1b-54bd87f4a260 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:31.194758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b3549-98c6-4192-9b1b-54bd87f4a260 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:31.194758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b3549-98c6-4192-9b1b-54bd87f4a260 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:31.194758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b3549-98c6-4192-9b1b-54bd87f4a260 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:31.200942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 72/129] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:17:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:31.207026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b3549-98c6-4192-9b1b-54bd87f4a260 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:31.212190 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208a9ef-181b-40fd-b2ed-e84588241cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:31.213344 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208a9ef-181b-40fd-b2ed-e84588241cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:31.213835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208a9ef-181b-40fd-b2ed-e84588241cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:31.214315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208a9ef-181b-40fd-b2ed-e84588241cc5 None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:31.222758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208a9ef-181b-40fd-b2ed-e84588241cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=554f819c0ee841348da0445f933c4c69)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:31.224507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208a9ef-181b-40fd-b2ed-e84588241cc5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:31.226541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 58/130] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:30 2022] GET /identity/v3/projects/554f819c0ee841348da0445f933c4c69 => generated 298 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:31.227555 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208a9ef-181b-40fd-b2ed-e84588241cc5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:31.326150 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:31.364062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b3549-98c6-4192-9b1b-54bd87f4a260 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:31.403098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08f14d-9ddf-49b4-9d51-e3ea9785da3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:31.404418 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08f14d-9ddf-49b4-9d51-e3ea9785da3b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:31.404843 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08f14d-9ddf-49b4-9d51-e3ea9785da3b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:31.405124 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08f14d-9ddf-49b4-9d51-e3ea9785da3b None admin] PATH_INFO: `/v3/users/cab36057742a4256b2d6d72a97dec4da` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:31.406364 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08f14d-9ddf-49b4-9d51-e3ea9785da3b None admin] RBAC: Authorizing `identity:get_user(user_id=cab36057742a4256b2d6d72a97dec4da)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:31.407977 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08f14d-9ddf-49b4-9d51-e3ea9785da3b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:31.410872 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 73/131] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:31 2022] GET /identity/v3/users/cab36057742a4256b2d6d72a97dec4da => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:31.411486 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08f14d-9ddf-49b4-9d51-e3ea9785da3b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:31.496173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:31.521576 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208a9ef-181b-40fd-b2ed-e84588241cc5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:31.535726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08f14d-9ddf-49b4-9d51-e3ea9785da3b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:31.576888 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388552a2-2660-4569-bfb7-579b191dc18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:31.577836 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388552a2-2660-4569-bfb7-579b191dc18b None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:31.578122 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388552a2-2660-4569-bfb7-579b191dc18b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:31.578394 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388552a2-2660-4569-bfb7-579b191dc18b None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69/users/f6b1bae44b87419cac105e8b3296eaae/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:31.580438 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388552a2-2660-4569-bfb7-579b191dc18b None admin] RBAC: Authorizing `identity:create_grant(project_id=554f819c0ee841348da0445f933c4c69, user_id=f6b1bae44b87419cac105e8b3296eaae, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:31.582171 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388552a2-2660-4569-bfb7-579b191dc18b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:31.589726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a68638-3132-47b7-9574-37183a7f770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:31.590819 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a68638-3132-47b7-9574-37183a7f770c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:31.591111 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a68638-3132-47b7-9574-37183a7f770c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:31.591573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a68638-3132-47b7-9574-37183a7f770c None admin] PATH_INFO: `/v3/users/cab36057742a4256b2d6d72a97dec4da` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:31.593192 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a68638-3132-47b7-9574-37183a7f770c None admin] RBAC: Authorizing `identity:get_user(user_id=cab36057742a4256b2d6d72a97dec4da)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:31.597493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:31.597822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a68638-3132-47b7-9574-37183a7f770c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:31.606914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 74/132] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:17:31 2022] PUT /identity/v3/projects/554f819c0ee841348da0445f933c4c69/users/f6b1bae44b87419cac105e8b3296eaae/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:17:31.607831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388552a2-2660-4569-bfb7-579b191dc18b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:31.609677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 59/133] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:31 2022] GET /identity/v3/users/cab36057742a4256b2d6d72a97dec4da => generated 275 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:31.615874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a68638-3132-47b7-9574-37183a7f770c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:31.751237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a68638-3132-47b7-9574-37183a7f770c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:31.789711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1eedf-b1e5-4bcf-b665-56c180f9a5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:31.790605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1eedf-b1e5-4bcf-b665-56c180f9a5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:31.790921 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1eedf-b1e5-4bcf-b665-56c180f9a5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:31.791199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1eedf-b1e5-4bcf-b665-56c180f9a5c6 None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:31.792467 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1eedf-b1e5-4bcf-b665-56c180f9a5c6 None admin] RBAC: Authorizing `identity:get_project(project_id=554f819c0ee841348da0445f933c4c69)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:31.793914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1eedf-b1e5-4bcf-b665-56c180f9a5c6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:31.796036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 60/134] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:31 2022] GET /identity/v3/projects/554f819c0ee841348da0445f933c4c69 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:31.804018 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1eedf-b1e5-4bcf-b665-56c180f9a5c6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:31.856432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:31.887285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388552a2-2660-4569-bfb7-579b191dc18b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:31.959914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b4853-404b-443e-a89d-8e2596c69af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:31.960939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b4853-404b-443e-a89d-8e2596c69af3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:31.961334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b4853-404b-443e-a89d-8e2596c69af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:31.961705 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b4853-404b-443e-a89d-8e2596c69af3 None admin] PATH_INFO: `/v3/projects/33838b6284394f989eab0b5fa952dda5` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:31.963107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b4853-404b-443e-a89d-8e2596c69af3 None admin] RBAC: Authorizing `identity:get_project(project_id=33838b6284394f989eab0b5fa952dda5)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:31.964729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b4853-404b-443e-a89d-8e2596c69af3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:31.966510 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1eedf-b1e5-4bcf-b665-56c180f9a5c6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:31.966908 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 75/135] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:31 2022] GET /identity/v3/projects/33838b6284394f989eab0b5fa952dda5 => generated 312 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:31.968211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3424c7-9d57-4a04-bef8-68ef58bc3a4d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:31.968490 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3424c7-9d57-4a04-bef8-68ef58bc3a4d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:31.968890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3424c7-9d57-4a04-bef8-68ef58bc3a4d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:31.970554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 76/136] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:31.975240 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3424c7-9d57-4a04-bef8-68ef58bc3a4d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:32.007853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf78892-a7d7-4373-94a1-55950715094a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:32.009129 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf78892-a7d7-4373-94a1-55950715094a None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:32.010014 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf78892-a7d7-4373-94a1-55950715094a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:32.010494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf78892-a7d7-4373-94a1-55950715094a None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69/users/cab36057742a4256b2d6d72a97dec4da/roles/b929adc09fcc41daaf5cf39de856c1b6` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:32.013350 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf78892-a7d7-4373-94a1-55950715094a None admin] RBAC: Authorizing `identity:create_grant(project_id=554f819c0ee841348da0445f933c4c69, user_id=cab36057742a4256b2d6d72a97dec4da, role_id=b929adc09fcc41daaf5cf39de856c1b6)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:32.015251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf78892-a7d7-4373-94a1-55950715094a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:32.034229 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 61/137] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:17:31 2022] PUT /identity/v3/projects/554f819c0ee841348da0445f933c4c69/users/cab36057742a4256b2d6d72a97dec4da/roles/b929adc09fcc41daaf5cf39de856c1b6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:17:32.036094 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676b1d5-b30c-4171-8e16-760d76aae177 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:32.036787 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676b1d5-b30c-4171-8e16-760d76aae177 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:32.037282 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676b1d5-b30c-4171-8e16-760d76aae177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:32.052263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:32.065983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0676b1d5-b30c-4171-8e16-760d76aae177 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:32.067855 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0676b1d5-b30c-4171-8e16-760d76aae177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:32.095930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3424c7-9d57-4a04-bef8-68ef58bc3a4d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:32.133858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e1d5f-6edd-4a77-a772-d5325262757a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:32.134969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e1d5f-6edd-4a77-a772-d5325262757a None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:32.135246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e1d5f-6edd-4a77-a772-d5325262757a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:32.135571 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e1d5f-6edd-4a77-a772-d5325262757a None admin] PATH_INFO: `/v3/projects/33838b6284394f989eab0b5fa952dda5/users/cab36057742a4256b2d6d72a97dec4da/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:32.138225 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e1d5f-6edd-4a77-a772-d5325262757a None admin] RBAC: Authorizing `identity:create_grant(project_id=33838b6284394f989eab0b5fa952dda5, user_id=cab36057742a4256b2d6d72a97dec4da, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:32.139735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e1d5f-6edd-4a77-a772-d5325262757a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:32.175500 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 77/138] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:17:31 2022] PUT /identity/v3/projects/33838b6284394f989eab0b5fa952dda5/users/cab36057742a4256b2d6d72a97dec4da/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:17:32.198521 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 62/139] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:32.237190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e1d5f-6edd-4a77-a772-d5325262757a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:32.370518 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e1d5f-6edd-4a77-a772-d5325262757a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:32.404244 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:32.415065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872295d1-3aa5-4079-a2a9-150fed665f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:32.416341 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872295d1-3aa5-4079-a2a9-150fed665f92 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:32.416830 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872295d1-3aa5-4079-a2a9-150fed665f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:32.417236 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872295d1-3aa5-4079-a2a9-150fed665f92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:32.430263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872295d1-3aa5-4079-a2a9-150fed665f92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:32.438032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-872295d1-3aa5-4079-a2a9-150fed665f92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:32.438032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:32.438032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:32.438032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:32.438032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:32.438032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:32.438032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:32.438032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:32.438032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:32.438032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:32.438032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:32.438032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:32.438032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:32.438032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:32.438032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:32.438032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:32.438886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:32.438886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:32.438886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:32.438886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:32.438886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:32.438886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:32.438886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:32.438886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:32.438886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:32.438886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:32.438886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:32.438886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:32.438886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:32.438886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:32.438886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:32.438886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:32.439628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:32.439628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:32.439628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:32.439628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:32.439628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:32.439628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:32.439628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:32.439628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:32.439628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:32.439628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:32.439628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:32.439628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:32.439628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 78/140] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:32.446933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676b1d5-b30c-4171-8e16-760d76aae177 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:32.468873 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:32.588375 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676b1d5-b30c-4171-8e16-760d76aae177 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:32.627825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e40bb-db7b-4650-942e-5d4ac11260f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:32.629130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e40bb-db7b-4650-942e-5d4ac11260f3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:32.629633 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e40bb-db7b-4650-942e-5d4ac11260f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:32.630106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e40bb-db7b-4650-942e-5d4ac11260f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:32.631095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e40bb-db7b-4650-942e-5d4ac11260f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:32.631606 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e40bb-db7b-4650-942e-5d4ac11260f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:32.633212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e40bb-db7b-4650-942e-5d4ac11260f3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:32.642893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 63/141] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:32.649323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872295d1-3aa5-4079-a2a9-150fed665f92 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:32.781529 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872295d1-3aa5-4079-a2a9-150fed665f92 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:32.822683 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cda5c0-1569-48a2-a3ac-b2f9492a46ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:32.823850 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cda5c0-1569-48a2-a3ac-b2f9492a46ee None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:32.824274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cda5c0-1569-48a2-a3ac-b2f9492a46ee None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:32.824704 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cda5c0-1569-48a2-a3ac-b2f9492a46ee None admin] PATH_INFO: `/v3/users/cab36057742a4256b2d6d72a97dec4da` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:32.832124 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cda5c0-1569-48a2-a3ac-b2f9492a46ee None admin] RBAC: Authorizing `identity:get_user(user_id=cab36057742a4256b2d6d72a97dec4da)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:32.833797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cda5c0-1569-48a2-a3ac-b2f9492a46ee None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:32.835723 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 79/142] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:32 2022] GET /identity/v3/users/cab36057742a4256b2d6d72a97dec4da => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:32.841235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa82ad5-70af-4831-9b7d-e53de0d92cf3 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:32.841735 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa82ad5-70af-4831-9b7d-e53de0d92cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:32.842159 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa82ad5-70af-4831-9b7d-e53de0d92cf3 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:32.843749 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 64/143] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:32.844841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cda5c0-1569-48a2-a3ac-b2f9492a46ee None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:32.851342 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c79d07-8278-4acf-94a7-0d0ad71ca6dc None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:32.851828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c79d07-8278-4acf-94a7-0d0ad71ca6dc None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:32.852253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c79d07-8278-4acf-94a7-0d0ad71ca6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:32.880838 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a7c79d07-8278-4acf-94a7-0d0ad71ca6dc None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:32.882321 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a7c79d07-8278-4acf-94a7-0d0ad71ca6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:32.969794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:33.035840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cda5c0-1569-48a2-a3ac-b2f9492a46ee None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:33.042768 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 65/144] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 19 12:17:33.069261 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c79d07-8278-4acf-94a7-0d0ad71ca6dc None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:33.096402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:33.110310 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7749fd-536b-4852-b539-fe1e8f1593c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:33.111286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7749fd-536b-4852-b539-fe1e8f1593c3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:33.111765 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7749fd-536b-4852-b539-fe1e8f1593c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:33.112186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7749fd-536b-4852-b539-fe1e8f1593c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:33.224684 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7749fd-536b-4852-b539-fe1e8f1593c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:33.226334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7749fd-536b-4852-b539-fe1e8f1593c3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:33.324068 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:33.334800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c79d07-8278-4acf-94a7-0d0ad71ca6dc None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:33.390519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 80/145] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:17:33.396907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044516ca-4669-4bf9-9461-7cd5f0215944 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:33.397199 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044516ca-4669-4bf9-9461-7cd5f0215944 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:33.397475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044516ca-4669-4bf9-9461-7cd5f0215944 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:33.398949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 81/146] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:33.401380 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044516ca-4669-4bf9-9461-7cd5f0215944 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:33.419432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81593e8-2127-42d7-8255-27d0884a376a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:33.420239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81593e8-2127-42d7-8255-27d0884a376a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:33.420518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81593e8-2127-42d7-8255-27d0884a376a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:33.420794 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81593e8-2127-42d7-8255-27d0884a376a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:33.424082 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81593e8-2127-42d7-8255-27d0884a376a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:33.426474 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81593e8-2127-42d7-8255-27d0884a376a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:33.428127 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 66/147] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:17:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:33.437379 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1347e-042c-43ca-96f0-1f771557cb37 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:33.437661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1347e-042c-43ca-96f0-1f771557cb37 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:33.439347 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1347e-042c-43ca-96f0-1f771557cb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:33.471522 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-51a1347e-042c-43ca-96f0-1f771557cb37 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:33.473316 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-51a1347e-042c-43ca-96f0-1f771557cb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:33.596897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 67/148] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:33.597654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1347e-042c-43ca-96f0-1f771557cb37 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:33.598586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044516ca-4669-4bf9-9461-7cd5f0215944 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:33.615562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:33.646860 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd35eb6-505b-4425-b3da-319dc5c9b0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:33.648965 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd35eb6-505b-4425-b3da-319dc5c9b0aa None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:33.649240 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd35eb6-505b-4425-b3da-319dc5c9b0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:33.649508 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd35eb6-505b-4425-b3da-319dc5c9b0aa None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:33.653320 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd35eb6-505b-4425-b3da-319dc5c9b0aa None admin] RBAC: Authorizing `identity:get_project(project_id=554f819c0ee841348da0445f933c4c69)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:33.656372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd35eb6-505b-4425-b3da-319dc5c9b0aa None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:33.665920 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 82/149] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:33 2022] GET /identity/v3/projects/554f819c0ee841348da0445f933c4c69 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:33.666771 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd35eb6-505b-4425-b3da-319dc5c9b0aa None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:33.722947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:33.785940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1347e-042c-43ca-96f0-1f771557cb37 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:33.830494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161b374-91fd-42a8-aab2-52969f991a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:33.831362 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161b374-91fd-42a8-aab2-52969f991a08 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:33.831704 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161b374-91fd-42a8-aab2-52969f991a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:33.831918 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161b374-91fd-42a8-aab2-52969f991a08 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:33.832633 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161b374-91fd-42a8-aab2-52969f991a08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:33.834076 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161b374-91fd-42a8-aab2-52969f991a08 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:33.872980 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd35eb6-505b-4425-b3da-319dc5c9b0aa None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:33.873153 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 68/150] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 19 12:17:33 2022] POST /identity/v3/users => generated 283 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:17:33.880105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161b374-91fd-42a8-aab2-52969f991a08 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:33.991197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:34.030107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161b374-91fd-42a8-aab2-52969f991a08 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:34.032140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2c23e-8d51-40aa-be54-b97cf8cc484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:34.032976 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2c23e-8d51-40aa-be54-b97cf8cc484c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:34.033258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2c23e-8d51-40aa-be54-b97cf8cc484c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:34.033543 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2c23e-8d51-40aa-be54-b97cf8cc484c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:34.061896 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2c23e-8d51-40aa-be54-b97cf8cc484c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:34.071354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8dc2c23e-8d51-40aa-be54-b97cf8cc484c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 12:17:34.071354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:34.071354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:34.071354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:34.071354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:34.071354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:34.071354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:34.071354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:34.071354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:34.071354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:34.071354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:34.071354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:34.071354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:34.071354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:34.071354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:34.071354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:34.072247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:34.072247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:34.072247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:34.072247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:34.072247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:34.072247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:34.072247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:34.072247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:34.072247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:34.072247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:34.072247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:34.072247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:34.072247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:34.072247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:34.072247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:34.072247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:34.073066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:34.073066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:34.073066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:34.073066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:34.073066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:34.073066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:34.073066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:34.073066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:34.073066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:34.073066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:34.073066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 12:17:34.073066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:34.073066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 83/151] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:34.079736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbbf5f-742b-4f78-8bfb-ffed29e7424c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:34.080416 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbbf5f-742b-4f78-8bfb-ffed29e7424c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:34.080697 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbbf5f-742b-4f78-8bfb-ffed29e7424c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:34.080973 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbbf5f-742b-4f78-8bfb-ffed29e7424c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:34.082520 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbbf5f-742b-4f78-8bfb-ffed29e7424c None admin] RBAC: Adding query filter params (role.id=61c33763c453452d82531c56aeb67287, scope.project.id=554f819c0ee841348da0445f933c4c69, user.id=cab36057742a4256b2d6d72a97dec4da) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:34.083793 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2c23e-8d51-40aa-be54-b97cf8cc484c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:34.084678 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbbf5f-742b-4f78-8bfb-ffed29e7424c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:34.088209 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbbf5f-742b-4f78-8bfb-ffed29e7424c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:34.111000 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 69/152] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:17:33 2022] GET /identity/v3/role_assignments?user.id=cab36057742a4256b2d6d72a97dec4da&scope.project.id=554f819c0ee841348da0445f933c4c69&role.id=61c33763c453452d82531c56aeb67287 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:34.230592 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:34.255179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2c23e-8d51-40aa-be54-b97cf8cc484c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:34.299253 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797af24-2932-4f37-94e2-9688cc951fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:34.300529 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797af24-2932-4f37-94e2-9688cc951fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:34.301038 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797af24-2932-4f37-94e2-9688cc951fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:34.301513 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797af24-2932-4f37-94e2-9688cc951fd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:34.302469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797af24-2932-4f37-94e2-9688cc951fd4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:34.303257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797af24-2932-4f37-94e2-9688cc951fd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:34.304845 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797af24-2932-4f37-94e2-9688cc951fd4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:34.317932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 84/153] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:34.326808 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbbf5f-742b-4f78-8bfb-ffed29e7424c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:34.451107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbbf5f-742b-4f78-8bfb-ffed29e7424c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:34.484439 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:34.500502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99bf6f-1252-442f-965a-a5fb20d85cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:34.501705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99bf6f-1252-442f-965a-a5fb20d85cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:34.502143 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99bf6f-1252-442f-965a-a5fb20d85cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:34.502555 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99bf6f-1252-442f-965a-a5fb20d85cf8 None admin] PATH_INFO: `/v3/users/f4a06ad5e845499991fbdd7e95fb83e4` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:34.504600 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99bf6f-1252-442f-965a-a5fb20d85cf8 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a06ad5e845499991fbdd7e95fb83e4)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:34.506203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99bf6f-1252-442f-965a-a5fb20d85cf8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:34.509011 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 70/154] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:34 2022] GET /identity/v3/users/f4a06ad5e845499991fbdd7e95fb83e4 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:34.513845 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797af24-2932-4f37-94e2-9688cc951fd4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:34.642523 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797af24-2932-4f37-94e2-9688cc951fd4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:34.681527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2c8e1-0c85-4bc7-b0c0-21c88e55ad89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:34.682389 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2c8e1-0c85-4bc7-b0c0-21c88e55ad89 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:34.682665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2c8e1-0c85-4bc7-b0c0-21c88e55ad89 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:34.682960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2c8e1-0c85-4bc7-b0c0-21c88e55ad89 None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:34.684490 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2c8e1-0c85-4bc7-b0c0-21c88e55ad89 None admin] RBAC: Authorizing `identity:get_project(project_id=554f819c0ee841348da0445f933c4c69)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:34.685932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2c8e1-0c85-4bc7-b0c0-21c88e55ad89 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:34.687693 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 85/155] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:34 2022] GET /identity/v3/projects/554f819c0ee841348da0445f933c4c69 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:34.693956 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99bf6f-1252-442f-965a-a5fb20d85cf8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:34.817629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99bf6f-1252-442f-965a-a5fb20d85cf8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:34.855123 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aec863-b07b-480f-a8b4-56753ffbe37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:34.856028 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aec863-b07b-480f-a8b4-56753ffbe37f None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:34.856375 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aec863-b07b-480f-a8b4-56753ffbe37f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:34.856652 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aec863-b07b-480f-a8b4-56753ffbe37f None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69/users/f4a06ad5e845499991fbdd7e95fb83e4/roles/eb94b5e764af483db56184d52333f6da` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:34.858853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aec863-b07b-480f-a8b4-56753ffbe37f None admin] RBAC: Authorizing `identity:create_grant(project_id=554f819c0ee841348da0445f933c4c69, user_id=f4a06ad5e845499991fbdd7e95fb83e4, role_id=eb94b5e764af483db56184d52333f6da)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:34.860298 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aec863-b07b-480f-a8b4-56753ffbe37f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:34.875270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f5bdf-989e-4d7b-8062-f9b9c498b25e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:34.875883 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f5bdf-989e-4d7b-8062-f9b9c498b25e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:34.876350 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f5bdf-989e-4d7b-8062-f9b9c498b25e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:34.877955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 86/156] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:34.880690 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 71/157] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:17:34 2022] PUT /identity/v3/projects/554f819c0ee841348da0445f933c4c69/users/f4a06ad5e845499991fbdd7e95fb83e4/roles/eb94b5e764af483db56184d52333f6da => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:17:34.884854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc4e48-ec41-49c9-ac9a-479d13a2aeda None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:34.885553 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc4e48-ec41-49c9-ac9a-479d13a2aeda None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:34.885826 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc4e48-ec41-49c9-ac9a-479d13a2aeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:34.887040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b251df-c2bb-48b7-87bb-a55a42b1e462 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:34.887451 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b251df-c2bb-48b7-87bb-a55a42b1e462 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:34.887743 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b251df-c2bb-48b7-87bb-a55a42b1e462 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:34.889886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 72/158] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:34.910431 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea2023-b3bc-4000-9921-af493b59ddfc None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:34.910881 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea2023-b3bc-4000-9921-af493b59ddfc None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:34.911172 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea2023-b3bc-4000-9921-af493b59ddfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:34.911770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0edc4e48-ec41-49c9-ac9a-479d13a2aeda None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:34.912981 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0edc4e48-ec41-49c9-ac9a-479d13a2aeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:34.921927 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:34.932257 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-5bea2023-b3bc-4000-9921-af493b59ddfc None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:34.933516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5bea2023-b3bc-4000-9921-af493b59ddfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:34.996443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:35.007914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 87/159] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:35.033882 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 73/160] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:17:35.044003 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc4e48-ec41-49c9-ac9a-479d13a2aeda None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:35.076880 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea2023-b3bc-4000-9921-af493b59ddfc None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:35.198820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc4e48-ec41-49c9-ac9a-479d13a2aeda None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:35.216931 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea2023-b3bc-4000-9921-af493b59ddfc None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:35.244399 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deed0f-c991-4359-976a-b0e27d7f21d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:35.245205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deed0f-c991-4359-976a-b0e27d7f21d1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:35.245487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deed0f-c991-4359-976a-b0e27d7f21d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:35.245760 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deed0f-c991-4359-976a-b0e27d7f21d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:35.259551 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29deed0f-c991-4359-976a-b0e27d7f21d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:35.268607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-29deed0f-c991-4359-976a-b0e27d7f21d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:17:35.268607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:35.268607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:35.268607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:35.268607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:35.268607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:35.268607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:35.268607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:35.268607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:35.268607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:35.268607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:35.268607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:35.268607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:35.268607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:35.268607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:35.268607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:35.269641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:35.269641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:35.269641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:35.269641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:35.269641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:35.269641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:35.269641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:35.269641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:35.269641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:35.269641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:35.269641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:35.269641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:35.269641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:35.269641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:35.269641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:35.269641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:35.270397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:35.270397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:35.270397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:35.270397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:35.270397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:35.270397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:35.270397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:35.270397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:35.270397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:35.270397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:35.270397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:17:35.270397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:35.270397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 88/161] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:17:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:35.271314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d6b63-dc62-42d8-ab57-cb7b1be55ff4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:35.271507 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d6b63-dc62-42d8-ab57-cb7b1be55ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:35.271816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d6b63-dc62-42d8-ab57-cb7b1be55ff4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:35.273547 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 89/162] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:35.276737 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d6b63-dc62-42d8-ab57-cb7b1be55ff4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:35.280308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:35.285030 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43444ef5-f428-4b5b-950c-8c9de3216bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:35.286074 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43444ef5-f428-4b5b-950c-8c9de3216bca None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:35.286525 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43444ef5-f428-4b5b-950c-8c9de3216bca None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:35.286971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43444ef5-f428-4b5b-950c-8c9de3216bca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:35.299629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43444ef5-f428-4b5b-950c-8c9de3216bca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:35.309568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-43444ef5-f428-4b5b-950c-8c9de3216bca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:17:35.309568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:35.309568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:35.309568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:35.309568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:35.309568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:35.309568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:35.309568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:35.309568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:35.309568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:35.309568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:35.309568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:35.309568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:35.309568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:35.309568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:35.309568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:35.310639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:35.310639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:35.310639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:35.310639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:35.310639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:35.310639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:35.310639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:35.310639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:35.310639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:35.310639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:35.310639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:35.310639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:35.310639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:35.310639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:35.310639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:35.310639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:35.311657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:35.311657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:35.311657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:35.311657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:35.311657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:35.311657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:35.311657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:35.311657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:35.311657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:35.311657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:35.311657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:17:35.311657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:17:35.313700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 74/163] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:17:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:35.315125 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b105aa-133a-436a-84ed-cb5868cf5869 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:35.316108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b105aa-133a-436a-84ed-cb5868cf5869 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:35.316524 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b105aa-133a-436a-84ed-cb5868cf5869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:35.338855 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-56b105aa-133a-436a-84ed-cb5868cf5869 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:35.340259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-56b105aa-133a-436a-84ed-cb5868cf5869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:35.399125 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:35.428072 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d6b63-dc62-42d8-ab57-cb7b1be55ff4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:35.442001 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 75/164] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:35.443230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b105aa-133a-436a-84ed-cb5868cf5869 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:35.515391 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776a6ed-2a54-4582-9706-6d5c9809f950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:35.516660 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776a6ed-2a54-4582-9706-6d5c9809f950 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:35.517080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776a6ed-2a54-4582-9706-6d5c9809f950 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:35.517488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776a6ed-2a54-4582-9706-6d5c9809f950 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:35.521040 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776a6ed-2a54-4582-9706-6d5c9809f950 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:35.521549 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776a6ed-2a54-4582-9706-6d5c9809f950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:35.524026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776a6ed-2a54-4582-9706-6d5c9809f950 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:35.545338 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 90/165] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:35.546527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776a6ed-2a54-4582-9706-6d5c9809f950 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:35.600479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b105aa-133a-436a-84ed-cb5868cf5869 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:35.641043 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d40c0b-bd1c-4cef-94a3-210b197e6219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:35.641826 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d40c0b-bd1c-4cef-94a3-210b197e6219 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:35.643112 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d40c0b-bd1c-4cef-94a3-210b197e6219 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:35.643474 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d40c0b-bd1c-4cef-94a3-210b197e6219 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:35.644861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d40c0b-bd1c-4cef-94a3-210b197e6219 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:35.645245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d40c0b-bd1c-4cef-94a3-210b197e6219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:35.646749 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d40c0b-bd1c-4cef-94a3-210b197e6219 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:35.657253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 76/166] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:17:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:35.658153 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d40c0b-bd1c-4cef-94a3-210b197e6219 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:35.703895 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:35.732029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:35.776874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d40c0b-bd1c-4cef-94a3-210b197e6219 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:35.801937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776a6ed-2a54-4582-9706-6d5c9809f950 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:35.813958 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a0711-e2cd-4aee-948d-7b823e6cb1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:35.814877 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a0711-e2cd-4aee-948d-7b823e6cb1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:35.815160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a0711-e2cd-4aee-948d-7b823e6cb1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:35.815458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a0711-e2cd-4aee-948d-7b823e6cb1f5 None admin] PATH_INFO: `/v3/users/f6b1bae44b87419cac105e8b3296eaae` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:35.816815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a0711-e2cd-4aee-948d-7b823e6cb1f5 None admin] RBAC: Authorizing `identity:get_user(user_id=f6b1bae44b87419cac105e8b3296eaae)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:35.818472 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a0711-e2cd-4aee-948d-7b823e6cb1f5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:35.820690 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 77/167] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:35 2022] GET /identity/v3/users/f6b1bae44b87419cac105e8b3296eaae => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:35.821595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a0711-e2cd-4aee-948d-7b823e6cb1f5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:35.856923 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31c86d-8fb2-4a0f-bbb0-1dfce51d8f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:35.857645 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31c86d-8fb2-4a0f-bbb0-1dfce51d8f9d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:35.857924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31c86d-8fb2-4a0f-bbb0-1dfce51d8f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:35.858232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31c86d-8fb2-4a0f-bbb0-1dfce51d8f9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:35.881419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31c86d-8fb2-4a0f-bbb0-1dfce51d8f9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:35.894783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5a31c86d-8fb2-4a0f-bbb0-1dfce51d8f9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:35.894783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:35.894783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:35.894783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:35.894783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:35.894783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:35.894783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:35.894783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:35.894783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:35.894783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:35.894783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:35.894783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:35.894783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:35.894783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:35.894783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:35.894783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:35.895679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:35.895679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:35.895679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:35.895679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:35.895679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:35.895679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:35.895679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:35.895679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:35.895679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:35.895679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:35.895679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:35.895679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:35.895679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:35.895679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:35.895679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:35.895679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:35.896494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:35.896494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:35.896494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:35.896494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:35.896494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:35.896494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:35.896494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:35.896494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:35.896494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:35.896494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:35.896494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:35.896494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:35.896494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 91/168] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:35.899509 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31c86d-8fb2-4a0f-bbb0-1dfce51d8f9d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:35.941782 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a0711-e2cd-4aee-948d-7b823e6cb1f5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:35.949565 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:35.982046 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff22cc0-ceac-4040-8716-cb4914f52c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:35.983285 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff22cc0-ceac-4040-8716-cb4914f52c3c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:35.983710 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff22cc0-ceac-4040-8716-cb4914f52c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:35.984298 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff22cc0-ceac-4040-8716-cb4914f52c3c None admin] PATH_INFO: `/v3/users/cab36057742a4256b2d6d72a97dec4da` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:35.985661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff22cc0-ceac-4040-8716-cb4914f52c3c None admin] RBAC: Authorizing `identity:get_user(user_id=cab36057742a4256b2d6d72a97dec4da)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:35.987437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff22cc0-ceac-4040-8716-cb4914f52c3c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:35.989911 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 78/169] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:35 2022] GET /identity/v3/users/cab36057742a4256b2d6d72a97dec4da => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:35.990922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff22cc0-ceac-4040-8716-cb4914f52c3c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:36.011859 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31c86d-8fb2-4a0f-bbb0-1dfce51d8f9d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:36.037126 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:36.060270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b72df-e69d-43e9-91a3-7a8bfc0547d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:36.060720 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b72df-e69d-43e9-91a3-7a8bfc0547d7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:36.061003 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b72df-e69d-43e9-91a3-7a8bfc0547d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:36.061279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b72df-e69d-43e9-91a3-7a8bfc0547d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:36.106357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff22cc0-ceac-4040-8716-cb4914f52c3c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:36.144241 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02049c-e17d-4d17-a89c-db55716f91a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:36.145254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02049c-e17d-4d17-a89c-db55716f91a2 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:36.145715 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02049c-e17d-4d17-a89c-db55716f91a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:36.146167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02049c-e17d-4d17-a89c-db55716f91a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:36.147227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02049c-e17d-4d17-a89c-db55716f91a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:36.147710 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02049c-e17d-4d17-a89c-db55716f91a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:36.149445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02049c-e17d-4d17-a89c-db55716f91a2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:36.159750 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 79/170] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:36.162161 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02049c-e17d-4d17-a89c-db55716f91a2 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:36.173084 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b72df-e69d-43e9-91a3-7a8bfc0547d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:36.175622 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b72df-e69d-43e9-91a3-7a8bfc0547d7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:36.231717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:36.343639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02049c-e17d-4d17-a89c-db55716f91a2 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:36.366579 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 92/171] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:17:36.368551 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b72df-e69d-43e9-91a3-7a8bfc0547d7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:36.415012 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6b6c6-a78b-4251-a76f-bc59e87692a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:36.415680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6b6c6-a78b-4251-a76f-bc59e87692a2 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:36.415962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6b6c6-a78b-4251-a76f-bc59e87692a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:36.416237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6b6c6-a78b-4251-a76f-bc59e87692a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:36.418425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:36.555526 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6b6c6-a78b-4251-a76f-bc59e87692a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:36.557017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6b6c6-a78b-4251-a76f-bc59e87692a2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:36.564161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b72df-e69d-43e9-91a3-7a8bfc0547d7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:36.637299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c304631-f672-44db-a6ef-19976c435848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:36.638438 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c304631-f672-44db-a6ef-19976c435848 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:36.638718 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c304631-f672-44db-a6ef-19976c435848 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:36.639013 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c304631-f672-44db-a6ef-19976c435848 None admin] PATH_INFO: `/v3/users/cab36057742a4256b2d6d72a97dec4da` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:36.641337 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c304631-f672-44db-a6ef-19976c435848 None admin] RBAC: Authorizing `identity:get_user(user_id=cab36057742a4256b2d6d72a97dec4da)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:36.641845 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:36.642807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c304631-f672-44db-a6ef-19976c435848 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:36.645447 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 93/172] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:36 2022] GET /identity/v3/users/cab36057742a4256b2d6d72a97dec4da => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:36.651194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c304631-f672-44db-a6ef-19976c435848 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:36.759905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 80/173] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:17:36.762169 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6b6c6-a78b-4251-a76f-bc59e87692a2 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:36.843384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:36.863695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c304631-f672-44db-a6ef-19976c435848 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:36.935295 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fccaa9-9c84-43dd-8b05-13235a879c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:36.936176 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fccaa9-9c84-43dd-8b05-13235a879c61 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:36.936452 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fccaa9-9c84-43dd-8b05-13235a879c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:36.936726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fccaa9-9c84-43dd-8b05-13235a879c61 None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:36.938059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fccaa9-9c84-43dd-8b05-13235a879c61 None admin] RBAC: Authorizing `identity:get_project(project_id=554f819c0ee841348da0445f933c4c69)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:36.939536 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fccaa9-9c84-43dd-8b05-13235a879c61 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:36.942121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 94/174] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:36 2022] GET /identity/v3/projects/554f819c0ee841348da0445f933c4c69 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:36.944187 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fccaa9-9c84-43dd-8b05-13235a879c61 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:36.974868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6b6c6-a78b-4251-a76f-bc59e87692a2 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:37.051380 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615f1e2-fc54-40c6-86c2-5b292b38655c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:37.052052 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615f1e2-fc54-40c6-86c2-5b292b38655c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:37.052337 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615f1e2-fc54-40c6-86c2-5b292b38655c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:37.052611 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615f1e2-fc54-40c6-86c2-5b292b38655c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:37.059891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:37.150663 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fccaa9-9c84-43dd-8b05-13235a879c61 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:37.190487 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615f1e2-fc54-40c6-86c2-5b292b38655c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:37.192342 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615f1e2-fc54-40c6-86c2-5b292b38655c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:37.239633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed9dc0-d540-4e39-b9b5-132f01967e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:37.240426 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed9dc0-d540-4e39-b9b5-132f01967e19 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:37.240703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed9dc0-d540-4e39-b9b5-132f01967e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:37.240974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed9dc0-d540-4e39-b9b5-132f01967e19 None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:37.242179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed9dc0-d540-4e39-b9b5-132f01967e19 None admin] RBAC: Authorizing `identity:get_project(project_id=554f819c0ee841348da0445f933c4c69)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:37.243852 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed9dc0-d540-4e39-b9b5-132f01967e19 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:37.245555 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 95/175] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:36 2022] GET /identity/v3/projects/554f819c0ee841348da0445f933c4c69 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:37.246310 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed9dc0-d540-4e39-b9b5-132f01967e19 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:37.311141 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:37.357222 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 81/176] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:17:37.358426 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615f1e2-fc54-40c6-86c2-5b292b38655c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:37.401913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:37.466084 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615f1e2-fc54-40c6-86c2-5b292b38655c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:37.480927 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed9dc0-d540-4e39-b9b5-132f01967e19 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:37.503647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5348d7-130e-4a86-9419-3134fc32e0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:37.504639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5348d7-130e-4a86-9419-3134fc32e0da None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:37.505141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5348d7-130e-4a86-9419-3134fc32e0da None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:37.505620 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5348d7-130e-4a86-9419-3134fc32e0da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:37.506659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5348d7-130e-4a86-9419-3134fc32e0da None admin] RBAC: Adding query filter params (role.id=b929adc09fcc41daaf5cf39de856c1b6, scope.project.id=554f819c0ee841348da0445f933c4c69, user.id=cab36057742a4256b2d6d72a97dec4da) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:37.507322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5348d7-130e-4a86-9419-3134fc32e0da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:37.509112 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5348d7-130e-4a86-9419-3134fc32e0da None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:37.516030 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 82/177] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:17:37 2022] GET /identity/v3/role_assignments?user.id=cab36057742a4256b2d6d72a97dec4da&scope.project.id=554f819c0ee841348da0445f933c4c69&role.id=b929adc09fcc41daaf5cf39de856c1b6 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:37.517176 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5348d7-130e-4a86-9419-3134fc32e0da None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:37.619500 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476be9f-28c1-4f5d-a613-134fd6c669f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:37.620221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476be9f-28c1-4f5d-a613-134fd6c669f9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:37.620454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476be9f-28c1-4f5d-a613-134fd6c669f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:37.620729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476be9f-28c1-4f5d-a613-134fd6c669f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:37.621573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476be9f-28c1-4f5d-a613-134fd6c669f9 None admin] RBAC: Adding query filter params (role.id=386cb814e8464fda8832b13c75eabdaf, scope.project.id=554f819c0ee841348da0445f933c4c69, user.id=f6b1bae44b87419cac105e8b3296eaae) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:37.621880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476be9f-28c1-4f5d-a613-134fd6c669f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:37.623440 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476be9f-28c1-4f5d-a613-134fd6c669f9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:37.629789 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5348d7-130e-4a86-9419-3134fc32e0da None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:37.645340 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 96/178] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:17:37 2022] GET /identity/v3/role_assignments?user.id=f6b1bae44b87419cac105e8b3296eaae&scope.project.id=554f819c0ee841348da0445f933c4c69&role.id=386cb814e8464fda8832b13c75eabdaf => generated 608 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:37.666300 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:37.676426 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca197974-babe-408d-ab0d-efe5dc1ab8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:37.677882 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca197974-babe-408d-ab0d-efe5dc1ab8fe None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:37.678466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca197974-babe-408d-ab0d-efe5dc1ab8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:37.678979 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca197974-babe-408d-ab0d-efe5dc1ab8fe None admin] PATH_INFO: `/v3/projects/33838b6284394f989eab0b5fa952dda5` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:37.680699 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca197974-babe-408d-ab0d-efe5dc1ab8fe None admin] RBAC: Authorizing `identity:get_project(project_id=33838b6284394f989eab0b5fa952dda5)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:37.682489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca197974-babe-408d-ab0d-efe5dc1ab8fe None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:37.684753 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 83/179] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:37 2022] GET /identity/v3/projects/33838b6284394f989eab0b5fa952dda5 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:37.699058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476be9f-28c1-4f5d-a613-134fd6c669f9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:37.833596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae7d80-a8ff-4790-a70f-360725f42102 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:37.834086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae7d80-a8ff-4790-a70f-360725f42102 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:37.834086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae7d80-a8ff-4790-a70f-360725f42102 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:37.835623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 84/180] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:37.842077 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e739e-e8cc-4724-b1b1-575d6b75ef55 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:37.842476 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e739e-e8cc-4724-b1b1-575d6b75ef55 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:37.842774 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e739e-e8cc-4724-b1b1-575d6b75ef55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:37.871709 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:37.881432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0b1e739e-e8cc-4724-b1b1-575d6b75ef55 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:37.882727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0b1e739e-e8cc-4724-b1b1-575d6b75ef55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:37.893060 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476be9f-28c1-4f5d-a613-134fd6c669f9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:37.961207 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7eb37-b7eb-431f-aec9-1be013085cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:37.961869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7eb37-b7eb-431f-aec9-1be013085cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:37.962147 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7eb37-b7eb-431f-aec9-1be013085cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:37.962418 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7eb37-b7eb-431f-aec9-1be013085cf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:37.963336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7eb37-b7eb-431f-aec9-1be013085cf0 None admin] RBAC: Adding query filter params (role.id=61c33763c453452d82531c56aeb67287, scope.project.id=33838b6284394f989eab0b5fa952dda5, user.id=cab36057742a4256b2d6d72a97dec4da) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:37.963641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7eb37-b7eb-431f-aec9-1be013085cf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:37.965099 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7eb37-b7eb-431f-aec9-1be013085cf0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:37.979242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 97/181] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:17:37 2022] GET /identity/v3/role_assignments?user.id=cab36057742a4256b2d6d72a97dec4da&scope.project.id=33838b6284394f989eab0b5fa952dda5&role.id=61c33763c453452d82531c56aeb67287 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:37.991728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 85/182] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:17:38.026475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7eb37-b7eb-431f-aec9-1be013085cf0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:38.037378 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82084140-0b2c-474c-8ca1-5c4088982e74 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:38.037654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82084140-0b2c-474c-8ca1-5c4088982e74 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:38.037937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82084140-0b2c-474c-8ca1-5c4088982e74 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:38.039596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 86/183] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:38.045219 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b18a0b-a79d-406d-9a3b-ecf3a6341c68 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:38.045499 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b18a0b-a79d-406d-9a3b-ecf3a6341c68 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:38.045771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b18a0b-a79d-406d-9a3b-ecf3a6341c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:38.065214 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-16b18a0b-a79d-406d-9a3b-ecf3a6341c68 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:38.066687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-16b18a0b-a79d-406d-9a3b-ecf3a6341c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:38.163543 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7eb37-b7eb-431f-aec9-1be013085cf0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:38.201580 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fe228-b8fb-42f6-bee4-7d45005d33f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:38.202398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fe228-b8fb-42f6-bee4-7d45005d33f1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:38.202693 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fe228-b8fb-42f6-bee4-7d45005d33f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:38.202972 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fe228-b8fb-42f6-bee4-7d45005d33f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:38.215056 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fe228-b8fb-42f6-bee4-7d45005d33f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:38.217573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 87/184] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:17:38.227897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-e91fe228-b8fb-42f6-bee4-7d45005d33f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 12:17:38.227897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:38.227897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:38.227897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:38.227897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:38.227897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:38.227897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:38.227897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:38.227897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:38.227897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:38.227897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:38.227897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:38.227897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:38.227897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:38.227897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:38.227897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:38.228822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:38.228822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:38.228822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:38.228822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:38.228822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:38.228822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:38.228822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:38.228822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:38.228822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:38.228822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:38.228822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:38.228822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:38.228822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:38.228822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:38.228822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:38.228822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:38.230044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:38.230044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:38.230044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:38.230044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:38.230044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:38.230044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:38.230044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:38.230044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:38.230044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:38.230044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:38.230044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 12:17:38.230044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:38.230044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 98/185] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:38.235083 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b18a0b-a79d-406d-9a3b-ecf3a6341c68 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:38.251114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fe228-b8fb-42f6-bee4-7d45005d33f1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:38.273633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:38.299092 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:38.386958 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b18a0b-a79d-406d-9a3b-ecf3a6341c68 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:38.388522 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fe228-b8fb-42f6-bee4-7d45005d33f1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:38.433307 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a5da6-cc60-42b3-b384-4e04f0c31da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:38.434490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a5da6-cc60-42b3-b384-4e04f0c31da5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:38.434801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a5da6-cc60-42b3-b384-4e04f0c31da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:38.435083 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a5da6-cc60-42b3-b384-4e04f0c31da5 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:38.435845 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a5da6-cc60-42b3-b384-4e04f0c31da5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:38.436148 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a5da6-cc60-42b3-b384-4e04f0c31da5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:38.437535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a5da6-cc60-42b3-b384-4e04f0c31da5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:38.438192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c7513-fc22-4966-b063-710a3fb9c1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:38.439197 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c7513-fc22-4966-b063-710a3fb9c1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:38.439486 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c7513-fc22-4966-b063-710a3fb9c1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:38.439769 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c7513-fc22-4966-b063-710a3fb9c1d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:38.441881 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c7513-fc22-4966-b063-710a3fb9c1d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:38.443360 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c7513-fc22-4966-b063-710a3fb9c1d5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:38.445816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 99/186] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:17:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:38.447379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff706f65-b134-492c-8d89-619811c64253 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:38.447733 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff706f65-b134-492c-8d89-619811c64253 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:38.448079 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff706f65-b134-492c-8d89-619811c64253 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:38.449472 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 100/187] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:38.450591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d984a-e7a8-453e-b05e-ea7a20469adb None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:38.450916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d984a-e7a8-453e-b05e-ea7a20469adb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:38.451190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d984a-e7a8-453e-b05e-ea7a20469adb None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:38.452426 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 101/188] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:38.457434 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 88/189] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:38.457717 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d984a-e7a8-453e-b05e-ea7a20469adb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:38.458898 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec68d4f-3929-4883-8351-820dd9b855ff None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:38.459189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec68d4f-3929-4883-8351-820dd9b855ff None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:38.459515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec68d4f-3929-4883-8351-820dd9b855ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:38.477287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-dec68d4f-3929-4883-8351-820dd9b855ff None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:38.478488 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-dec68d4f-3929-4883-8351-820dd9b855ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:38.548012 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:38.548198 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 89/190] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:38.550253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3895c9b-0ca1-46d0-8622-9dc589fbcdb8 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:38.550368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3895c9b-0ca1-46d0-8622-9dc589fbcdb8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:38.550903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3895c9b-0ca1-46d0-8622-9dc589fbcdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:38.566118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d984a-e7a8-453e-b05e-ea7a20469adb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:38.574604 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d3895c9b-0ca1-46d0-8622-9dc589fbcdb8 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:38.575836 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d3895c9b-0ca1-46d0-8622-9dc589fbcdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:38.591393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:38.603082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f146b-5596-4fc0-8987-1643736d4f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:38.603742 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f146b-5596-4fc0-8987-1643736d4f43 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:38.604021 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f146b-5596-4fc0-8987-1643736d4f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:38.604293 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f146b-5596-4fc0-8987-1643736d4f43 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:38.604989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f146b-5596-4fc0-8987-1643736d4f43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:38.606413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f146b-5596-4fc0-8987-1643736d4f43 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:38.625484 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 102/191] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 19 12:17:38 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:17:38.635825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f146b-5596-4fc0-8987-1643736d4f43 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:38.650099 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 90/192] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:38.650863 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3895c9b-0ca1-46d0-8622-9dc589fbcdb8 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:38.766906 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f146b-5596-4fc0-8987-1643736d4f43 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:38.769117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3895c9b-0ca1-46d0-8622-9dc589fbcdb8 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:38.811809 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3e9c9-adf2-4b74-8599-7b5daf9809ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:38.812006 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc96b1-2856-4a1a-ba43-ccd917b73463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:38.812631 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3e9c9-adf2-4b74-8599-7b5daf9809ef None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:38.812919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3e9c9-adf2-4b74-8599-7b5daf9809ef None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:38.813021 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc96b1-2856-4a1a-ba43-ccd917b73463 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:38.813195 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3e9c9-adf2-4b74-8599-7b5daf9809ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:38.813287 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc96b1-2856-4a1a-ba43-ccd917b73463 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:38.813521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc96b1-2856-4a1a-ba43-ccd917b73463 None admin] PATH_INFO: `/v3/users/f4a06ad5e845499991fbdd7e95fb83e4` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:38.814719 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc96b1-2856-4a1a-ba43-ccd917b73463 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a06ad5e845499991fbdd7e95fb83e4)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:38.816274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc96b1-2856-4a1a-ba43-ccd917b73463 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:38.817865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 103/193] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:38 2022] GET /identity/v3/users/f4a06ad5e845499991fbdd7e95fb83e4 => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:38.818632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc96b1-2856-4a1a-ba43-ccd917b73463 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:38.825838 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3e9c9-adf2-4b74-8599-7b5daf9809ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:38.831611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:38.836705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-49b3e9c9-adf2-4b74-8599-7b5daf9809ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:17:38.836705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:38.836705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:38.836705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:38.836705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:38.836705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:38.836705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:38.836705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:38.836705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:38.836705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:38.836705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:38.836705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:38.836705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:38.836705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:38.836705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:38.836705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:38.837879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:38.837879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:38.837879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:38.837879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:38.837879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:38.837879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:38.837879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:38.837879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:38.837879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:38.837879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:38.837879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:38.837879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:38.837879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:38.837879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:38.837879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:38.837879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:38.838641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:38.838641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:38.838641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:38.838641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:38.838641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:38.838641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:38.838641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:38.838641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:38.838641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:38.838641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:38.838641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:17:38.838641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:17:38.838641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 91/194] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:17:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:38.839310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3e9c9-adf2-4b74-8599-7b5daf9809ef None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:38.857928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:38.950400 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc96b1-2856-4a1a-ba43-ccd917b73463 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:38.978523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3e9c9-adf2-4b74-8599-7b5daf9809ef None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:38.998031 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dd091-4de5-42e7-bac2-4da86303105a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:38.998861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dd091-4de5-42e7-bac2-4da86303105a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:38.999139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dd091-4de5-42e7-bac2-4da86303105a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:38.999409 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dd091-4de5-42e7-bac2-4da86303105a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:39.014835 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9dd091-4de5-42e7-bac2-4da86303105a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:39.016772 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe61d6-8568-4ee8-ad2d-e8bd3dbe857a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:39.017673 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe61d6-8568-4ee8-ad2d-e8bd3dbe857a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:39.018148 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe61d6-8568-4ee8-ad2d-e8bd3dbe857a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:39.019397 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe61d6-8568-4ee8-ad2d-e8bd3dbe857a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:39.024475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-3d9dd091-4de5-42e7-bac2-4da86303105a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:17:39.024475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:39.024475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:39.024475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:39.024475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:39.024475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:39.024475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:39.024475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:39.024475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:39.024475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:39.024475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:39.024475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:39.024475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:39.024475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:39.024475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:39.024475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:39.025349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:39.025349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:39.025349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:39.025349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:39.025349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:39.025349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:39.025349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:39.025349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:39.025349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:39.025349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:39.025349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:39.025349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:39.025349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:39.025349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:39.025349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:39.025349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:39.026119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:39.026119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:39.026119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:39.026119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:39.026119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:39.026119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:39.026119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:39.026119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:39.026119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:39.026119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:39.026119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:17:39.026119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:39.026119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 104/195] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:17:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:39.027300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dd091-4de5-42e7-bac2-4da86303105a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:39.108615 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe61d6-8568-4ee8-ad2d-e8bd3dbe857a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:39.110462 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe61d6-8568-4ee8-ad2d-e8bd3dbe857a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:39.118816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:39.126101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:39.170196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dd091-4de5-42e7-bac2-4da86303105a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:39.216907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab313a9-efce-4775-8fa4-0c8cea3f5fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:39.217585 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab313a9-efce-4775-8fa4-0c8cea3f5fde None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:39.217869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab313a9-efce-4775-8fa4-0c8cea3f5fde None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:39.218148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab313a9-efce-4775-8fa4-0c8cea3f5fde None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:39.219274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab313a9-efce-4775-8fa4-0c8cea3f5fde None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:39.219575 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab313a9-efce-4775-8fa4-0c8cea3f5fde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:39.221467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab313a9-efce-4775-8fa4-0c8cea3f5fde None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:39.232169 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 92/196] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:17:39.232633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 105/197] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:17:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:39.233522 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe61d6-8568-4ee8-ad2d-e8bd3dbe857a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:39.239690 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab313a9-efce-4775-8fa4-0c8cea3f5fde None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:39.350838 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe61d6-8568-4ee8-ad2d-e8bd3dbe857a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:39.364876 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:39.386638 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab313a9-efce-4775-8fa4-0c8cea3f5fde None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:39.393013 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b230d-988e-4faf-85b1-4df51130c51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:39.394485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b230d-988e-4faf-85b1-4df51130c51c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:39.395127 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b230d-988e-4faf-85b1-4df51130c51c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:39.395597 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b230d-988e-4faf-85b1-4df51130c51c None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:39.396557 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b230d-988e-4faf-85b1-4df51130c51c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:39.397154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b230d-988e-4faf-85b1-4df51130c51c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:39.398844 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b230d-988e-4faf-85b1-4df51130c51c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:39.407998 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 93/198] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:39.409182 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b230d-988e-4faf-85b1-4df51130c51c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:39.420329 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:39.428444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b53a11-a7c7-4f02-b77b-c8a6a6d2cc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:39.429577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b53a11-a7c7-4f02-b77b-c8a6a6d2cc14 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:39.429861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b53a11-a7c7-4f02-b77b-c8a6a6d2cc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:39.430139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b53a11-a7c7-4f02-b77b-c8a6a6d2cc14 None admin] PATH_INFO: `/v3/users/dce4bdd13cbb4b4db78ff6857ff1f8fd` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:39.445553 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b53a11-a7c7-4f02-b77b-c8a6a6d2cc14 None admin] RBAC: Authorizing `identity:get_user(user_id=dce4bdd13cbb4b4db78ff6857ff1f8fd)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:39.447319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b53a11-a7c7-4f02-b77b-c8a6a6d2cc14 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:39.449633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 106/199] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:39 2022] GET /identity/v3/users/dce4bdd13cbb4b4db78ff6857ff1f8fd => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:39.450641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b53a11-a7c7-4f02-b77b-c8a6a6d2cc14 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:39.550645 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b230d-988e-4faf-85b1-4df51130c51c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:39.556086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b53a11-a7c7-4f02-b77b-c8a6a6d2cc14 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:39.594646 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42301ea-64a9-4757-9b8d-76eb1a4e6aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:39.596154 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42301ea-64a9-4757-9b8d-76eb1a4e6aca None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:39.596973 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e5b3d-9dff-4a29-b908-c70e0ad3ba06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:39.597925 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e5b3d-9dff-4a29-b908-c70e0ad3ba06 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:39.598288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42301ea-64a9-4757-9b8d-76eb1a4e6aca None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:39.598654 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42301ea-64a9-4757-9b8d-76eb1a4e6aca None admin] PATH_INFO: `/v3/users/dce4bdd13cbb4b4db78ff6857ff1f8fd` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:39.599039 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e5b3d-9dff-4a29-b908-c70e0ad3ba06 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:39.599907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e5b3d-9dff-4a29-b908-c70e0ad3ba06 None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:39.600657 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42301ea-64a9-4757-9b8d-76eb1a4e6aca None admin] RBAC: Authorizing `identity:get_user(user_id=dce4bdd13cbb4b4db78ff6857ff1f8fd)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:39.602668 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42301ea-64a9-4757-9b8d-76eb1a4e6aca None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:39.603505 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e5b3d-9dff-4a29-b908-c70e0ad3ba06 None admin] RBAC: Authorizing `identity:get_project(project_id=554f819c0ee841348da0445f933c4c69)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:39.604811 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 107/200] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:39 2022] GET /identity/v3/users/dce4bdd13cbb4b4db78ff6857ff1f8fd => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:39.605340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e5b3d-9dff-4a29-b908-c70e0ad3ba06 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:39.605752 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42301ea-64a9-4757-9b8d-76eb1a4e6aca None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:39.612954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 94/201] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:39 2022] GET /identity/v3/projects/554f819c0ee841348da0445f933c4c69 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:39.612954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e5b3d-9dff-4a29-b908-c70e0ad3ba06 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:39.664906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:39.679715 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:39.740220 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e5b3d-9dff-4a29-b908-c70e0ad3ba06 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:39.749687 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42301ea-64a9-4757-9b8d-76eb1a4e6aca None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:39.776388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4efe4-dcad-4575-90a3-4f0f8eba983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:39.777284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4efe4-dcad-4575-90a3-4f0f8eba983a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:39.777777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4efe4-dcad-4575-90a3-4f0f8eba983a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:39.778128 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4efe4-dcad-4575-90a3-4f0f8eba983a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:39.793750 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e390a2-81ff-47f1-b7be-0bf5b6a92ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:39.794606 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e390a2-81ff-47f1-b7be-0bf5b6a92ccd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:39.795045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e390a2-81ff-47f1-b7be-0bf5b6a92ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:39.795603 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e390a2-81ff-47f1-b7be-0bf5b6a92ccd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:39.852512 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4efe4-dcad-4575-90a3-4f0f8eba983a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:39.854093 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4efe4-dcad-4575-90a3-4f0f8eba983a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:39.884846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e390a2-81ff-47f1-b7be-0bf5b6a92ccd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:39.886581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e390a2-81ff-47f1-b7be-0bf5b6a92ccd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:39.899918 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:39.951955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:39.970290 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 95/202] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:17:39.971441 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4efe4-dcad-4575-90a3-4f0f8eba983a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:40.000906 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 108/203] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:17:40.002134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e390a2-81ff-47f1-b7be-0bf5b6a92ccd None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:40.080294 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4efe4-dcad-4575-90a3-4f0f8eba983a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:40.107140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e390a2-81ff-47f1-b7be-0bf5b6a92ccd None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:40.117878 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda215de-168c-4eac-8187-9d893a339071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:40.118629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda215de-168c-4eac-8187-9d893a339071 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:40.119005 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda215de-168c-4eac-8187-9d893a339071 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:40.119359 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda215de-168c-4eac-8187-9d893a339071 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:40.120270 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda215de-168c-4eac-8187-9d893a339071 None admin] RBAC: Adding query filter params (role.id=eb94b5e764af483db56184d52333f6da, scope.project.id=554f819c0ee841348da0445f933c4c69, user.id=f4a06ad5e845499991fbdd7e95fb83e4) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:40.120802 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda215de-168c-4eac-8187-9d893a339071 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:40.122355 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda215de-168c-4eac-8187-9d893a339071 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:40.135026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 96/204] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:17:39 2022] GET /identity/v3/role_assignments?user.id=f4a06ad5e845499991fbdd7e95fb83e4&scope.project.id=554f819c0ee841348da0445f933c4c69&role.id=eb94b5e764af483db56184d52333f6da => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:40.136249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda215de-168c-4eac-8187-9d893a339071 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:40.140345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:40.153303 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc533aa-0163-45d2-a3d6-3fa51c5418d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:40.154496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc533aa-0163-45d2-a3d6-3fa51c5418d6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:40.154974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc533aa-0163-45d2-a3d6-3fa51c5418d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:40.155453 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc533aa-0163-45d2-a3d6-3fa51c5418d6 None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:40.161038 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc533aa-0163-45d2-a3d6-3fa51c5418d6 None admin] RBAC: Authorizing `identity:get_project(project_id=5a14beb3e8e643bca9af26f2ac0062bb)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:40.162810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc533aa-0163-45d2-a3d6-3fa51c5418d6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:40.167044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 109/205] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:40 2022] GET /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:40.171597 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc533aa-0163-45d2-a3d6-3fa51c5418d6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:40.221362 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:40.305306 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc533aa-0163-45d2-a3d6-3fa51c5418d6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:40.347503 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db419a53-d03c-4cdd-89bf-d1c32d544a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:40.348470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db419a53-d03c-4cdd-89bf-d1c32d544a3d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:40.348854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db419a53-d03c-4cdd-89bf-d1c32d544a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:40.349244 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db419a53-d03c-4cdd-89bf-d1c32d544a3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:40.350177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db419a53-d03c-4cdd-89bf-d1c32d544a3d None admin] RBAC: Adding query filter params (role.id=386cb814e8464fda8832b13c75eabdaf, scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb, user.id=dce4bdd13cbb4b4db78ff6857ff1f8fd) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:40.350582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db419a53-d03c-4cdd-89bf-d1c32d544a3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:40.351192 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda215de-168c-4eac-8187-9d893a339071 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:40.352469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db419a53-d03c-4cdd-89bf-d1c32d544a3d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:40.360199 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 110/206] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:17:40 2022] GET /identity/v3/role_assignments?user.id=dce4bdd13cbb4b4db78ff6857ff1f8fd&scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb&role.id=386cb814e8464fda8832b13c75eabdaf => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:40.396572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d507da8-9c93-4951-bbfc-d57f01cc2ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:40.397989 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d507da8-9c93-4951-bbfc-d57f01cc2ccc None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:40.398422 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d507da8-9c93-4951-bbfc-d57f01cc2ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:40.398872 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d507da8-9c93-4951-bbfc-d57f01cc2ccc None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:40.400461 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d507da8-9c93-4951-bbfc-d57f01cc2ccc None admin] RBAC: Authorizing `identity:get_project(project_id=5a14beb3e8e643bca9af26f2ac0062bb)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:40.402249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d507da8-9c93-4951-bbfc-d57f01cc2ccc None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:40.404290 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 97/207] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:40 2022] GET /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:40.410462 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db419a53-d03c-4cdd-89bf-d1c32d544a3d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:40.515632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:40.529387 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db419a53-d03c-4cdd-89bf-d1c32d544a3d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:40.569081 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fa129-72ab-48ff-a0f3-4a103dc3be2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:40.569742 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fa129-72ab-48ff-a0f3-4a103dc3be2e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:40.570014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fa129-72ab-48ff-a0f3-4a103dc3be2e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:40.570283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fa129-72ab-48ff-a0f3-4a103dc3be2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:40.571142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fa129-72ab-48ff-a0f3-4a103dc3be2e None admin] RBAC: Adding query filter params (role.id=b929adc09fcc41daaf5cf39de856c1b6, scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb, user.id=dce4bdd13cbb4b4db78ff6857ff1f8fd) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:40.571449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fa129-72ab-48ff-a0f3-4a103dc3be2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:40.572879 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fa129-72ab-48ff-a0f3-4a103dc3be2e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:40.579749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 111/208] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:17:40 2022] GET /identity/v3/role_assignments?user.id=dce4bdd13cbb4b4db78ff6857ff1f8fd&scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb&role.id=b929adc09fcc41daaf5cf39de856c1b6 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:40.917480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a34d6-d02e-4f2a-b1f5-c0828f08291a None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:40.918011 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a34d6-d02e-4f2a-b1f5-c0828f08291a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:40.918011 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a34d6-d02e-4f2a-b1f5-c0828f08291a None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:40.919472 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 98/209] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:40.925226 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ca502-8678-4597-8b63-aed30968fd2d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:40.925639 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ca502-8678-4597-8b63-aed30968fd2d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:40.925828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ca502-8678-4597-8b63-aed30968fd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:40.939227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025f969-fc60-4748-8456-781c660ac8fe None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:40.939517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025f969-fc60-4748-8456-781c660ac8fe None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:40.939800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025f969-fc60-4748-8456-781c660ac8fe None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:40.941315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 99/210] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:17:40.943861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-020ca502-8678-4597-8b63-aed30968fd2d None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:40.945210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-020ca502-8678-4597-8b63-aed30968fd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:40.946580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62108e3d-a20e-4511-b2fd-b5b492dacb7a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:40.946894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62108e3d-a20e-4511-b2fd-b5b492dacb7a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:40.947174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62108e3d-a20e-4511-b2fd-b5b492dacb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:40.965648 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-62108e3d-a20e-4511-b2fd-b5b492dacb7a None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:40.966801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-62108e3d-a20e-4511-b2fd-b5b492dacb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:41.033548 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 112/211] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:41.040097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 100/212] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:17:41.058193 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ca502-8678-4597-8b63-aed30968fd2d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:41.070292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62108e3d-a20e-4511-b2fd-b5b492dacb7a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:41.072925 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:41.155130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:41.176865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ca502-8678-4597-8b63-aed30968fd2d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:41.186029 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62108e3d-a20e-4511-b2fd-b5b492dacb7a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:41.215919 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5542def-a0a2-4cdb-b1a5-f575501cd01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:41.216738 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5542def-a0a2-4cdb-b1a5-f575501cd01e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:41.217049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5542def-a0a2-4cdb-b1a5-f575501cd01e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:41.217389 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5542def-a0a2-4cdb-b1a5-f575501cd01e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:41.222177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd35cc-0138-41a3-a6f0-9a7841f2a80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:41.223012 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd35cc-0138-41a3-a6f0-9a7841f2a80e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:41.223296 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd35cc-0138-41a3-a6f0-9a7841f2a80e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:41.223569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd35cc-0138-41a3-a6f0-9a7841f2a80e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:41.224828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd35cc-0138-41a3-a6f0-9a7841f2a80e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:41.226275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd35cc-0138-41a3-a6f0-9a7841f2a80e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:41.227989 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 101/213] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:17:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:41.228871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5542def-a0a2-4cdb-b1a5-f575501cd01e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:41.233451 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd35cc-0138-41a3-a6f0-9a7841f2a80e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:41.236839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b5542def-a0a2-4cdb-b1a5-f575501cd01e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:41.236839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:41.236839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:41.236839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:41.236839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:41.236839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:41.236839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:41.236839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:41.236839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:41.236839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:41.236839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:41.236839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:41.236839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:41.236839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:41.236839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:41.236839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:41.237735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:41.237735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:41.237735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:41.237735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:41.237735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:41.237735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:41.237735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:41.237735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:41.237735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:41.237735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:41.237735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:41.237735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:41.237735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:41.237735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:41.237735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:41.237735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:41.238483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:41.238483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:41.238483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:41.238483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:41.238483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:41.238483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:41.238483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:41.238483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:41.238483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:41.238483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:41.238483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:41.238483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:41.239080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 113/214] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:41.247698 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5542def-a0a2-4cdb-b1a5-f575501cd01e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:41.309320 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:41.342776 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd35cc-0138-41a3-a6f0-9a7841f2a80e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:41.359507 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5542def-a0a2-4cdb-b1a5-f575501cd01e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:41.384067 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff739e-99a0-4786-9bc4-4e60de2dbde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:41.384745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff739e-99a0-4786-9bc4-4e60de2dbde3 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:41.385126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff739e-99a0-4786-9bc4-4e60de2dbde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:41.385419 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff739e-99a0-4786-9bc4-4e60de2dbde3 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:41.386160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff739e-99a0-4786-9bc4-4e60de2dbde3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:41.387786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff739e-99a0-4786-9bc4-4e60de2dbde3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:41.400456 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07401709-0b20-450e-b470-b323d4564e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:41.401336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07401709-0b20-450e-b470-b323d4564e28 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:41.401706 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07401709-0b20-450e-b470-b323d4564e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:41.402012 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07401709-0b20-450e-b470-b323d4564e28 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:41.402895 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07401709-0b20-450e-b470-b323d4564e28 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:41.403209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07401709-0b20-450e-b470-b323d4564e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:41.404719 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07401709-0b20-450e-b470-b323d4564e28 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:41.413608 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 102/215] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 19 12:17:41 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:17:41.418862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 114/216] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:41.420947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07401709-0b20-450e-b470-b323d4564e28 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:41.435159 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:41.540514 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07401709-0b20-450e-b470-b323d4564e28 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:41.578653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ade10-9a21-4399-8dcf-a66612e96324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:41.579586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ade10-9a21-4399-8dcf-a66612e96324 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:41.579865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ade10-9a21-4399-8dcf-a66612e96324 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:41.580139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ade10-9a21-4399-8dcf-a66612e96324 None admin] PATH_INFO: `/v3/users/fd80457b9a6442669f83515a371fa5c2` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:41.595221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ade10-9a21-4399-8dcf-a66612e96324 None admin] RBAC: Authorizing `identity:get_user(user_id=fd80457b9a6442669f83515a371fa5c2)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:41.596790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ade10-9a21-4399-8dcf-a66612e96324 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:41.598863 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 115/217] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:41 2022] GET /identity/v3/users/fd80457b9a6442669f83515a371fa5c2 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:41.604633 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff739e-99a0-4786-9bc4-4e60de2dbde3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:41.720546 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff739e-99a0-4786-9bc4-4e60de2dbde3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:41.754423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:41.766280 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e0782-3f13-4745-a48b-05ea1263bbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:41.766976 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e0782-3f13-4745-a48b-05ea1263bbeb None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:41.767263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e0782-3f13-4745-a48b-05ea1263bbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:41.767540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e0782-3f13-4745-a48b-05ea1263bbeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:41.846115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e0782-3f13-4745-a48b-05ea1263bbeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:41.847826 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e0782-3f13-4745-a48b-05ea1263bbeb None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:41.961592 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 103/218] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:17:41.967864 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ade10-9a21-4399-8dcf-a66612e96324 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:42.066895 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:42.121175 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ade10-9a21-4399-8dcf-a66612e96324 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:42.170129 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493003e-09f0-45cc-a723-beb4119f3355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:42.171028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493003e-09f0-45cc-a723-beb4119f3355 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:42.171364 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493003e-09f0-45cc-a723-beb4119f3355 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:42.171639 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493003e-09f0-45cc-a723-beb4119f3355 None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:42.172875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493003e-09f0-45cc-a723-beb4119f3355 None admin] RBAC: Authorizing `identity:get_project(project_id=5a14beb3e8e643bca9af26f2ac0062bb)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:42.174387 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493003e-09f0-45cc-a723-beb4119f3355 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:42.176187 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 116/219] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:41 2022] GET /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:42.183670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e0782-3f13-4745-a48b-05ea1263bbeb None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:42.240528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:42.328789 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e0782-3f13-4745-a48b-05ea1263bbeb None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:42.371133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28011b7f-1901-430a-9544-309e4fb1c4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:42.372227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28011b7f-1901-430a-9544-309e4fb1c4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:42.372712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28011b7f-1901-430a-9544-309e4fb1c4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:42.373197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28011b7f-1901-430a-9544-309e4fb1c4a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:42.374255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28011b7f-1901-430a-9544-309e4fb1c4a5 None admin] RBAC: Adding query filter params (role.id=61c33763c453452d82531c56aeb67287, scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb, user.id=fd80457b9a6442669f83515a371fa5c2) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:42.374791 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28011b7f-1901-430a-9544-309e4fb1c4a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:42.376450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28011b7f-1901-430a-9544-309e4fb1c4a5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:42.382838 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 104/220] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:17:42 2022] GET /identity/v3/role_assignments?user.id=fd80457b9a6442669f83515a371fa5c2&scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb&role.id=61c33763c453452d82531c56aeb67287 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:42.665108 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9e48d-475c-4436-9b12-3bff7aebe7ec None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:42.665496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9e48d-475c-4436-9b12-3bff7aebe7ec None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:42.665686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9e48d-475c-4436-9b12-3bff7aebe7ec None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:42.667073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 117/221] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:42.672452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c305cb7-7700-47b3-b7c2-008b70ab288e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:42.672739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c305cb7-7700-47b3-b7c2-008b70ab288e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:42.673012 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c305cb7-7700-47b3-b7c2-008b70ab288e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:42.696876 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3c305cb7-7700-47b3-b7c2-008b70ab288e None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:42.698078 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3c305cb7-7700-47b3-b7c2-008b70ab288e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:42.789880 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 105/222] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:42.825026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9e48d-475c-4436-9b12-3bff7aebe7ec None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:42.832514 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ded92c-c046-4e65-ba2b-b127a2d8bf7d None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:42.832807 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ded92c-c046-4e65-ba2b-b127a2d8bf7d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:42.833092 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ded92c-c046-4e65-ba2b-b127a2d8bf7d None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:42.834482 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 106/223] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:42.839906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcb4ad-c879-4ab5-89f3-9c8d3a7c7252 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:42.840193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcb4ad-c879-4ab5-89f3-9c8d3a7c7252 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:42.840469 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcb4ad-c879-4ab5-89f3-9c8d3a7c7252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:42.867753 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-90bcb4ad-c879-4ab5-89f3-9c8d3a7c7252 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:42.868971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-90bcb4ad-c879-4ab5-89f3-9c8d3a7c7252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:42.895838 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:42.936007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9e48d-475c-4436-9b12-3bff7aebe7ec None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:42.973293 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b7c43-0f4d-4e6b-b91b-9652057ef494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:42.974161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b7c43-0f4d-4e6b-b91b-9652057ef494 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:42.974493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b7c43-0f4d-4e6b-b91b-9652057ef494 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:42.974797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b7c43-0f4d-4e6b-b91b-9652057ef494 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:42.983083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:42.986112 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b7c43-0f4d-4e6b-b91b-9652057ef494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:42.994415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-773b7c43-0f4d-4e6b-b91b-9652057ef494 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:17:42.994415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:42.994415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:42.994415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:42.994415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:42.994415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:42.994415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:42.994415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:42.994415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:42.994415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:42.994415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:42.994415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:42.994415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:42.994415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:42.994415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:42.994415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:42.995290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:42.995290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:42.995290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:42.995290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:42.995290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:42.995290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:42.995290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:42.995290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:42.995290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:42.995290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:42.995290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:42.995290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:42.995290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:42.995290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:42.995290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:42.995290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:42.996054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:42.996054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:42.996054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:42.996054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:42.996054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:42.996054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:42.996054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:42.996054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:42.996054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:42.996054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:42.996054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:17:42.996054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:42.996054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 118/224] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:17:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:43.004688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b7c43-0f4d-4e6b-b91b-9652057ef494 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:43.032537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 107/225] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:43.067142 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcb4ad-c879-4ab5-89f3-9c8d3a7c7252 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:43.153955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b7c43-0f4d-4e6b-b91b-9652057ef494 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:43.189902 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0965a63-0ea4-4dff-b70a-40d18421179c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:43.190558 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0965a63-0ea4-4dff-b70a-40d18421179c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:43.190872 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0965a63-0ea4-4dff-b70a-40d18421179c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:43.191153 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0965a63-0ea4-4dff-b70a-40d18421179c None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:43.191907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0965a63-0ea4-4dff-b70a-40d18421179c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:43.192214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0965a63-0ea4-4dff-b70a-40d18421179c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:43.193601 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0965a63-0ea4-4dff-b70a-40d18421179c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:43.202158 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 119/226] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:43.209547 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0965a63-0ea4-4dff-b70a-40d18421179c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:43.258818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcb4ad-c879-4ab5-89f3-9c8d3a7c7252 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:43.323106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:43.325203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15874eeb-35df-42e5-8f2e-1cb69eaff662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:43.326027 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15874eeb-35df-42e5-8f2e-1cb69eaff662 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:43.326311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15874eeb-35df-42e5-8f2e-1cb69eaff662 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:43.326587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15874eeb-35df-42e5-8f2e-1cb69eaff662 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:43.352702 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15874eeb-35df-42e5-8f2e-1cb69eaff662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:43.368251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-15874eeb-35df-42e5-8f2e-1cb69eaff662 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:17:43.368251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:43.368251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:43.368251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:43.368251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:43.368251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:43.368251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:43.368251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:43.368251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:43.368251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:43.368251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:43.368251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:43.368251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:43.368251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:43.368251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:43.368251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:43.369132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:43.369132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:43.369132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:43.369132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:43.369132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:43.369132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:43.369132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:43.369132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:43.369132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:43.369132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:43.369132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:43.369132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:43.369132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:43.369132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:43.369132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:43.369132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:43.369892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:43.369892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:43.369892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:43.369892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:43.369892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:43.369892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:43.369892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:43.369892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:43.369892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:43.369892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:43.369892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:17:43.369892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:17:43.377610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 108/227] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:17:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:43.379553 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15874eeb-35df-42e5-8f2e-1cb69eaff662 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:43.403098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:43.403482 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0965a63-0ea4-4dff-b70a-40d18421179c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:43.470758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd9a90-c07b-4c68-bdff-938c66b6a5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:43.472175 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd9a90-c07b-4c68-bdff-938c66b6a5de None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:43.472511 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd9a90-c07b-4c68-bdff-938c66b6a5de None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:43.472785 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd9a90-c07b-4c68-bdff-938c66b6a5de None admin] PATH_INFO: `/v3/users/dce4bdd13cbb4b4db78ff6857ff1f8fd` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:43.474005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd9a90-c07b-4c68-bdff-938c66b6a5de None admin] RBAC: Authorizing `identity:get_user(user_id=dce4bdd13cbb4b4db78ff6857ff1f8fd)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:43.475569 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd9a90-c07b-4c68-bdff-938c66b6a5de None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:43.477520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 120/228] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:43 2022] GET /identity/v3/users/dce4bdd13cbb4b4db78ff6857ff1f8fd => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:43.488028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd9a90-c07b-4c68-bdff-938c66b6a5de None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:43.544155 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15874eeb-35df-42e5-8f2e-1cb69eaff662 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:43.613348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded459f-36c7-4cb1-aeb3-41efbfcd14df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:43.614021 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded459f-36c7-4cb1-aeb3-41efbfcd14df None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:43.614299 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded459f-36c7-4cb1-aeb3-41efbfcd14df None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:43.614573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded459f-36c7-4cb1-aeb3-41efbfcd14df None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:43.615355 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded459f-36c7-4cb1-aeb3-41efbfcd14df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:43.615657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded459f-36c7-4cb1-aeb3-41efbfcd14df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:43.617024 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded459f-36c7-4cb1-aeb3-41efbfcd14df None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:43.620463 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd9a90-c07b-4c68-bdff-938c66b6a5de None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:43.639486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 109/229] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:17:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:43.647847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded459f-36c7-4cb1-aeb3-41efbfcd14df None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:43.659916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:43.686040 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859b757-ab20-46d5-a80c-0df878baeed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:43.686948 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859b757-ab20-46d5-a80c-0df878baeed3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:43.687225 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859b757-ab20-46d5-a80c-0df878baeed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:43.687494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859b757-ab20-46d5-a80c-0df878baeed3 None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:43.694769 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859b757-ab20-46d5-a80c-0df878baeed3 None admin] RBAC: Authorizing `identity:get_project(project_id=5a14beb3e8e643bca9af26f2ac0062bb)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:43.694769 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859b757-ab20-46d5-a80c-0df878baeed3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:43.698011 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 121/230] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:43 2022] GET /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:43.709000 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859b757-ab20-46d5-a80c-0df878baeed3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:43.768964 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:43.796330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded459f-36c7-4cb1-aeb3-41efbfcd14df None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:43.830568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ecdba-f68f-4c32-a226-5ff80da07110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:43.832429 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ecdba-f68f-4c32-a226-5ff80da07110 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:43.832769 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ecdba-f68f-4c32-a226-5ff80da07110 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:43.833103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ecdba-f68f-4c32-a226-5ff80da07110 None admin] PATH_INFO: `/v3/users/dce4bdd13cbb4b4db78ff6857ff1f8fd` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:43.834387 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ecdba-f68f-4c32-a226-5ff80da07110 None admin] RBAC: Authorizing `identity:get_user(user_id=dce4bdd13cbb4b4db78ff6857ff1f8fd)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:43.835964 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ecdba-f68f-4c32-a226-5ff80da07110 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:43.837655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 110/231] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:43 2022] GET /identity/v3/users/dce4bdd13cbb4b4db78ff6857ff1f8fd => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:43.843491 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ecdba-f68f-4c32-a226-5ff80da07110 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:43.944670 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859b757-ab20-46d5-a80c-0df878baeed3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:43.949267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ecdba-f68f-4c32-a226-5ff80da07110 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:43.985894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81cdc5e-a1c8-4e31-9b6a-c8c7f3821987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:43.987006 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cdc5e-a1c8-4e31-9b6a-c8c7f3821987 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:43.988047 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cdc5e-a1c8-4e31-9b6a-c8c7f3821987 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:43.988533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cdc5e-a1c8-4e31-9b6a-c8c7f3821987 None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:43.989595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81cdc5e-a1c8-4e31-9b6a-c8c7f3821987 None admin] RBAC: Authorizing `identity:get_project(project_id=5a14beb3e8e643bca9af26f2ac0062bb)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:43.991197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81cdc5e-a1c8-4e31-9b6a-c8c7f3821987 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:43.993608 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 111/232] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:43 2022] GET /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:43.999323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81cdc5e-a1c8-4e31-9b6a-c8c7f3821987 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:44.016405 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:44.043603 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb00b42-260d-4bba-803a-31136bc4190b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:44.044425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb00b42-260d-4bba-803a-31136bc4190b None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:44.044810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb00b42-260d-4bba-803a-31136bc4190b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:44.045089 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb00b42-260d-4bba-803a-31136bc4190b None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb/users/dce4bdd13cbb4b4db78ff6857ff1f8fd/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:44.047237 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb00b42-260d-4bba-803a-31136bc4190b None admin] RBAC: Authorizing `identity:create_grant(project_id=5a14beb3e8e643bca9af26f2ac0062bb, user_id=dce4bdd13cbb4b4db78ff6857ff1f8fd, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:44.048808 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb00b42-260d-4bba-803a-31136bc4190b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:44.070527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 122/233] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:17:43 2022] PUT /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb/users/dce4bdd13cbb4b4db78ff6857ff1f8fd/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:17:44.072049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e1646-e27d-41c3-81bf-ecd20d1ab6b4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:44.072340 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e1646-e27d-41c3-81bf-ecd20d1ab6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:44.072619 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e1646-e27d-41c3-81bf-ecd20d1ab6b4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:44.074083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 123/234] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:44.080852 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa390d-8f84-46d5-8af9-49cbdd3e820b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:44.081230 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa390d-8f84-46d5-8af9-49cbdd3e820b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:44.081420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa390d-8f84-46d5-8af9-49cbdd3e820b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:44.105469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-02fa390d-8f84-46d5-8af9-49cbdd3e820b None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:44.107336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-02fa390d-8f84-46d5-8af9-49cbdd3e820b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:44.167345 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:44.171422 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81cdc5e-a1c8-4e31-9b6a-c8c7f3821987 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:44.202540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 124/235] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:44.208323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e969ad-6b2c-45e0-ac7b-bb0d86d6fa1e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:44.208602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e969ad-6b2c-45e0-ac7b-bb0d86d6fa1e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:44.208875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e969ad-6b2c-45e0-ac7b-bb0d86d6fa1e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:44.210703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 125/236] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:44.217479 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafaba7-31af-4a54-b71a-f07b737f3bd9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:44.217756 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafaba7-31af-4a54-b71a-f07b737f3bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:44.218027 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafaba7-31af-4a54-b71a-f07b737f3bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:44.243366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-afafaba7-31af-4a54-b71a-f07b737f3bd9 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:44.243607 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82ec15-1768-4ae1-b225-97687f9e4964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:44.244419 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82ec15-1768-4ae1-b225-97687f9e4964 None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:44.244705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82ec15-1768-4ae1-b225-97687f9e4964 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:44.245148 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82ec15-1768-4ae1-b225-97687f9e4964 None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb/users/dce4bdd13cbb4b4db78ff6857ff1f8fd/roles/b929adc09fcc41daaf5cf39de856c1b6` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:44.245262 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-afafaba7-31af-4a54-b71a-f07b737f3bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:44.248119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82ec15-1768-4ae1-b225-97687f9e4964 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a14beb3e8e643bca9af26f2ac0062bb, user_id=dce4bdd13cbb4b4db78ff6857ff1f8fd, role_id=b929adc09fcc41daaf5cf39de856c1b6)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:44.250858 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82ec15-1768-4ae1-b225-97687f9e4964 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:44.273142 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 112/237] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:17:43 2022] PUT /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb/users/dce4bdd13cbb4b4db78ff6857ff1f8fd/roles/b929adc09fcc41daaf5cf39de856c1b6 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:17:44.274676 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82ec15-1768-4ae1-b225-97687f9e4964 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:44.347483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 126/238] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:44.374262 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafaba7-31af-4a54-b71a-f07b737f3bd9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:44.376769 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:44.420951 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82ec15-1768-4ae1-b225-97687f9e4964 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:44.464501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b129b-a662-4c77-89a0-60717cd04c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:44.465646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b129b-a662-4c77-89a0-60717cd04c4d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:44.466106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b129b-a662-4c77-89a0-60717cd04c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:44.466535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b129b-a662-4c77-89a0-60717cd04c4d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:44.480202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b129b-a662-4c77-89a0-60717cd04c4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:44.491780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-994b129b-a662-4c77-89a0-60717cd04c4d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 12:17:44.491780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:44.491780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:44.491780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:44.491780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:44.491780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:44.491780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:44.491780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:44.491780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:44.491780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:44.491780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:44.491780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:44.491780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:44.491780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:44.491780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:44.491780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:44.492692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:44.492692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:44.492692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:44.492692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:44.492692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:44.492692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:44.492692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:44.492692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:44.492692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:44.492692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:44.492692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:44.492692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:44.492692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:44.492692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:44.492692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:44.492692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:44.493480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:44.493480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:44.493480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:44.493480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:44.493480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:44.493480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:44.493480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:44.493480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:44.493480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:44.493480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:44.493480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 12:17:44.493480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:17:44.496028 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 113/239] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:44.502530 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b129b-a662-4c77-89a0-60717cd04c4d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:44.503873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafaba7-31af-4a54-b71a-f07b737f3bd9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:44.520857 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:44.560600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9725d7-d6a7-4f4c-8c33-22a19a27f46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:44.561538 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9725d7-d6a7-4f4c-8c33-22a19a27f46b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:44.561783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9725d7-d6a7-4f4c-8c33-22a19a27f46b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:44.562055 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9725d7-d6a7-4f4c-8c33-22a19a27f46b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:44.563266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9725d7-d6a7-4f4c-8c33-22a19a27f46b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:44.564719 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9725d7-d6a7-4f4c-8c33-22a19a27f46b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:44.567021 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 127/240] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:17:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:44.575880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9725d7-d6a7-4f4c-8c33-22a19a27f46b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:44.618423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b129b-a662-4c77-89a0-60717cd04c4d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:44.647799 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:44.665587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a658b-2419-46ce-b784-feb434ccbeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:44.666617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a658b-2419-46ce-b784-feb434ccbeac None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:44.667367 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a658b-2419-46ce-b784-feb434ccbeac None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:44.667850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a658b-2419-46ce-b784-feb434ccbeac None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:44.668815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a658b-2419-46ce-b784-feb434ccbeac None admin] RBAC: Adding query filter params (name=reader) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:44.669323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a658b-2419-46ce-b784-feb434ccbeac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:44.671168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a658b-2419-46ce-b784-feb434ccbeac None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:44.693556 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 114/241] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:44.697172 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a658b-2419-46ce-b784-feb434ccbeac None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:44.819623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9725d7-d6a7-4f4c-8c33-22a19a27f46b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:44.847184 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a658b-2419-46ce-b784-feb434ccbeac None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:44.879132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ba877-a7ff-4774-80ee-61cc438dfee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:44.879769 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ba877-a7ff-4774-80ee-61cc438dfee1 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:44.880044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ba877-a7ff-4774-80ee-61cc438dfee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:44.880312 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ba877-a7ff-4774-80ee-61cc438dfee1 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:44.881128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ba877-a7ff-4774-80ee-61cc438dfee1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:44.882567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ba877-a7ff-4774-80ee-61cc438dfee1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:44.885587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101945b-0f8d-42cd-b9d3-a8262c548f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:44.886599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101945b-0f8d-42cd-b9d3-a8262c548f7f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:44.886913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101945b-0f8d-42cd-b9d3-a8262c548f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:44.887190 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101945b-0f8d-42cd-b9d3-a8262c548f7f None admin] PATH_INFO: `/v3/users/b6d6c44f831c4e8c8c399c44bd133be2` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:44.903924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101945b-0f8d-42cd-b9d3-a8262c548f7f None admin] RBAC: Authorizing `identity:get_user(user_id=b6d6c44f831c4e8c8c399c44bd133be2)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:44.905675 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101945b-0f8d-42cd-b9d3-a8262c548f7f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:44.913617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 115/242] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:44 2022] GET /identity/v3/users/b6d6c44f831c4e8c8c399c44bd133be2 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:44.915315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101945b-0f8d-42cd-b9d3-a8262c548f7f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:44.925635 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 128/243] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 19 12:17:44 2022] POST /identity/v3/users => generated 293 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:17:44.975998 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:45.036681 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101945b-0f8d-42cd-b9d3-a8262c548f7f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:45.036876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8555c22-c1b1-454f-b5e3-7f6ca9ed1e11 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:45.037121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8555c22-c1b1-454f-b5e3-7f6ca9ed1e11 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:45.037279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8555c22-c1b1-454f-b5e3-7f6ca9ed1e11 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:45.038860 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 129/244] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:17:45.045331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ef51f-e3e6-4e9f-aa69-e68369303563 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:45.045914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ef51f-e3e6-4e9f-aa69-e68369303563 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:45.045914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ef51f-e3e6-4e9f-aa69-e68369303563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:45.077020 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bee01-dc8f-4f97-8018-4c384cd75761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:45.077721 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bee01-dc8f-4f97-8018-4c384cd75761 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:45.078012 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bee01-dc8f-4f97-8018-4c384cd75761 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:45.078296 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bee01-dc8f-4f97-8018-4c384cd75761 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:45.088440 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d01ef51f-e3e6-4e9f-aa69-e68369303563 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:45.089661 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d01ef51f-e3e6-4e9f-aa69-e68369303563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:45.153359 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:45.170960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bee01-dc8f-4f97-8018-4c384cd75761 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:45.172660 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bee01-dc8f-4f97-8018-4c384cd75761 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:45.228073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 130/245] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:45.231029 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:45.259973 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ef51f-e3e6-4e9f-aa69-e68369303563 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:45.296096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 116/246] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:17:45.298804 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bee01-dc8f-4f97-8018-4c384cd75761 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:45.380449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ef51f-e3e6-4e9f-aa69-e68369303563 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:45.414351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bee01-dc8f-4f97-8018-4c384cd75761 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:45.421301 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1343ab3-bf0d-4946-9a19-e7c58ae589a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:45.422116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1343ab3-bf0d-4946-9a19-e7c58ae589a7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:45.422609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1343ab3-bf0d-4946-9a19-e7c58ae589a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:45.423171 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1343ab3-bf0d-4946-9a19-e7c58ae589a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:45.436224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1343ab3-bf0d-4946-9a19-e7c58ae589a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:45.445071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d1343ab3-bf0d-4946-9a19-e7c58ae589a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:45.445071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:45.445071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:45.445071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:45.445071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:45.445071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:45.445071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:45.445071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:45.445071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:45.445071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:45.445071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:45.445071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:45.445071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:45.445071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:45.445071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:45.445071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:45.446058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:45.446058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:45.446058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:45.446058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:45.446058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:45.446058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:45.446058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:45.446058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:45.446058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:45.446058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:45.446058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:45.446058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:45.446058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:45.446058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:45.446058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:45.446058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:45.447271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:45.447271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:45.447271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:45.447271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:45.447271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:45.447271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:45.447271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:45.447271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:45.447271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:45.447271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:45.447271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:45.447271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:45.447271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 131/247] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:17:45.452791 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1343ab3-bf0d-4946-9a19-e7c58ae589a7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:45.459631 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f96bce-228e-4990-bb94-9a0959dd1e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:45.460834 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f96bce-228e-4990-bb94-9a0959dd1e19 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:45.461345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f96bce-228e-4990-bb94-9a0959dd1e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:45.461817 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f96bce-228e-4990-bb94-9a0959dd1e19 None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:45.463391 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f96bce-228e-4990-bb94-9a0959dd1e19 None admin] RBAC: Authorizing `identity:get_project(project_id=5a14beb3e8e643bca9af26f2ac0062bb)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:45.465107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f96bce-228e-4990-bb94-9a0959dd1e19 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:45.467350 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 117/248] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:45 2022] GET /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:45.474201 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f96bce-228e-4990-bb94-9a0959dd1e19 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:45.483001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:45.498079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:45.582895 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1343ab3-bf0d-4946-9a19-e7c58ae589a7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:45.592020 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f96bce-228e-4990-bb94-9a0959dd1e19 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:45.631799 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428d744-736e-4550-b0c2-43677f7a5e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:45.632791 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc993fd9-1163-444a-aa77-9604f9d64309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:45.633081 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428d744-736e-4550-b0c2-43677f7a5e1f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:45.633590 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428d744-736e-4550-b0c2-43677f7a5e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:45.633893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc993fd9-1163-444a-aa77-9604f9d64309 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:45.634177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc993fd9-1163-444a-aa77-9604f9d64309 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:45.634451 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc993fd9-1163-444a-aa77-9604f9d64309 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:45.634782 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428d744-736e-4550-b0c2-43677f7a5e1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:45.635262 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc993fd9-1163-444a-aa77-9604f9d64309 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:45.635564 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc993fd9-1163-444a-aa77-9604f9d64309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:45.636252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428d744-736e-4550-b0c2-43677f7a5e1f None admin] RBAC: Adding query filter params (role.id=eb94b5e764af483db56184d52333f6da, scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb, user.id=b6d6c44f831c4e8c8c399c44bd133be2) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:45.636784 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428d744-736e-4550-b0c2-43677f7a5e1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:45.636962 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc993fd9-1163-444a-aa77-9604f9d64309 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:45.639035 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428d744-736e-4550-b0c2-43677f7a5e1f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:45.648487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 132/249] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:45.652674 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 118/250] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:17:45 2022] GET /identity/v3/role_assignments?user.id=b6d6c44f831c4e8c8c399c44bd133be2&scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb&role.id=eb94b5e764af483db56184d52333f6da => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:45.654870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc993fd9-1163-444a-aa77-9604f9d64309 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:45.771139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:45.786751 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc993fd9-1163-444a-aa77-9604f9d64309 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:45.829469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cba48f-647b-4aa1-aac3-b26c6523ac48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:45.830361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cba48f-647b-4aa1-aac3-b26c6523ac48 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:45.830637 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cba48f-647b-4aa1-aac3-b26c6523ac48 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:45.831563 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cba48f-647b-4aa1-aac3-b26c6523ac48 None admin] PATH_INFO: `/v3/users/fd80457b9a6442669f83515a371fa5c2` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:45.832911 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cba48f-647b-4aa1-aac3-b26c6523ac48 None admin] RBAC: Authorizing `identity:get_user(user_id=fd80457b9a6442669f83515a371fa5c2)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:45.834376 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cba48f-647b-4aa1-aac3-b26c6523ac48 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:45.836352 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 133/251] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:45 2022] GET /identity/v3/users/fd80457b9a6442669f83515a371fa5c2 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:45.842624 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428d744-736e-4550-b0c2-43677f7a5e1f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:45.956898 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:45.988958 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428d744-736e-4550-b0c2-43677f7a5e1f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:46.027420 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a5a94-c696-4829-8954-6d6dab3dd96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:46.028305 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a5a94-c696-4829-8954-6d6dab3dd96a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:46.028586 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a5a94-c696-4829-8954-6d6dab3dd96a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:46.028860 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a5a94-c696-4829-8954-6d6dab3dd96a None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:46.031833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a5a94-c696-4829-8954-6d6dab3dd96a None admin] RBAC: Authorizing `identity:get_project(project_id=5a14beb3e8e643bca9af26f2ac0062bb)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:46.033369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a5a94-c696-4829-8954-6d6dab3dd96a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:46.035649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 119/252] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:45 2022] GET /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:46.041441 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cba48f-647b-4aa1-aac3-b26c6523ac48 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:46.149437 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cba48f-647b-4aa1-aac3-b26c6523ac48 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:46.184168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308c7ae-0b05-4ffc-86ce-60242116ad4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:46.185053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308c7ae-0b05-4ffc-86ce-60242116ad4e None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:46.185381 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308c7ae-0b05-4ffc-86ce-60242116ad4e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:46.185713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308c7ae-0b05-4ffc-86ce-60242116ad4e None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb/users/fd80457b9a6442669f83515a371fa5c2/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:46.187947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308c7ae-0b05-4ffc-86ce-60242116ad4e None admin] RBAC: Authorizing `identity:create_grant(project_id=5a14beb3e8e643bca9af26f2ac0062bb, user_id=fd80457b9a6442669f83515a371fa5c2, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:46.189484 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308c7ae-0b05-4ffc-86ce-60242116ad4e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:46.203965 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 134/253] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:17:46 2022] PUT /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb/users/fd80457b9a6442669f83515a371fa5c2/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:17:46.945728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccd4be-0390-4a55-946a-498d4f81a5f4 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:46.946231 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccd4be-0390-4a55-946a-498d4f81a5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:46.946302 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccd4be-0390-4a55-946a-498d4f81a5f4 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:46.947918 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 120/254] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:46.953299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca260cb1-f099-480c-b2a2-f564d48e5bc1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:46.953537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca260cb1-f099-480c-b2a2-f564d48e5bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:46.953816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca260cb1-f099-480c-b2a2-f564d48e5bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:46.971844 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ca260cb1-f099-480c-b2a2-f564d48e5bc1 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:46.973032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ca260cb1-f099-480c-b2a2-f564d48e5bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:46.980870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:47.038726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045324f-ffb5-4817-b705-654340aedf61 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:47.039078 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045324f-ffb5-4817-b705-654340aedf61 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:47.039369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045324f-ffb5-4817-b705-654340aedf61 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:47.040917 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 121/255] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:17:47.046484 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f090c-857a-4c0e-8c4b-5bdb2443b5de None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:47.047120 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f090c-857a-4c0e-8c4b-5bdb2443b5de None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:47.047635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f090c-857a-4c0e-8c4b-5bdb2443b5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:47.051771 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 135/256] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:47.075524 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-843f090c-857a-4c0e-8c4b-5bdb2443b5de None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:47.075828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca260cb1-f099-480c-b2a2-f564d48e5bc1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:47.077262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-843f090c-857a-4c0e-8c4b-5bdb2443b5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:47.184486 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca260cb1-f099-480c-b2a2-f564d48e5bc1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:47.204262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 122/257] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:17:47.221142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a5a78-efa6-4e48-9737-b62e033d596a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:47.222487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a5a78-efa6-4e48-9737-b62e033d596a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:47.222860 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a5a78-efa6-4e48-9737-b62e033d596a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:47.223247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a5a78-efa6-4e48-9737-b62e033d596a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:47.233767 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a5a78-efa6-4e48-9737-b62e033d596a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:47.242245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-4c3a5a78-efa6-4e48-9737-b62e033d596a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:17:47.242245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:47.242245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:47.242245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:47.242245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:47.242245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:47.242245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:47.242245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:47.242245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:47.242245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:47.242245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:47.242245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:47.242245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:47.242245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:47.242245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:47.242245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:47.243152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:47.243152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:47.243152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:47.243152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:47.243152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:47.243152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:47.243152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:47.243152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:47.243152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:47.243152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:47.243152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:47.243152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:47.243152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:47.243152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:47.243152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:47.243152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:47.245016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:47.245016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:47.245016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:47.245016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:47.245016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:47.245016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:47.245016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:47.245016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:47.245016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:47.245016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:47.245016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:17:47.245016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:47.245016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 136/258] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:17:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:17:47.249545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f090c-857a-4c0e-8c4b-5bdb2443b5de None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:47.253696 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a5a78-efa6-4e48-9737-b62e033d596a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:47.258295 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:47.391158 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:47.435842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f090c-857a-4c0e-8c4b-5bdb2443b5de None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:47.454856 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a5a78-efa6-4e48-9737-b62e033d596a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:47.507714 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ca3ff-9b52-4374-9ed4-fe0281f941e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:47.508443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ca3ff-9b52-4374-9ed4-fe0281f941e6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:47.508726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ca3ff-9b52-4374-9ed4-fe0281f941e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:47.508999 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ca3ff-9b52-4374-9ed4-fe0281f941e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:47.509758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ca3ff-9b52-4374-9ed4-fe0281f941e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:47.510061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ca3ff-9b52-4374-9ed4-fe0281f941e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:47.511465 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ca3ff-9b52-4374-9ed4-fe0281f941e6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:47.523127 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 123/259] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:17:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:47.523558 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2bb32-7daf-4b07-b095-1bc2b3a30ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:47.524350 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2bb32-7daf-4b07-b095-1bc2b3a30ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:47.524628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2bb32-7daf-4b07-b095-1bc2b3a30ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:47.524902 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2bb32-7daf-4b07-b095-1bc2b3a30ca6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:47.530993 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ca3ff-9b52-4374-9ed4-fe0281f941e6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:47.555441 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2bb32-7daf-4b07-b095-1bc2b3a30ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:47.563220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-3fe2bb32-7daf-4b07-b095-1bc2b3a30ca6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:17:47.563220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:47.563220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:47.563220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:47.563220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:47.563220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:47.563220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:47.563220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:47.563220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:47.563220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:47.563220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:47.563220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:47.563220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:47.563220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:47.563220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:47.563220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:47.564064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:47.564064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:47.564064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:47.564064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:47.564064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:47.564064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:47.564064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:47.564064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:47.564064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:47.564064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:47.564064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:47.564064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:47.564064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:47.564064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:47.564064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:47.564064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:47.564928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:47.564928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:47.564928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:47.564928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:47.564928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:47.564928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:47.564928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:47.564928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:47.564928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:47.564928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:47.564928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:17:47.564928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:47.572737 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 137/260] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:17:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:47.573577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2bb32-7daf-4b07-b095-1bc2b3a30ca6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:47.664487 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ca3ff-9b52-4374-9ed4-fe0281f941e6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:47.674366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:47.701149 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9da353-61a7-4267-a5ad-3a33b0621a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:47.702034 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9da353-61a7-4267-a5ad-3a33b0621a86 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:47.702318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9da353-61a7-4267-a5ad-3a33b0621a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:47.702595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9da353-61a7-4267-a5ad-3a33b0621a86 None admin] PATH_INFO: `/v3/users/dce4bdd13cbb4b4db78ff6857ff1f8fd` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:47.715698 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9da353-61a7-4267-a5ad-3a33b0621a86 None admin] RBAC: Authorizing `identity:get_user(user_id=dce4bdd13cbb4b4db78ff6857ff1f8fd)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:47.717097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9da353-61a7-4267-a5ad-3a33b0621a86 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:47.718935 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 124/261] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:47 2022] GET /identity/v3/users/dce4bdd13cbb4b4db78ff6857ff1f8fd => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:47.724640 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9da353-61a7-4267-a5ad-3a33b0621a86 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:47.731447 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2bb32-7daf-4b07-b095-1bc2b3a30ca6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:47.749580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:47.794699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d114c7-b266-4559-bc32-180052bab548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:47.795449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d114c7-b266-4559-bc32-180052bab548 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:47.795739 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d114c7-b266-4559-bc32-180052bab548 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:47.796017 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d114c7-b266-4559-bc32-180052bab548 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:47.796818 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d114c7-b266-4559-bc32-180052bab548 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:47.797126 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d114c7-b266-4559-bc32-180052bab548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:47.798519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d114c7-b266-4559-bc32-180052bab548 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:47.815811 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 138/262] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:47.821532 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d114c7-b266-4559-bc32-180052bab548 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:47.943477 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9da353-61a7-4267-a5ad-3a33b0621a86 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:47.974147 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d114c7-b266-4559-bc32-180052bab548 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:48.008604 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224407e-3172-4547-97c4-9c65a480d9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:48.009378 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224407e-3172-4547-97c4-9c65a480d9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:48.009672 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224407e-3172-4547-97c4-9c65a480d9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:48.009948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224407e-3172-4547-97c4-9c65a480d9c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:48.027186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:48.043295 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbb447-3ff3-43df-a127-32d0f505bdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:48.044231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbb447-3ff3-43df-a127-32d0f505bdea None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:48.044512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbb447-3ff3-43df-a127-32d0f505bdea None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:48.044786 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbb447-3ff3-43df-a127-32d0f505bdea None admin] PATH_INFO: `/v3/users/dce4bdd13cbb4b4db78ff6857ff1f8fd` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:48.047533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbb447-3ff3-43df-a127-32d0f505bdea None admin] RBAC: Authorizing `identity:get_user(user_id=dce4bdd13cbb4b4db78ff6857ff1f8fd)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:48.048995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbb447-3ff3-43df-a127-32d0f505bdea None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:48.051281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 139/263] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:47 2022] GET /identity/v3/users/dce4bdd13cbb4b4db78ff6857ff1f8fd => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:48.056759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbb447-3ff3-43df-a127-32d0f505bdea None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:48.212339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224407e-3172-4547-97c4-9c65a480d9c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:48.213825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224407e-3172-4547-97c4-9c65a480d9c3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:48.226233 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbb447-3ff3-43df-a127-32d0f505bdea None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:48.231068 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:48.286075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8e565-158f-42a3-95ba-aed63c6deecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:48.291076 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8e565-158f-42a3-95ba-aed63c6deecc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:48.291383 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8e565-158f-42a3-95ba-aed63c6deecc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:48.291670 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8e565-158f-42a3-95ba-aed63c6deecc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:48.401632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:48.412472 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8e565-158f-42a3-95ba-aed63c6deecc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:48.413968 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8e565-158f-42a3-95ba-aed63c6deecc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:48.437625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 125/264] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 12:17:48.443340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224407e-3172-4547-97c4-9c65a480d9c3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:48.589813 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 140/265] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:17:48.603877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8e565-158f-42a3-95ba-aed63c6deecc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:48.608787 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224407e-3172-4547-97c4-9c65a480d9c3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:48.623079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:48.664427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7d6c5-e1d8-45c1-a7c9-9723aa8236db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:48.665669 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7d6c5-e1d8-45c1-a7c9-9723aa8236db None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:48.666163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7d6c5-e1d8-45c1-a7c9-9723aa8236db None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:48.666643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7d6c5-e1d8-45c1-a7c9-9723aa8236db None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:48.671462 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7d6c5-e1d8-45c1-a7c9-9723aa8236db None admin] RBAC: Authorizing `identity:get_project(project_id=5a14beb3e8e643bca9af26f2ac0062bb)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:48.673179 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7d6c5-e1d8-45c1-a7c9-9723aa8236db None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:48.675475 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 126/266] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:48 2022] GET /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:48.677126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e876c5-f3db-46ac-9bce-2880e40b01f0 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:48.677637 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e876c5-f3db-46ac-9bce-2880e40b01f0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:48.678124 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e876c5-f3db-46ac-9bce-2880e40b01f0 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:48.679879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 127/267] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:48.685844 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fde89-40c2-4e07-a38e-8520916f0f8d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:48.686361 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fde89-40c2-4e07-a38e-8520916f0f8d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:48.686881 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fde89-40c2-4e07-a38e-8520916f0f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:48.723778 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-592fde89-40c2-4e07-a38e-8520916f0f8d None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:48.725014 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-592fde89-40c2-4e07-a38e-8520916f0f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:48.727072 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8e565-158f-42a3-95ba-aed63c6deecc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:48.749478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:48.764476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603df7f-c7ab-4c73-8e3b-ced3359627fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:48.765347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603df7f-c7ab-4c73-8e3b-ced3359627fb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:48.765622 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603df7f-c7ab-4c73-8e3b-ced3359627fb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:48.765898 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603df7f-c7ab-4c73-8e3b-ced3359627fb None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:48.769603 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603df7f-c7ab-4c73-8e3b-ced3359627fb None admin] RBAC: Authorizing `identity:get_project(project_id=5a14beb3e8e643bca9af26f2ac0062bb)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:48.771162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603df7f-c7ab-4c73-8e3b-ced3359627fb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:48.773209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 141/268] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:48 2022] GET /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:48.773990 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603df7f-c7ab-4c73-8e3b-ced3359627fb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:48.878349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603df7f-c7ab-4c73-8e3b-ced3359627fb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:48.909565 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 128/269] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:48.910715 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fde89-40c2-4e07-a38e-8520916f0f8d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:48.918173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51389816-7531-41f2-97d5-aa888d31caf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:48.918862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51389816-7531-41f2-97d5-aa888d31caf7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:48.919141 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51389816-7531-41f2-97d5-aa888d31caf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:48.919413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51389816-7531-41f2-97d5-aa888d31caf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:48.920245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51389816-7531-41f2-97d5-aa888d31caf7 None admin] RBAC: Adding query filter params (role.id=b929adc09fcc41daaf5cf39de856c1b6, scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb, user.id=dce4bdd13cbb4b4db78ff6857ff1f8fd) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:48.920553 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51389816-7531-41f2-97d5-aa888d31caf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:48.921994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51389816-7531-41f2-97d5-aa888d31caf7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:48.928227 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 142/270] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:17:48 2022] GET /identity/v3/role_assignments?user.id=dce4bdd13cbb4b4db78ff6857ff1f8fd&scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb&role.id=b929adc09fcc41daaf5cf39de856c1b6 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:48.945221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51389816-7531-41f2-97d5-aa888d31caf7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:48.999169 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:49.110867 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fde89-40c2-4e07-a38e-8520916f0f8d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:49.125404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:49.138683 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51389816-7531-41f2-97d5-aa888d31caf7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:49.163426 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e51eec-0cb5-49af-b747-f58f51c2d31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:49.164435 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e51eec-0cb5-49af-b747-f58f51c2d31f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:49.164719 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e51eec-0cb5-49af-b747-f58f51c2d31f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:49.164992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e51eec-0cb5-49af-b747-f58f51c2d31f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:49.165859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e51eec-0cb5-49af-b747-f58f51c2d31f None admin] RBAC: Adding query filter params (role.id=386cb814e8464fda8832b13c75eabdaf, scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb, user.id=dce4bdd13cbb4b4db78ff6857ff1f8fd) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:49.166173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e51eec-0cb5-49af-b747-f58f51c2d31f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:49.167892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e51eec-0cb5-49af-b747-f58f51c2d31f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:49.175197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 129/271] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:17:48 2022] GET /identity/v3/role_assignments?user.id=dce4bdd13cbb4b4db78ff6857ff1f8fd&scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb&role.id=386cb814e8464fda8832b13c75eabdaf => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:49.176605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d423c-4d11-4a9e-adb2-a170680fa069 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:49.176904 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d423c-4d11-4a9e-adb2-a170680fa069 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:49.177167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d423c-4d11-4a9e-adb2-a170680fa069 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:49.178427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 130/272] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:49.179654 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160e6ce-b322-44ec-89e8-b57b8064c131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:49.180476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160e6ce-b322-44ec-89e8-b57b8064c131 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:49.180758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160e6ce-b322-44ec-89e8-b57b8064c131 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:49.181035 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160e6ce-b322-44ec-89e8-b57b8064c131 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:49.184338 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bdaae-c544-478d-9e9e-c2b0eb61ebfe None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:49.184616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bdaae-c544-478d-9e9e-c2b0eb61ebfe None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:49.184893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bdaae-c544-478d-9e9e-c2b0eb61ebfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:49.194156 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160e6ce-b322-44ec-89e8-b57b8064c131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:49.202304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-0160e6ce-b322-44ec-89e8-b57b8064c131 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 12:17:49.202304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:49.202304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:49.202304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:49.202304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:49.202304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:49.202304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:49.202304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:49.202304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:49.202304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:49.202304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:49.202304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:49.202304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:49.202304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:49.202304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:49.202304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:49.204535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:49.204535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:49.204535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:49.204535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:49.204535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:49.204535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:49.204535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:49.204535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:49.204535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:49.204535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:49.204535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:49.204535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:49.204535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:49.204535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:49.204535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:49.204535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:49.206584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:49.206584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:49.206584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:49.206584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:49.206584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:49.206584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:49.206584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:49.206584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:49.206584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:49.206584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:49.206584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 12:17:49.206584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:49.207204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-1b8bdaae-c544-478d-9e9e-c2b0eb61ebfe None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:49.207283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 143/273] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:49.207358 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1b8bdaae-c544-478d-9e9e-c2b0eb61ebfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:49.210490 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160e6ce-b322-44ec-89e8-b57b8064c131 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:49.324080 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 131/274] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:17:49.325639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1b6e6-0195-462e-983e-71fbbe1ed3d0 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:49.325935 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1b6e6-0195-462e-983e-71fbbe1ed3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:49.326218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1b6e6-0195-462e-983e-71fbbe1ed3d0 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:49.327543 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 132/275] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:49.332937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:49.334406 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddb542-53a4-45e1-9122-71432cdb2611 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:49.334693 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddb542-53a4-45e1-9122-71432cdb2611 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:49.335654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddb542-53a4-45e1-9122-71432cdb2611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:49.347674 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160e6ce-b322-44ec-89e8-b57b8064c131 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:49.356034 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-63ddb542-53a4-45e1-9122-71432cdb2611 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:49.357356 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-63ddb542-53a4-45e1-9122-71432cdb2611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:49.394510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb7dc5-0992-482a-8b08-e57485f9f2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:49.395146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb7dc5-0992-482a-8b08-e57485f9f2ef None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:49.395430 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb7dc5-0992-482a-8b08-e57485f9f2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:49.395709 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb7dc5-0992-482a-8b08-e57485f9f2ef None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:49.396450 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb7dc5-0992-482a-8b08-e57485f9f2ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:49.396752 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb7dc5-0992-482a-8b08-e57485f9f2ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:49.398143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb7dc5-0992-482a-8b08-e57485f9f2ef None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:49.411851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 144/276] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:49.418605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca453ebe-d4ba-4a2f-bde0-9b1b2b198459 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:49.418972 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca453ebe-d4ba-4a2f-bde0-9b1b2b198459 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:49.419275 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca453ebe-d4ba-4a2f-bde0-9b1b2b198459 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:49.420603 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 145/277] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:49.421305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca453ebe-d4ba-4a2f-bde0-9b1b2b198459 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:49.449378 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 133/278] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:17:49.454919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddb542-53a4-45e1-9122-71432cdb2611 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:49.484371 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:49.550933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca453ebe-d4ba-4a2f-bde0-9b1b2b198459 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:49.561777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddb542-53a4-45e1-9122-71432cdb2611 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:49.583462 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef3d7e-91a5-4a08-9c94-05688a2bc68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:49.584269 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef3d7e-91a5-4a08-9c94-05688a2bc68c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:49.584520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef3d7e-91a5-4a08-9c94-05688a2bc68c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:49.584792 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef3d7e-91a5-4a08-9c94-05688a2bc68c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:49.585958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef3d7e-91a5-4a08-9c94-05688a2bc68c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:49.587445 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef3d7e-91a5-4a08-9c94-05688a2bc68c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:49.589048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 146/279] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:17:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:49.590170 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c57db-34dc-4edf-8d50-044116dfc576 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:49.590453 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c57db-34dc-4edf-8d50-044116dfc576 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:49.590726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c57db-34dc-4edf-8d50-044116dfc576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:49.601028 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc5a48-33c6-4098-8347-8ade7ca5fe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:49.601903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc5a48-33c6-4098-8347-8ade7ca5fe29 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:49.602183 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc5a48-33c6-4098-8347-8ade7ca5fe29 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:49.602451 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc5a48-33c6-4098-8347-8ade7ca5fe29 None admin] PATH_INFO: `/v3/users/b6d6c44f831c4e8c8c399c44bd133be2` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:49.603669 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc5a48-33c6-4098-8347-8ade7ca5fe29 None admin] RBAC: Authorizing `identity:get_user(user_id=b6d6c44f831c4e8c8c399c44bd133be2)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:49.605107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc5a48-33c6-4098-8347-8ade7ca5fe29 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:49.606760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 134/280] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:49 2022] GET /identity/v3/users/b6d6c44f831c4e8c8c399c44bd133be2 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:49.607121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-462c57db-34dc-4edf-8d50-044116dfc576 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:49.608307 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-462c57db-34dc-4edf-8d50-044116dfc576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:49.610817 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc5a48-33c6-4098-8347-8ade7ca5fe29 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:49.618307 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:49.676418 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 147/281] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:49.677222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c57db-34dc-4edf-8d50-044116dfc576 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:49.708561 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:49.712598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc5a48-33c6-4098-8347-8ade7ca5fe29 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:49.748136 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dd601-5419-4a2b-8b96-985efcc9c46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:49.748930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dd601-5419-4a2b-8b96-985efcc9c46c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:49.749211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dd601-5419-4a2b-8b96-985efcc9c46c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:49.749476 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7dd601-5419-4a2b-8b96-985efcc9c46c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:49.760235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7dd601-5419-4a2b-8b96-985efcc9c46c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:49.768199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-8b7dd601-5419-4a2b-8b96-985efcc9c46c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:49.768199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:49.768199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:49.768199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:49.768199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:49.768199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:49.768199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:49.768199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:49.768199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:49.768199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:49.768199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:49.768199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:49.768199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:49.768199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:49.768199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:49.768199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:49.769885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:49.769885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:49.769885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:49.769885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:49.769885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:49.769885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:49.769885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:49.769885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:49.769885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:49.769885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:49.769885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:49.769885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:49.769885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:49.769885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:49.769885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:49.769885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:49.770668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:49.770668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:49.770668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:49.770668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:49.770668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:49.770668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:49.770668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:49.770668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:49.770668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:49.770668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:49.770668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:49.770668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:17:49.770668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 135/282] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:49.771344 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dd601-5419-4a2b-8b96-985efcc9c46c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:49.790648 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c57db-34dc-4edf-8d50-044116dfc576 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:49.825192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2066152-c19a-46e5-9141-8630c4e6e982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:49.825854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2066152-c19a-46e5-9141-8630c4e6e982 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:49.826130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2066152-c19a-46e5-9141-8630c4e6e982 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:49.826405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2066152-c19a-46e5-9141-8630c4e6e982 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:49.827267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2066152-c19a-46e5-9141-8630c4e6e982 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:49.828716 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2066152-c19a-46e5-9141-8630c4e6e982 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:49.844428 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:49.849862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 148/283] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 19 12:17:49 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:17:49.851992 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2066152-c19a-46e5-9141-8630c4e6e982 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:49.879048 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7dd601-5419-4a2b-8b96-985efcc9c46c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:49.922231 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92741746-2e16-4627-abdc-61568b131ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:49.923223 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92741746-2e16-4627-abdc-61568b131ccd None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:49.923427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92741746-2e16-4627-abdc-61568b131ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:49.923704 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92741746-2e16-4627-abdc-61568b131ccd None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:49.925745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92741746-2e16-4627-abdc-61568b131ccd None admin] RBAC: Authorizing `identity:get_project(project_id=5a14beb3e8e643bca9af26f2ac0062bb)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:49.927536 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92741746-2e16-4627-abdc-61568b131ccd None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:49.934032 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 136/284] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:49 2022] GET /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:49.934032 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92741746-2e16-4627-abdc-61568b131ccd None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:49.966221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:49.980636 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2066152-c19a-46e5-9141-8630c4e6e982 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:50.023585 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0354363-975e-475e-837d-7c00a375cba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:50.024629 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0354363-975e-475e-837d-7c00a375cba8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:50.025061 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0354363-975e-475e-837d-7c00a375cba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:50.025493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0354363-975e-475e-837d-7c00a375cba8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:50.036792 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0354363-975e-475e-837d-7c00a375cba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:50.046766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a0354363-975e-475e-837d-7c00a375cba8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:50.046766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:50.046766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:50.046766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:50.046766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:50.046766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:50.046766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:50.046766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:50.046766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:50.046766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:50.046766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:50.046766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:50.046766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:50.046766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:50.046766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:50.046766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:50.047853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:50.047853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:50.047853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:50.047853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:50.047853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:50.047853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:50.047853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:50.047853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:50.047853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:50.047853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:50.047853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:50.047853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:50.047853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:50.047853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:50.047853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:50.047853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:50.048825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:50.048825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:50.048825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:50.048825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:50.048825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:50.048825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:50.048825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:50.048825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:50.048825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:50.048825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:50.048825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:50.048825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:50.048825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 149/285] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:50.048825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0354363-975e-475e-837d-7c00a375cba8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:50.068688 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92741746-2e16-4627-abdc-61568b131ccd None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:50.116961 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28626da0-f657-4654-8945-c682c00ac821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:50.116961 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28626da0-f657-4654-8945-c682c00ac821 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:50.116961 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28626da0-f657-4654-8945-c682c00ac821 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:50.116961 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28626da0-f657-4654-8945-c682c00ac821 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:50.117741 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28626da0-f657-4654-8945-c682c00ac821 None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:50.118025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28626da0-f657-4654-8945-c682c00ac821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:50.121140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28626da0-f657-4654-8945-c682c00ac821 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:50.129110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 137/286] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:50.132662 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28626da0-f657-4654-8945-c682c00ac821 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:50.135763 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:50.186933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0354363-975e-475e-837d-7c00a375cba8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:50.244867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2ad07-3cc4-4899-97c9-3ace85dc8b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:50.245764 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2ad07-3cc4-4899-97c9-3ace85dc8b5c None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:50.246039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2ad07-3cc4-4899-97c9-3ace85dc8b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:50.246310 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2ad07-3cc4-4899-97c9-3ace85dc8b5c None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb/users/b6d6c44f831c4e8c8c399c44bd133be2/roles/eb94b5e764af483db56184d52333f6da` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:50.248368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2ad07-3cc4-4899-97c9-3ace85dc8b5c None admin] RBAC: Authorizing `identity:create_grant(project_id=5a14beb3e8e643bca9af26f2ac0062bb, user_id=b6d6c44f831c4e8c8c399c44bd133be2, role_id=eb94b5e764af483db56184d52333f6da)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:50.249846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2ad07-3cc4-4899-97c9-3ace85dc8b5c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:50.255573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:50.267076 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 150/287] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:17:50 2022] PUT /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb/users/b6d6c44f831c4e8c8c399c44bd133be2/roles/eb94b5e764af483db56184d52333f6da => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:17:50.268796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2ad07-3cc4-4899-97c9-3ace85dc8b5c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:50.270705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28626da0-f657-4654-8945-c682c00ac821 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:50.310038 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814031b3-de01-494a-be8e-99c54e9c8470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:50.310910 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814031b3-de01-494a-be8e-99c54e9c8470 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:50.311289 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814031b3-de01-494a-be8e-99c54e9c8470 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:50.311659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814031b3-de01-494a-be8e-99c54e9c8470 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:50.312610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814031b3-de01-494a-be8e-99c54e9c8470 None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:50.313013 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814031b3-de01-494a-be8e-99c54e9c8470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:50.314587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814031b3-de01-494a-be8e-99c54e9c8470 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:50.325291 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 138/288] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:50.331407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814031b3-de01-494a-be8e-99c54e9c8470 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:50.422017 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2ad07-3cc4-4899-97c9-3ace85dc8b5c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:50.447253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814031b3-de01-494a-be8e-99c54e9c8470 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:50.477102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:50.495597 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429e6c7-8a15-431a-abb0-45307ddbc42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:50.496608 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429e6c7-8a15-431a-abb0-45307ddbc42c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:50.496908 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429e6c7-8a15-431a-abb0-45307ddbc42c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:50.497361 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429e6c7-8a15-431a-abb0-45307ddbc42c None admin] PATH_INFO: `/v3/users/fd80457b9a6442669f83515a371fa5c2` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:50.498412 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9e539-8265-4078-b452-b54ad12977c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:50.498686 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429e6c7-8a15-431a-abb0-45307ddbc42c None admin] RBAC: Authorizing `identity:get_user(user_id=fd80457b9a6442669f83515a371fa5c2)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:50.499331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9e539-8265-4078-b452-b54ad12977c8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:50.499607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9e539-8265-4078-b452-b54ad12977c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:50.499876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9e539-8265-4078-b452-b54ad12977c8 None admin] PATH_INFO: `/v3/users/9812b1bafb504dedab62db80afb3a7bf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:50.501244 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429e6c7-8a15-431a-abb0-45307ddbc42c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:50.504869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 139/289] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:50 2022] GET /identity/v3/users/fd80457b9a6442669f83515a371fa5c2 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:50.510863 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429e6c7-8a15-431a-abb0-45307ddbc42c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:50.521527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9e539-8265-4078-b452-b54ad12977c8 None admin] RBAC: Authorizing `identity:get_user(user_id=9812b1bafb504dedab62db80afb3a7bf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:50.523553 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9e539-8265-4078-b452-b54ad12977c8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:50.527154 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 151/290] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:50 2022] GET /identity/v3/users/9812b1bafb504dedab62db80afb3a7bf => generated 293 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:50.533564 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9e539-8265-4078-b452-b54ad12977c8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:50.539676 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:50.633980 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429e6c7-8a15-431a-abb0-45307ddbc42c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:50.667574 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9e539-8265-4078-b452-b54ad12977c8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:50.670406 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb19de5-8563-4959-8097-3b163a82b6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:50.671094 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb19de5-8563-4959-8097-3b163a82b6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:50.671378 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb19de5-8563-4959-8097-3b163a82b6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:50.671696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb19de5-8563-4959-8097-3b163a82b6e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:50.740315 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fac60d-5142-4429-acc9-eabc3f0188e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:50.740970 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fac60d-5142-4429-acc9-eabc3f0188e6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:50.741244 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fac60d-5142-4429-acc9-eabc3f0188e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:50.741511 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fac60d-5142-4429-acc9-eabc3f0188e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:50.742334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fac60d-5142-4429-acc9-eabc3f0188e6 None admin] RBAC: Adding query filter params (role.id=61c33763c453452d82531c56aeb67287, user.id=9812b1bafb504dedab62db80afb3a7bf, scope.system=all) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:50.742635 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fac60d-5142-4429-acc9-eabc3f0188e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:50.745353 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fac60d-5142-4429-acc9-eabc3f0188e6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:50.762975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 152/291] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Jul 19 12:17:50 2022] GET /identity/v3/role_assignments?user.id=9812b1bafb504dedab62db80afb3a7bf&scope.system=all&role.id=61c33763c453452d82531c56aeb67287 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:50.796773 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb19de5-8563-4959-8097-3b163a82b6e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:50.798323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb19de5-8563-4959-8097-3b163a82b6e3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:50.825942 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:50.954144 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 140/292] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 12:17:50.960808 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fac60d-5142-4429-acc9-eabc3f0188e6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:51.032032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:51.099731 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fac60d-5142-4429-acc9-eabc3f0188e6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:51.136006 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab7765-617b-4c52-832e-e2cf02caa044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:51.136869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab7765-617b-4c52-832e-e2cf02caa044 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:51.137147 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab7765-617b-4c52-832e-e2cf02caa044 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:51.137415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab7765-617b-4c52-832e-e2cf02caa044 None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:51.138941 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab7765-617b-4c52-832e-e2cf02caa044 None admin] RBAC: Authorizing `identity:get_project(project_id=5a14beb3e8e643bca9af26f2ac0062bb)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:51.140375 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab7765-617b-4c52-832e-e2cf02caa044 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:51.142378 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 153/293] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:50 2022] GET /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:51.148741 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb19de5-8563-4959-8097-3b163a82b6e3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:51.319508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb19de5-8563-4959-8097-3b163a82b6e3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:51.348592 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:51.370906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f78be-f7a3-4f88-90f8-2b4dec5e6201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:51.371573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f78be-f7a3-4f88-90f8-2b4dec5e6201 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:51.371854 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f78be-f7a3-4f88-90f8-2b4dec5e6201 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:51.372127 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f78be-f7a3-4f88-90f8-2b4dec5e6201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:51.372967 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f78be-f7a3-4f88-90f8-2b4dec5e6201 None admin] RBAC: Adding query filter params (role.id=61c33763c453452d82531c56aeb67287, scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb, user.id=fd80457b9a6442669f83515a371fa5c2) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:51.373277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f78be-f7a3-4f88-90f8-2b4dec5e6201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:51.374752 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f78be-f7a3-4f88-90f8-2b4dec5e6201 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:51.383204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 141/294] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:17:51 2022] GET /identity/v3/role_assignments?user.id=fd80457b9a6442669f83515a371fa5c2&scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb&role.id=61c33763c453452d82531c56aeb67287 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:52.317310 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7bbcd-6329-4245-8322-cbfa561ee78d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:52.317852 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7bbcd-6329-4245-8322-cbfa561ee78d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:52.317852 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7bbcd-6329-4245-8322-cbfa561ee78d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:52.319507 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 154/295] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:52.324869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a54dcc-8c8d-4665-8f56-64a58307c5ae None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:52.325252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a54dcc-8c8d-4665-8f56-64a58307c5ae None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:52.325428 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a54dcc-8c8d-4665-8f56-64a58307c5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:52.342995 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b9a54dcc-8c8d-4665-8f56-64a58307c5ae None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:52.344203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b9a54dcc-8c8d-4665-8f56-64a58307c5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:52.414963 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 142/296] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:52.437847 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7bbcd-6329-4245-8322-cbfa561ee78d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:52.463341 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75702a-652b-4c72-a865-8ed75aa4091a None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:52.463641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75702a-652b-4c72-a865-8ed75aa4091a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:52.463900 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75702a-652b-4c72-a865-8ed75aa4091a None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:52.465268 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 143/297] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:17:52.470291 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c6e59-a778-46c4-ac4c-01d052dda71e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:52.470578 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c6e59-a778-46c4-ac4c-01d052dda71e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:52.470900 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c6e59-a778-46c4-ac4c-01d052dda71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:52.488104 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4e2c6e59-a778-46c4-ac4c-01d052dda71e None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:52.489279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4e2c6e59-a778-46c4-ac4c-01d052dda71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:52.556312 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7bbcd-6329-4245-8322-cbfa561ee78d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:52.574908 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 144/298] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:17:52.575222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:52.599813 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c6e59-a778-46c4-ac4c-01d052dda71e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:52.606651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba62ac7-89bc-4801-8705-efe9bc8b8633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:52.608268 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba62ac7-89bc-4801-8705-efe9bc8b8633 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:52.608772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba62ac7-89bc-4801-8705-efe9bc8b8633 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:52.609250 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba62ac7-89bc-4801-8705-efe9bc8b8633 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:52.611127 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba62ac7-89bc-4801-8705-efe9bc8b8633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:52.614115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba62ac7-89bc-4801-8705-efe9bc8b8633 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:52.617377 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 155/299] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:17:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:52.622119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba62ac7-89bc-4801-8705-efe9bc8b8633 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:52.649641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:52.727558 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c6e59-a778-46c4-ac4c-01d052dda71e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:52.738218 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba62ac7-89bc-4801-8705-efe9bc8b8633 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:52.766993 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f60c2-1cf7-4036-873f-7055de99f507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:52.768272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f60c2-1cf7-4036-873f-7055de99f507 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:52.768735 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f60c2-1cf7-4036-873f-7055de99f507 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:52.769307 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f60c2-1cf7-4036-873f-7055de99f507 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:52.774155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c6e83-0ac8-4a38-abc0-a7b55319d8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:52.775190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c6e83-0ac8-4a38-abc0-a7b55319d8c7 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:52.775476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c6e83-0ac8-4a38-abc0-a7b55319d8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:52.775748 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c6e83-0ac8-4a38-abc0-a7b55319d8c7 None admin] PATH_INFO: `/v3/groups` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:52.776435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c6e83-0ac8-4a38-abc0-a7b55319d8c7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:52.778034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c6e83-0ac8-4a38-abc0-a7b55319d8c7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:52.781662 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f60c2-1cf7-4036-873f-7055de99f507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:52.791216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-987f60c2-1cf7-4036-873f-7055de99f507 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 12:17:52.791216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:52.791216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:52.791216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:52.791216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:52.791216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:52.791216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:52.791216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:52.791216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:52.791216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:52.791216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:52.791216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:52.791216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:52.791216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:52.791216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:52.791216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:52.792458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:52.792458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:52.792458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:52.792458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:52.792458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:52.792458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:52.792458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:52.792458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:52.792458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:52.792458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:52.792458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:52.792458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:52.792458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:52.792458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:52.792458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:52.792458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:52.793245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:52.793245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:52.793245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:52.793245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:52.793245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:52.793245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:52.793245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:52.793245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:52.793245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:52.793245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:52.793245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 12:17:52.793245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:17:52.795805 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 145/300] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:17:52.795909 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 156/301] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Jul 19 12:17:52 2022] POST /identity/v3/groups => generated 229 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:17:52.804947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c6e83-0ac8-4a38-abc0-a7b55319d8c7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:52.850496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:52.895066 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc4b33-c9e7-456f-845b-721e4a0e6c8e None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:52.895390 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc4b33-c9e7-456f-845b-721e4a0e6c8e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:52.895624 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc4b33-c9e7-456f-845b-721e4a0e6c8e None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:52.897331 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 146/302] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:52.902944 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf6fe0-7629-4230-868c-b9c8c615cab0 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:52.903270 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf6fe0-7629-4230-868c-b9c8c615cab0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:52.903499 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf6fe0-7629-4230-868c-b9c8c615cab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:52.926436 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8cdf6fe0-7629-4230-868c-b9c8c615cab0 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:52.926627 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c6e83-0ac8-4a38-abc0-a7b55319d8c7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:52.927700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8cdf6fe0-7629-4230-868c-b9c8c615cab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:52.968385 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fef8e-7e92-4b6c-b297-132c92c9ff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:52.969058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fef8e-7e92-4b6c-b297-132c92c9ff74 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:52.969340 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fef8e-7e92-4b6c-b297-132c92c9ff74 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:52.969618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fef8e-7e92-4b6c-b297-132c92c9ff74 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:52.970365 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fef8e-7e92-4b6c-b297-132c92c9ff74 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:52.970671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fef8e-7e92-4b6c-b297-132c92c9ff74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:52.972728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fef8e-7e92-4b6c-b297-132c92c9ff74 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:52.984898 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 157/303] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:52.992040 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fef8e-7e92-4b6c-b297-132c92c9ff74 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:53.025223 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 147/304] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:53.050199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf6fe0-7629-4230-868c-b9c8c615cab0 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:53.084788 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:53.102720 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:53.106183 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fef8e-7e92-4b6c-b297-132c92c9ff74 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:53.141190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6ee0e-4813-4d26-bbae-7293aa560d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:53.142068 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6ee0e-4813-4d26-bbae-7293aa560d5d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:53.142348 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6ee0e-4813-4d26-bbae-7293aa560d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:53.142619 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6ee0e-4813-4d26-bbae-7293aa560d5d None admin] PATH_INFO: `/v3/users/1ab651d081204015a22e74cb17f56edc` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:53.156475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6ee0e-4813-4d26-bbae-7293aa560d5d None admin] RBAC: Authorizing `identity:get_user(user_id=1ab651d081204015a22e74cb17f56edc)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:53.157925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6ee0e-4813-4d26-bbae-7293aa560d5d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:53.160281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 158/305] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:52 2022] GET /identity/v3/users/1ab651d081204015a22e74cb17f56edc => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:53.161335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376f78f-d830-4957-bec2-c2cc1f8c3175 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:53.161615 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376f78f-d830-4957-bec2-c2cc1f8c3175 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:53.161887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376f78f-d830-4957-bec2-c2cc1f8c3175 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:53.167033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 159/306] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:53.167802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376f78f-d830-4957-bec2-c2cc1f8c3175 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:53.168785 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf6fe0-7629-4230-868c-b9c8c615cab0 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:53.209618 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b3bdd-8e41-4703-8974-6c8afa6dd160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:53.210423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b3bdd-8e41-4703-8974-6c8afa6dd160 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:53.210700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b3bdd-8e41-4703-8974-6c8afa6dd160 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:53.211000 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b3bdd-8e41-4703-8974-6c8afa6dd160 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:53.222487 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b3bdd-8e41-4703-8974-6c8afa6dd160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:53.230246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-6c8b3bdd-8e41-4703-8974-6c8afa6dd160 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 12:17:53.230246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:53.230246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:53.230246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:53.230246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:53.230246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:53.230246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:53.230246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:53.230246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:53.230246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:53.230246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:53.230246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:53.230246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:53.230246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:53.230246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:53.230246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:53.231138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:53.231138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:53.231138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:53.231138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:53.231138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:53.231138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:53.231138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:53.231138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:53.231138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:53.231138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:53.231138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:53.231138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:53.231138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:53.231138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:53.231138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:53.231138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:53.231892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:53.231892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:53.231892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:53.231892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:53.231892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:53.231892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:53.231892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:53.231892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:53.231892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:53.231892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:53.231892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 12:17:53.231892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:17:53.231892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 148/307] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:17:53.233177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a0156-6778-43b1-867d-7403b6c26b11 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:53.233177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a0156-6778-43b1-867d-7403b6c26b11 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:53.233177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a0156-6778-43b1-867d-7403b6c26b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:53.250596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-832a0156-6778-43b1-867d-7403b6c26b11 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:53.251948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-832a0156-6778-43b1-867d-7403b6c26b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:53.285949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376f78f-d830-4957-bec2-c2cc1f8c3175 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:53.328841 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 149/308] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:53.328841 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a0156-6778-43b1-867d-7403b6c26b11 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:53.329414 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ef113-d101-43af-b867-2a31a9e37381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:53.329414 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ef113-d101-43af-b867-2a31a9e37381 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:53.329414 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ef113-d101-43af-b867-2a31a9e37381 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:53.329414 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ef113-d101-43af-b867-2a31a9e37381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:53.329978 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ef113-d101-43af-b867-2a31a9e37381 None admin] RBAC: Adding query filter params (role.id=eb94b5e764af483db56184d52333f6da, user.id=1ab651d081204015a22e74cb17f56edc, scope.system=all) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:53.329978 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ef113-d101-43af-b867-2a31a9e37381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:53.329978 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ef113-d101-43af-b867-2a31a9e37381 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:53.334687 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 160/309] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Jul 19 12:17:53 2022] GET /identity/v3/role_assignments?user.id=1ab651d081204015a22e74cb17f56edc&scope.system=all&role.id=eb94b5e764af483db56184d52333f6da => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:53.347926 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ef113-d101-43af-b867-2a31a9e37381 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:53.368401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:53.380745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:53.472705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a0156-6778-43b1-867d-7403b6c26b11 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:53.478171 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ef113-d101-43af-b867-2a31a9e37381 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:53.514600 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f15758-5382-49c3-b51a-4c7fb6f4d28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:53.515630 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f15758-5382-49c3-b51a-4c7fb6f4d28c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:53.516016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f15758-5382-49c3-b51a-4c7fb6f4d28c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:53.516391 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f15758-5382-49c3-b51a-4c7fb6f4d28c None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:53.517247 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f15758-5382-49c3-b51a-4c7fb6f4d28c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:53.517353 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49a045-a735-4d1b-9e8f-a7b4f193fb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:53.517553 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f15758-5382-49c3-b51a-4c7fb6f4d28c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:53.518222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49a045-a735-4d1b-9e8f-a7b4f193fb59 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:53.518502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49a045-a735-4d1b-9e8f-a7b4f193fb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:53.518939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49a045-a735-4d1b-9e8f-a7b4f193fb59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:53.519105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f15758-5382-49c3-b51a-4c7fb6f4d28c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:53.530259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 150/310] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:53.535412 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49a045-a735-4d1b-9e8f-a7b4f193fb59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:53.535806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f15758-5382-49c3-b51a-4c7fb6f4d28c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:53.543554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8c49a045-a735-4d1b-9e8f-a7b4f193fb59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:53.543554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:53.543554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:53.543554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:53.543554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:53.543554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:53.543554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:53.543554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:53.543554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:53.543554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:53.543554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:53.543554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:53.543554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:53.543554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:53.543554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:53.543554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:53.544512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:53.544512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:53.544512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:53.544512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:53.544512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:53.544512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:53.544512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:53.544512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:53.544512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:53.544512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:53.544512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:53.544512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:53.544512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:53.544512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:53.544512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:53.544512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:53.545680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:53.545680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:53.545680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:53.545680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:53.545680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:53.545680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:53.545680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:53.545680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:53.545680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:53.545680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:53.545680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:53.545680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:53.545680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 161/311] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:17:53.551738 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49a045-a735-4d1b-9e8f-a7b4f193fb59 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:53.637235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:53.659550 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f15758-5382-49c3-b51a-4c7fb6f4d28c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:53.664522 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:53.691050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49a045-a735-4d1b-9e8f-a7b4f193fb59 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:53.706264 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8c509-0eb8-41de-83f0-16947334d6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:53.707814 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8c509-0eb8-41de-83f0-16947334d6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:53.708507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8c509-0eb8-41de-83f0-16947334d6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:53.708948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8c509-0eb8-41de-83f0-16947334d6b0 None admin] PATH_INFO: `/v3/users/b6d6c44f831c4e8c8c399c44bd133be2` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:53.710524 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8c509-0eb8-41de-83f0-16947334d6b0 None admin] RBAC: Authorizing `identity:get_user(user_id=b6d6c44f831c4e8c8c399c44bd133be2)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:53.712760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8c509-0eb8-41de-83f0-16947334d6b0 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:53.719693 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 151/312] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:53 2022] GET /identity/v3/users/b6d6c44f831c4e8c8c399c44bd133be2 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:53.721493 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8c509-0eb8-41de-83f0-16947334d6b0 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:53.734422 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b7874-b0d4-4b5e-9126-20a29ab6a176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:53.735127 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b7874-b0d4-4b5e-9126-20a29ab6a176 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:53.735407 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b7874-b0d4-4b5e-9126-20a29ab6a176 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:53.735680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b7874-b0d4-4b5e-9126-20a29ab6a176 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:53.736422 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b7874-b0d4-4b5e-9126-20a29ab6a176 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:53.737571 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b7874-b0d4-4b5e-9126-20a29ab6a176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:53.738619 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b7874-b0d4-4b5e-9126-20a29ab6a176 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:53.747804 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 162/313] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:53.753902 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b7874-b0d4-4b5e-9126-20a29ab6a176 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:53.851325 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8c509-0eb8-41de-83f0-16947334d6b0 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:53.862341 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b7874-b0d4-4b5e-9126-20a29ab6a176 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:53.894369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1913252-7d69-4623-8790-d65dbe58a8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:53.895602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1913252-7d69-4623-8790-d65dbe58a8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:53.896500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1913252-7d69-4623-8790-d65dbe58a8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:53.896970 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1913252-7d69-4623-8790-d65dbe58a8c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:53.904756 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e142411-9147-4f7f-b513-c05695b6d531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:53.905818 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e142411-9147-4f7f-b513-c05695b6d531 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:53.906238 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e142411-9147-4f7f-b513-c05695b6d531 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:53.906647 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e142411-9147-4f7f-b513-c05695b6d531 None admin] PATH_INFO: `/v3/users/9812b1bafb504dedab62db80afb3a7bf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:53.908494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e142411-9147-4f7f-b513-c05695b6d531 None admin] RBAC: Authorizing `identity:get_user(user_id=9812b1bafb504dedab62db80afb3a7bf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:53.910698 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e142411-9147-4f7f-b513-c05695b6d531 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:53.913378 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 163/314] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:53 2022] GET /identity/v3/users/9812b1bafb504dedab62db80afb3a7bf => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:53.919175 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e142411-9147-4f7f-b513-c05695b6d531 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:53.928380 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:53.940451 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:53.993625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1913252-7d69-4623-8790-d65dbe58a8c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:53.995395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1913252-7d69-4623-8790-d65dbe58a8c1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:54.055233 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e142411-9147-4f7f-b513-c05695b6d531 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:54.100271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38f5cc-d124-4927-a63b-b87f4a4bdd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:54.101143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38f5cc-d124-4927-a63b-b87f4a4bdd31 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:54.101421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38f5cc-d124-4927-a63b-b87f4a4bdd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:54.101696 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38f5cc-d124-4927-a63b-b87f4a4bdd31 None admin] PATH_INFO: `/v3/system/users/9812b1bafb504dedab62db80afb3a7bf/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:54.103356 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38f5cc-d124-4927-a63b-b87f4a4bdd31 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9812b1bafb504dedab62db80afb3a7bf, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:54.104730 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38f5cc-d124-4927-a63b-b87f4a4bdd31 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:54.117715 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 164/315] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Jul 19 12:17:53 2022] PUT /identity/v3/system/users/9812b1bafb504dedab62db80afb3a7bf/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:17:54.119068 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 152/316] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:17:54.125052 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38f5cc-d124-4927-a63b-b87f4a4bdd31 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:54.222355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:54.249356 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38f5cc-d124-4927-a63b-b87f4a4bdd31 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:54.287634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a63fb-52b9-4845-9ea3-6fcfe1f865c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:54.288519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a63fb-52b9-4845-9ea3-6fcfe1f865c1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:54.288835 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a63fb-52b9-4845-9ea3-6fcfe1f865c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:54.289118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a63fb-52b9-4845-9ea3-6fcfe1f865c1 None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:54.290324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a63fb-52b9-4845-9ea3-6fcfe1f865c1 None admin] RBAC: Authorizing `identity:get_project(project_id=5a14beb3e8e643bca9af26f2ac0062bb)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:54.291810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a63fb-52b9-4845-9ea3-6fcfe1f865c1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:54.293874 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 165/317] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:54 2022] GET /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:54.300370 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1913252-7d69-4623-8790-d65dbe58a8c1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:54.359537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:54.410300 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1913252-7d69-4623-8790-d65dbe58a8c1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:54.447319 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc15c3-c687-4c51-9a7b-66e0c51f70e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:54.448283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc15c3-c687-4c51-9a7b-66e0c51f70e9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:54.448745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc15c3-c687-4c51-9a7b-66e0c51f70e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:54.449269 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc15c3-c687-4c51-9a7b-66e0c51f70e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:54.450300 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc15c3-c687-4c51-9a7b-66e0c51f70e9 None admin] RBAC: Adding query filter params (role.id=eb94b5e764af483db56184d52333f6da, scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb, user.id=b6d6c44f831c4e8c8c399c44bd133be2) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:54.450832 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc15c3-c687-4c51-9a7b-66e0c51f70e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:54.452507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc15c3-c687-4c51-9a7b-66e0c51f70e9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:54.460338 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 153/318] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:17:54 2022] GET /identity/v3/role_assignments?user.id=b6d6c44f831c4e8c8c399c44bd133be2&scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb&role.id=eb94b5e764af483db56184d52333f6da => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:55.060853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7792a7-3978-4635-930a-615de43a7dab None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:55.061331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7792a7-3978-4635-930a-615de43a7dab None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:55.061331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7792a7-3978-4635-930a-615de43a7dab None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:55.062755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 166/319] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:55.068037 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee7615-b4bb-4953-97f2-4846ac5edb8e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:55.068330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee7615-b4bb-4953-97f2-4846ac5edb8e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:55.068605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee7615-b4bb-4953-97f2-4846ac5edb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:55.086052 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-cdee7615-b4bb-4953-97f2-4846ac5edb8e None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:55.087289 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cdee7615-b4bb-4953-97f2-4846ac5edb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:55.154648 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 154/320] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:55.177842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7792a7-3978-4635-930a-615de43a7dab None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:55.293433 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7792a7-3978-4635-930a-615de43a7dab None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:55.327823 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d872f-4068-47e0-bf39-a8fe8bb34dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:55.328540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d872f-4068-47e0-bf39-a8fe8bb34dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:55.328824 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d872f-4068-47e0-bf39-a8fe8bb34dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:55.329094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d872f-4068-47e0-bf39-a8fe8bb34dc9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:55.330270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d872f-4068-47e0-bf39-a8fe8bb34dc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:55.332557 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d872f-4068-47e0-bf39-a8fe8bb34dc9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:55.334178 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 167/321] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:17:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:55.339856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee7615-b4bb-4953-97f2-4846ac5edb8e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:55.389848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:55.396924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89b29c-be39-436e-bb6c-a3df99cfed75 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:55.397206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89b29c-be39-436e-bb6c-a3df99cfed75 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:55.397477 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89b29c-be39-436e-bb6c-a3df99cfed75 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:55.399485 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 168/322] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:17:55.404103 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b9075-e45d-4762-ac2b-d178e3a88c3e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:55.404399 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b9075-e45d-4762-ac2b-d178e3a88c3e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:55.404654 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b9075-e45d-4762-ac2b-d178e3a88c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:55.422604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ab6b9075-e45d-4762-ac2b-d178e3a88c3e None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:55.423808 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ab6b9075-e45d-4762-ac2b-d178e3a88c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:55.431806 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:55.458184 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee7615-b4bb-4953-97f2-4846ac5edb8e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:55.494685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 169/323] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:17:55.499118 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208d89b-37bc-406b-8a59-ff2507749cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:55.499878 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d89b-37bc-406b-8a59-ff2507749cff None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:55.500229 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d89b-37bc-406b-8a59-ff2507749cff None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:55.500514 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d89b-37bc-406b-8a59-ff2507749cff None admin] PATH_INFO: `/v3/groups` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:55.501216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208d89b-37bc-406b-8a59-ff2507749cff None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:55.503180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208d89b-37bc-406b-8a59-ff2507749cff None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:55.517450 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b9075-e45d-4762-ac2b-d178e3a88c3e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:55.520295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 155/324] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Jul 19 12:17:55 2022] POST /identity/v3/groups => generated 226 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:17:55.632389 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b9075-e45d-4762-ac2b-d178e3a88c3e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:55.669767 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d032f2c-6263-4d5f-b0ea-c796931412b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:55.670569 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d032f2c-6263-4d5f-b0ea-c796931412b7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:55.670879 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d032f2c-6263-4d5f-b0ea-c796931412b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:55.671155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d032f2c-6263-4d5f-b0ea-c796931412b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:55.682721 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d032f2c-6263-4d5f-b0ea-c796931412b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:55.691951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6d032f2c-6263-4d5f-b0ea-c796931412b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 12:17:55.691951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:55.691951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:55.691951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:55.691951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:55.691951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:55.691951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:55.691951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:55.691951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:55.691951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:55.691951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:55.691951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:55.691951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:55.691951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:55.691951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:55.691951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:55.693039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:55.693039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:55.693039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:55.693039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:55.693039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:55.693039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:55.693039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:55.693039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:55.693039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:55.693039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:55.693039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:55.693039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:55.693039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:55.693039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:55.693039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:55.693039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:55.694232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:55.694232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:55.694232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:55.694232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:55.694232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:55.694232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:55.694232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:55.694232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:55.694232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:55.694232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:55.694232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 12:17:55.694232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:55.694232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 170/325] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:17:55.701001 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208d89b-37bc-406b-8a59-ff2507749cff None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:55.814860 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208d89b-37bc-406b-8a59-ff2507749cff None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:55.822260 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:55.857571 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5df431-3f64-4890-bf71-d665f7e12d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:55.858251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5df431-3f64-4890-bf71-d665f7e12d2e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:55.858536 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5df431-3f64-4890-bf71-d665f7e12d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:55.858842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5df431-3f64-4890-bf71-d665f7e12d2e None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:55.859659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5df431-3f64-4890-bf71-d665f7e12d2e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:55.859971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5df431-3f64-4890-bf71-d665f7e12d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:55.861407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5df431-3f64-4890-bf71-d665f7e12d2e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:55.870878 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 156/326] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:55.877169 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d032f2c-6263-4d5f-b0ea-c796931412b7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:55.880420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:55.993258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d032f2c-6263-4d5f-b0ea-c796931412b7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:56.030298 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327f503-8b62-4f96-8cf6-5b0c84cecff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:56.031224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327f503-8b62-4f96-8cf6-5b0c84cecff3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:56.031501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327f503-8b62-4f96-8cf6-5b0c84cecff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:56.031771 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327f503-8b62-4f96-8cf6-5b0c84cecff3 None admin] PATH_INFO: `/v3/users/1ab651d081204015a22e74cb17f56edc` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:56.032996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327f503-8b62-4f96-8cf6-5b0c84cecff3 None admin] RBAC: Authorizing `identity:get_user(user_id=1ab651d081204015a22e74cb17f56edc)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:56.034563 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327f503-8b62-4f96-8cf6-5b0c84cecff3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:56.036678 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 171/327] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:55 2022] GET /identity/v3/users/1ab651d081204015a22e74cb17f56edc => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:17:56.043189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5df431-3f64-4890-bf71-d665f7e12d2e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:56.153419 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5df431-3f64-4890-bf71-d665f7e12d2e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:56.194504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4c193-aa8e-4b9e-9878-8221b59d0790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:56.195466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4c193-aa8e-4b9e-9878-8221b59d0790 None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:56.195748 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4c193-aa8e-4b9e-9878-8221b59d0790 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:56.196027 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4c193-aa8e-4b9e-9878-8221b59d0790 None admin] PATH_INFO: `/v3/system/users/1ab651d081204015a22e74cb17f56edc/roles/eb94b5e764af483db56184d52333f6da` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:56.197557 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4c193-aa8e-4b9e-9878-8221b59d0790 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1ab651d081204015a22e74cb17f56edc, role_id=eb94b5e764af483db56184d52333f6da)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:56.198974 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4c193-aa8e-4b9e-9878-8221b59d0790 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:56.213005 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 157/328] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Jul 19 12:17:56 2022] PUT /identity/v3/system/users/1ab651d081204015a22e74cb17f56edc/roles/eb94b5e764af483db56184d52333f6da => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:17:56.307476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdff8a-a5b5-4eb0-805d-fd647aa84bfd None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:56.307959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdff8a-a5b5-4eb0-805d-fd647aa84bfd None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:56.307959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdff8a-a5b5-4eb0-805d-fd647aa84bfd None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:56.309697 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 172/329] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:56.315497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8b8d5-f4f5-4067-9c2a-f2205102cd55 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:56.316045 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8b8d5-f4f5-4067-9c2a-f2205102cd55 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:56.316639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8b8d5-f4f5-4067-9c2a-f2205102cd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:56.335526 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-00e8b8d5-f4f5-4067-9c2a-f2205102cd55 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:56.336766 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-00e8b8d5-f4f5-4067-9c2a-f2205102cd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:56.370369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:56.421756 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 158/330] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:56.446328 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdff8a-a5b5-4eb0-805d-fd647aa84bfd None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:56.539323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:56.581012 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdff8a-a5b5-4eb0-805d-fd647aa84bfd None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:56.626225 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f1d2e-5807-4675-9acf-2c104eb7d1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:56.627057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f1d2e-5807-4675-9acf-2c104eb7d1af None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:56.627333 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f1d2e-5807-4675-9acf-2c104eb7d1af None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:56.627630 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f1d2e-5807-4675-9acf-2c104eb7d1af None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:56.644575 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f1d2e-5807-4675-9acf-2c104eb7d1af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:56.652322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-3e6f1d2e-5807-4675-9acf-2c104eb7d1af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:56.652322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:56.652322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:56.652322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:56.652322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:56.652322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:56.652322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:56.652322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:56.652322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:56.652322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:56.652322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:56.652322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:56.652322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:56.652322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:56.652322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:56.652322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:56.653200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:56.653200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:56.653200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:56.653200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:56.653200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:56.653200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:56.653200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:56.653200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:56.653200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:56.653200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:56.653200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:56.653200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:56.653200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:56.653200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:56.653200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:56.653200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:56.653969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:56.653969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:56.653969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:56.653969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:56.653969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:56.653969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:56.653969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:56.653969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:56.653969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:56.653969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:56.653969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:56.653969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:56.653969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 173/331] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:56.659758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8b8d5-f4f5-4067-9c2a-f2205102cd55 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:56.776995 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8b8d5-f4f5-4067-9c2a-f2205102cd55 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:56.818951 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07968e-e328-4111-8bcd-c6aca51d6507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:56.819629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07968e-e328-4111-8bcd-c6aca51d6507 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:56.819904 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07968e-e328-4111-8bcd-c6aca51d6507 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:56.820170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07968e-e328-4111-8bcd-c6aca51d6507 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:56.820921 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07968e-e328-4111-8bcd-c6aca51d6507 None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:56.821219 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07968e-e328-4111-8bcd-c6aca51d6507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:56.822647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07968e-e328-4111-8bcd-c6aca51d6507 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:56.835530 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 159/332] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:56.841067 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f1d2e-5807-4675-9acf-2c104eb7d1af None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:56.954280 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f1d2e-5807-4675-9acf-2c104eb7d1af None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:56.985849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:56.993334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bf8e0-20b2-4dd8-829f-09ec76847fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:56.994267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bf8e0-20b2-4dd8-829f-09ec76847fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:56.994549 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bf8e0-20b2-4dd8-829f-09ec76847fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:56.994845 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bf8e0-20b2-4dd8-829f-09ec76847fd7 None admin] PATH_INFO: `/v3/users/9812b1bafb504dedab62db80afb3a7bf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:56.996060 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bf8e0-20b2-4dd8-829f-09ec76847fd7 None admin] RBAC: Authorizing `identity:get_user(user_id=9812b1bafb504dedab62db80afb3a7bf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:56.997488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bf8e0-20b2-4dd8-829f-09ec76847fd7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:56.999446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 174/333] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:17:56 2022] GET /identity/v3/users/9812b1bafb504dedab62db80afb3a7bf => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:57.005237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07968e-e328-4111-8bcd-c6aca51d6507 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:57.037257 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:57.130663 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07968e-e328-4111-8bcd-c6aca51d6507 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:57.170376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb134391-92f2-4387-be77-8b6e5dbac41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:57.171058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb134391-92f2-4387-be77-8b6e5dbac41c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:57.171339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb134391-92f2-4387-be77-8b6e5dbac41c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:57.171610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb134391-92f2-4387-be77-8b6e5dbac41c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:57.172441 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb134391-92f2-4387-be77-8b6e5dbac41c None admin] RBAC: Adding query filter params (role.id=61c33763c453452d82531c56aeb67287, user.id=9812b1bafb504dedab62db80afb3a7bf, scope.system=all) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:57.172753 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb134391-92f2-4387-be77-8b6e5dbac41c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:57.174179 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb134391-92f2-4387-be77-8b6e5dbac41c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:57.189574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 160/334] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Jul 19 12:17:57 2022] GET /identity/v3/role_assignments?user.id=9812b1bafb504dedab62db80afb3a7bf&scope.system=all&role.id=61c33763c453452d82531c56aeb67287 => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:58.055698 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c88bc-21c6-44a2-b037-c2a0eb77cc0c None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:58.056707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c88bc-21c6-44a2-b037-c2a0eb77cc0c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:58.057219 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c88bc-21c6-44a2-b037-c2a0eb77cc0c None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:58.059370 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 175/335] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:17:58.065612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20b501-fbee-455b-98ac-d245caf49e61 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:58.066561 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20b501-fbee-455b-98ac-d245caf49e61 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:58.067103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20b501-fbee-455b-98ac-d245caf49e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:58.089862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6d20b501-fbee-455b-98ac-d245caf49e61 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:58.091440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6d20b501-fbee-455b-98ac-d245caf49e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:58.180852 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 161/336] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:17:58.227121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c88bc-21c6-44a2-b037-c2a0eb77cc0c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:58.345519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c88bc-21c6-44a2-b037-c2a0eb77cc0c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:58.387736 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54360fa-8817-4fcb-b4d9-e7d6923cd930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:58.389146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54360fa-8817-4fcb-b4d9-e7d6923cd930 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:58.389754 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54360fa-8817-4fcb-b4d9-e7d6923cd930 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:58.390246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54360fa-8817-4fcb-b4d9-e7d6923cd930 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:58.407585 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54360fa-8817-4fcb-b4d9-e7d6923cd930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:58.415727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f54360fa-8817-4fcb-b4d9-e7d6923cd930 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:58.415727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:58.415727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:58.415727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:58.415727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:58.415727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:58.415727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:58.415727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:58.415727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:58.415727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:58.415727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:58.415727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:58.415727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:58.415727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:58.415727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:58.415727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:58.416573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:58.416573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:58.416573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:58.416573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:58.416573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:58.416573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:58.416573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:58.416573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:58.416573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:58.416573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:58.416573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:58.416573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:58.416573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:58.416573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:58.416573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:58.416573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:58.417388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:58.417388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:58.417388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:58.417388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:58.417388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:58.417388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:58.417388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:58.417388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:58.417388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:58.417388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:58.417388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:17:58.417388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:17:58.420065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 176/337] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:17:58.426307 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20b501-fbee-455b-98ac-d245caf49e61 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:58.441773 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:58.538492 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20b501-fbee-455b-98ac-d245caf49e61 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:58.578991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd15181-451c-492d-a9d1-829525f9977a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:58.579674 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd15181-451c-492d-a9d1-829525f9977a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:58.579958 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd15181-451c-492d-a9d1-829525f9977a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:58.580293 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd15181-451c-492d-a9d1-829525f9977a None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:58.581378 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd15181-451c-492d-a9d1-829525f9977a None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:58.581691 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd15181-451c-492d-a9d1-829525f9977a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:58.583093 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd15181-451c-492d-a9d1-829525f9977a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:58.593945 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 162/338] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:17:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:58.600337 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54360fa-8817-4fcb-b4d9-e7d6923cd930 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:58.676665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:58.732954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54360fa-8817-4fcb-b4d9-e7d6923cd930 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:58.784995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b6d81-7e58-4bd4-b3a8-0da5fcf7aee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:58.785755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b6d81-7e58-4bd4-b3a8-0da5fcf7aee0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:58.786038 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b6d81-7e58-4bd4-b3a8-0da5fcf7aee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:58.786313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b6d81-7e58-4bd4-b3a8-0da5fcf7aee0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:58.871570 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b6d81-7e58-4bd4-b3a8-0da5fcf7aee0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:58.872966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b6d81-7e58-4bd4-b3a8-0da5fcf7aee0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:58.942872 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:58.987275 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 177/339] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:17:58.992934 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd15181-451c-492d-a9d1-829525f9977a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:59.079356 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:59.108828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd15181-451c-492d-a9d1-829525f9977a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:59.150205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be67035-28d2-49ee-b25b-8bbcf40d7ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:59.151100 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be67035-28d2-49ee-b25b-8bbcf40d7ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:59.151384 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be67035-28d2-49ee-b25b-8bbcf40d7ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:59.151659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be67035-28d2-49ee-b25b-8bbcf40d7ca5 None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:59.155484 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be67035-28d2-49ee-b25b-8bbcf40d7ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=554f819c0ee841348da0445f933c4c69)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:59.156948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be67035-28d2-49ee-b25b-8bbcf40d7ca5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:59.159709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 163/340] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:17:58 2022] GET /identity/v3/projects/554f819c0ee841348da0445f933c4c69 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:59.165252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b6d81-7e58-4bd4-b3a8-0da5fcf7aee0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:59.227187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb31645-00d8-4693-a4a2-2853c80dee7a None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:59.227492 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb31645-00d8-4693-a4a2-2853c80dee7a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:59.227731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb31645-00d8-4693-a4a2-2853c80dee7a None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:59.229358 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 164/341] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:17:59.236636 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33641e83-e2b9-455a-a2b9-094d6f1b0864 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:59.237002 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33641e83-e2b9-455a-a2b9-094d6f1b0864 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:59.237254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33641e83-e2b9-455a-a2b9-094d6f1b0864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:59.257817 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-33641e83-e2b9-455a-a2b9-094d6f1b0864 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:59.259351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-33641e83-e2b9-455a-a2b9-094d6f1b0864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:59.307923 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b6d81-7e58-4bd4-b3a8-0da5fcf7aee0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:59.345945 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec76220-48d2-45f6-b1da-e8811416b40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:59.346917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec76220-48d2-45f6-b1da-e8811416b40c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:59.347196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec76220-48d2-45f6-b1da-e8811416b40c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:59.347469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec76220-48d2-45f6-b1da-e8811416b40c None admin] PATH_INFO: `/v3/groups/ee994d30d4784b6fa845b0b1db117752` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:59.354909 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec76220-48d2-45f6-b1da-e8811416b40c None admin] RBAC: Authorizing `identity:get_group(group_id=ee994d30d4784b6fa845b0b1db117752)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:59.356590 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec76220-48d2-45f6-b1da-e8811416b40c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:59.359408 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 178/342] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 19 12:17:59 2022] GET /identity/v3/groups/ee994d30d4784b6fa845b0b1db117752 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:59.365875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec76220-48d2-45f6-b1da-e8811416b40c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:59.377148 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 165/343] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:17:59.398385 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:59.451210 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33641e83-e2b9-455a-a2b9-094d6f1b0864 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:59.494351 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec76220-48d2-45f6-b1da-e8811416b40c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:59.535218 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b66f5-ebdd-4024-a092-01d942824ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:59.536009 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b66f5-ebdd-4024-a092-01d942824ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:59.536302 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b66f5-ebdd-4024-a092-01d942824ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:59.536699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b66f5-ebdd-4024-a092-01d942824ff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:59.537534 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b66f5-ebdd-4024-a092-01d942824ff1 None admin] RBAC: Adding query filter params (group.id=ee994d30d4784b6fa845b0b1db117752, role.id=61c33763c453452d82531c56aeb67287, scope.project.id=554f819c0ee841348da0445f933c4c69) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:59.537896 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b66f5-ebdd-4024-a092-01d942824ff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:59.540188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b66f5-ebdd-4024-a092-01d942824ff1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:59.548067 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 179/344] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 19 12:17:59 2022] GET /identity/v3/role_assignments?group.id=ee994d30d4784b6fa845b0b1db117752&scope.project.id=554f819c0ee841348da0445f933c4c69&role.id=61c33763c453452d82531c56aeb67287 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:59.585710 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:59.630537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33641e83-e2b9-455a-a2b9-094d6f1b0864 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:59.674980 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3393d5a-ffc3-41c1-afa5-804b23e2e983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:59.675850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3393d5a-ffc3-41c1-afa5-804b23e2e983 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:59.676139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3393d5a-ffc3-41c1-afa5-804b23e2e983 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:59.676415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3393d5a-ffc3-41c1-afa5-804b23e2e983 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:59.697002 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3393d5a-ffc3-41c1-afa5-804b23e2e983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:17:59.708985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-f3393d5a-ffc3-41c1-afa5-804b23e2e983 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:17:59.708985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:17:59.708985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:17:59.708985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:17:59.708985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:17:59.708985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:17:59.708985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:17:59.708985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:17:59.708985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:17:59.708985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:17:59.708985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:17:59.708985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:17:59.708985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:17:59.708985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:17:59.708985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:17:59.708985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:17:59.709891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:17:59.709891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:17:59.709891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:17:59.709891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:17:59.709891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:17:59.709891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:17:59.709891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:17:59.709891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:17:59.709891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:17:59.709891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:17:59.709891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:17:59.709891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:17:59.709891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:17:59.709891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:17:59.709891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:17:59.709891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:17:59.710677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:17:59.710677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:17:59.710677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:17:59.710677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:17:59.710677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:17:59.710677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:17:59.710677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:17:59.710677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:17:59.710677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:17:59.710677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:17:59.710677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:17:59.710677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:17:59.710677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 166/345] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:17:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:17:59.718252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b66f5-ebdd-4024-a092-01d942824ff1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:59.772212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cadcc5-3245-467e-b77f-81ab70a7e85f None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:59.772525 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cadcc5-3245-467e-b77f-81ab70a7e85f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:59.772772 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cadcc5-3245-467e-b77f-81ab70a7e85f None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:59.774411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 167/346] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:17:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:17:59.782363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d62ea1-c5ca-43fa-b465-53ebf0f1f6b9 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:59.782652 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d62ea1-c5ca-43fa-b465-53ebf0f1f6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:59.782950 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d62ea1-c5ca-43fa-b465-53ebf0f1f6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:59.809815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-46d62ea1-c5ca-43fa-b465-53ebf0f1f6b9 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:17:59.811145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-46d62ea1-c5ca-43fa-b465-53ebf0f1f6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:17:59.843381 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:17:59.855698 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b66f5-ebdd-4024-a092-01d942824ff1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:17:59.898313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f82142-20e3-4617-a799-8997086923e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:17:59.899474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f82142-20e3-4617-a799-8997086923e1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:17:59.900043 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f82142-20e3-4617-a799-8997086923e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:17:59.900509 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f82142-20e3-4617-a799-8997086923e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:17:59.901498 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f82142-20e3-4617-a799-8997086923e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:17:59.901994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f82142-20e3-4617-a799-8997086923e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:17:59.903639 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f82142-20e3-4617-a799-8997086923e1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:17:59.913723 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 180/347] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:17:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:17:59.918979 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f82142-20e3-4617-a799-8997086923e1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:17:59.920656 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 168/348] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:17:59.965465 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d62ea1-c5ca-43fa-b465-53ebf0f1f6b9 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:00.030323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f82142-20e3-4617-a799-8997086923e1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:00.054864 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:00.072870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d3c9a-9d10-47bf-828c-0099b9d13a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:00.074002 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d3c9a-9d10-47bf-828c-0099b9d13a45 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:00.074474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d3c9a-9d10-47bf-828c-0099b9d13a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:00.075041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d3c9a-9d10-47bf-828c-0099b9d13a45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:00.095208 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:00.105078 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d62ea1-c5ca-43fa-b465-53ebf0f1f6b9 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:00.148633 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c98f7-3405-433c-8492-3392bf31605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:00.149816 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c98f7-3405-433c-8492-3392bf31605d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:00.150289 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c98f7-3405-433c-8492-3392bf31605d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:00.151050 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c98f7-3405-433c-8492-3392bf31605d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:00.154076 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d3c9a-9d10-47bf-828c-0099b9d13a45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:00.155525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d3c9a-9d10-47bf-828c-0099b9d13a45 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:00.166260 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c98f7-3405-433c-8492-3392bf31605d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:00.177445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-712c98f7-3405-433c-8492-3392bf31605d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:18:00.177445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:00.177445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:00.177445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:00.177445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:00.177445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:00.177445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:00.177445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:00.177445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:00.177445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:00.177445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:00.177445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:00.177445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:00.177445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:00.177445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:00.177445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:00.178351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:00.178351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:00.178351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:00.178351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:00.178351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:00.178351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:00.178351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:00.178351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:00.178351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:00.178351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:00.178351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:00.178351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:00.178351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:00.178351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:00.178351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:00.178351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:00.179177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:00.179177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:00.179177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:00.179177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:00.179177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:00.179177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:00.179177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:00.179177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:00.179177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:00.179177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:00.179177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:18:00.179177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:00.180547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 169/349] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:17:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:00.181653 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b0ade-59ea-403a-8ac8-74f3bf515781 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:00.181933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b0ade-59ea-403a-8ac8-74f3bf515781 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:00.182202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b0ade-59ea-403a-8ac8-74f3bf515781 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:00.186868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 170/350] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:00.191107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c829f1-2de4-43c3-ab03-e5d513070f86 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:00.191386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c829f1-2de4-43c3-ab03-e5d513070f86 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:00.191663 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c829f1-2de4-43c3-ab03-e5d513070f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:00.212948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-46c829f1-2de4-43c3-ab03-e5d513070f86 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:00.214155 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-46c829f1-2de4-43c3-ab03-e5d513070f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:00.288461 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 171/351] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:00.289134 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c829f1-2de4-43c3-ab03-e5d513070f86 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:00.293914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 181/352] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:17:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:00.303797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d3c9a-9d10-47bf-828c-0099b9d13a45 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:00.366445 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:00.373202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:00.434974 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c829f1-2de4-43c3-ab03-e5d513070f86 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:00.436839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d3c9a-9d10-47bf-828c-0099b9d13a45 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:00.484987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0647f3b-7c8e-4a08-8ce9-66c5bc9769e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:00.485704 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0647f3b-7c8e-4a08-8ce9-66c5bc9769e6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:00.485987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0647f3b-7c8e-4a08-8ce9-66c5bc9769e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:00.486258 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0647f3b-7c8e-4a08-8ce9-66c5bc9769e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:00.487713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0647f3b-7c8e-4a08-8ce9-66c5bc9769e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:00.488015 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0647f3b-7c8e-4a08-8ce9-66c5bc9769e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:00.488543 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b505c-f711-40f1-ac5a-0b499b7a79e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:00.489654 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b505c-f711-40f1-ac5a-0b499b7a79e7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:00.489825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0647f3b-7c8e-4a08-8ce9-66c5bc9769e6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:00.490288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b505c-f711-40f1-ac5a-0b499b7a79e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:00.490778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b505c-f711-40f1-ac5a-0b499b7a79e7 None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:00.492971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b505c-f711-40f1-ac5a-0b499b7a79e7 None admin] RBAC: Authorizing `identity:get_project(project_id=554f819c0ee841348da0445f933c4c69)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:00.494604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b505c-f711-40f1-ac5a-0b499b7a79e7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:00.497425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 182/353] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:18:00 2022] GET /identity/v3/projects/554f819c0ee841348da0445f933c4c69 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:00.498394 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b505c-f711-40f1-ac5a-0b499b7a79e7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:00.502757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 172/354] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:18:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:00.504797 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0647f3b-7c8e-4a08-8ce9-66c5bc9769e6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:00.641964 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b505c-f711-40f1-ac5a-0b499b7a79e7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:00.663590 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:00.665536 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0647f3b-7c8e-4a08-8ce9-66c5bc9769e6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:00.683748 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:00.684779 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685a3e0-02b2-4ad1-8eb2-1fd40e006b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:00.685874 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685a3e0-02b2-4ad1-8eb2-1fd40e006b16 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:00.686359 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685a3e0-02b2-4ad1-8eb2-1fd40e006b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:00.688510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685a3e0-02b2-4ad1-8eb2-1fd40e006b16 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:00.706356 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685a3e0-02b2-4ad1-8eb2-1fd40e006b16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:00.716115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-c685a3e0-02b2-4ad1-8eb2-1fd40e006b16 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 12:18:00.716115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:00.716115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:00.716115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:00.716115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:00.716115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:00.716115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:00.716115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:00.716115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:00.716115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:00.716115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:00.716115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:00.716115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:00.716115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:00.716115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:00.716115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:00.717116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:00.717116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:00.717116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:00.717116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:00.717116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:00.717116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:00.717116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:00.717116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:00.717116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:00.717116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:00.717116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:00.717116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:00.717116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:00.717116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:00.717116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:00.717116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:00.718313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:00.718313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:00.718313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:00.718313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:00.718313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:00.718313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:00.718313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:00.718313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:00.718313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:00.718313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:00.718313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 12:18:00.718313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:00.718313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 183/355] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:00.719406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685a3e0-02b2-4ad1-8eb2-1fd40e006b16 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:00.723518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9c369-fa16-4db5-a605-3a6b21e15bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:00.724403 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9c369-fa16-4db5-a605-3a6b21e15bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:00.724686 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9c369-fa16-4db5-a605-3a6b21e15bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:00.725004 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9c369-fa16-4db5-a605-3a6b21e15bf5 None admin] PATH_INFO: `/v3/groups/ee994d30d4784b6fa845b0b1db117752` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:00.727894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9c369-fa16-4db5-a605-3a6b21e15bf5 None admin] RBAC: Authorizing `identity:get_group(group_id=ee994d30d4784b6fa845b0b1db117752)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:00.729367 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9c369-fa16-4db5-a605-3a6b21e15bf5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:00.731313 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 173/356] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 19 12:18:00 2022] GET /identity/v3/groups/ee994d30d4784b6fa845b0b1db117752 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:00.732089 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9c369-fa16-4db5-a605-3a6b21e15bf5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:00.842589 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685a3e0-02b2-4ad1-8eb2-1fd40e006b16 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:00.880107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704711a-5b7a-47e6-8577-06d70ae9c936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:00.880864 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704711a-5b7a-47e6-8577-06d70ae9c936 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:00.881251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704711a-5b7a-47e6-8577-06d70ae9c936 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:00.881539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704711a-5b7a-47e6-8577-06d70ae9c936 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:00.889087 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9c369-fa16-4db5-a605-3a6b21e15bf5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:00.935378 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b209ae4-3bb3-46e1-ab32-95af8ded8af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:00.936058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b209ae4-3bb3-46e1-ab32-95af8ded8af5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:00.936342 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b209ae4-3bb3-46e1-ab32-95af8ded8af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:00.936611 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b209ae4-3bb3-46e1-ab32-95af8ded8af5 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:00.938106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b209ae4-3bb3-46e1-ab32-95af8ded8af5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:00.938686 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b209ae4-3bb3-46e1-ab32-95af8ded8af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:00.940027 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:00.941631 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b209ae4-3bb3-46e1-ab32-95af8ded8af5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:00.953718 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 174/357] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:18:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:00.954563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b209ae4-3bb3-46e1-ab32-95af8ded8af5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:00.967214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704711a-5b7a-47e6-8577-06d70ae9c936 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:00.968907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704711a-5b7a-47e6-8577-06d70ae9c936 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:01.031551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:01.104506 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b209ae4-3bb3-46e1-ab32-95af8ded8af5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:01.104721 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 184/358] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:01.105959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfe8ff-0980-4ff6-ad81-8e5f2a99c6f0 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:01.106399 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfe8ff-0980-4ff6-ad81-8e5f2a99c6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:01.106680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfe8ff-0980-4ff6-ad81-8e5f2a99c6f0 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:01.108130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 185/359] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:01.109033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536787bd-4fbd-4d2f-8f96-52f42d5a5dd9 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:01.109310 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536787bd-4fbd-4d2f-8f96-52f42d5a5dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:01.109577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536787bd-4fbd-4d2f-8f96-52f42d5a5dd9 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:01.110771 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 186/360] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:01.111459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536787bd-4fbd-4d2f-8f96-52f42d5a5dd9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:01.153555 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7153853-e9e6-4423-a0d9-72878fb91f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:01.154828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7153853-e9e6-4423-a0d9-72878fb91f55 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:01.156181 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7153853-e9e6-4423-a0d9-72878fb91f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:01.156616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7153853-e9e6-4423-a0d9-72878fb91f55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:01.157612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7153853-e9e6-4423-a0d9-72878fb91f55 None admin] RBAC: Adding query filter params (group.id=ee994d30d4784b6fa845b0b1db117752, role.id=b929adc09fcc41daaf5cf39de856c1b6, scope.project.id=554f819c0ee841348da0445f933c4c69) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:01.158081 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7153853-e9e6-4423-a0d9-72878fb91f55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:01.160502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7153853-e9e6-4423-a0d9-72878fb91f55 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:01.166973 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 175/361] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 19 12:18:00 2022] GET /identity/v3/role_assignments?group.id=ee994d30d4784b6fa845b0b1db117752&scope.project.id=554f819c0ee841348da0445f933c4c69&role.id=b929adc09fcc41daaf5cf39de856c1b6 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:01.168118 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7153853-e9e6-4423-a0d9-72878fb91f55 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:01.206961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:01.234655 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536787bd-4fbd-4d2f-8f96-52f42d5a5dd9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:01.289681 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900d22b-dcd5-4a1a-bda2-c681d8d668b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:01.290600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900d22b-dcd5-4a1a-bda2-c681d8d668b3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:01.290937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900d22b-dcd5-4a1a-bda2-c681d8d668b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:01.291233 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900d22b-dcd5-4a1a-bda2-c681d8d668b3 None admin] PATH_INFO: `/v3/users/1ab651d081204015a22e74cb17f56edc` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:01.293335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900d22b-dcd5-4a1a-bda2-c681d8d668b3 None admin] RBAC: Authorizing `identity:get_user(user_id=1ab651d081204015a22e74cb17f56edc)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:01.295214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900d22b-dcd5-4a1a-bda2-c681d8d668b3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:01.297582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 187/362] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:18:01 2022] GET /identity/v3/users/1ab651d081204015a22e74cb17f56edc => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:01.301654 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd0a75-dcce-4b1c-8f7b-51c39371e1fe None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:01.301654 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd0a75-dcce-4b1c-8f7b-51c39371e1fe None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:01.301654 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd0a75-dcce-4b1c-8f7b-51c39371e1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:01.314614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7153853-e9e6-4423-a0d9-72878fb91f55 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:01.326079 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-badd0a75-dcce-4b1c-8f7b-51c39371e1fe None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:01.327738 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-badd0a75-dcce-4b1c-8f7b-51c39371e1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:01.333815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:01.374761 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfefd4-d51a-4c77-8a53-bbc944b6e48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:01.374761 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfefd4-d51a-4c77-8a53-bbc944b6e48a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:01.374761 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfefd4-d51a-4c77-8a53-bbc944b6e48a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:01.374761 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfefd4-d51a-4c77-8a53-bbc944b6e48a None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:01.375176 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfefd4-d51a-4c77-8a53-bbc944b6e48a None admin] RBAC: Authorizing `identity:get_project(project_id=5a14beb3e8e643bca9af26f2ac0062bb)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:01.377013 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfefd4-d51a-4c77-8a53-bbc944b6e48a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:01.379162 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 176/363] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:18:01 2022] GET /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:01.380821 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311d5e6-f1ad-47db-b2b7-cc06bf6903b5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:01.381368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311d5e6-f1ad-47db-b2b7-cc06bf6903b5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:01.381644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311d5e6-f1ad-47db-b2b7-cc06bf6903b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:01.402758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6311d5e6-f1ad-47db-b2b7-cc06bf6903b5 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:01.404303 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6311d5e6-f1ad-47db-b2b7-cc06bf6903b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:01.426199 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 188/364] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:01.427238 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd0a75-dcce-4b1c-8f7b-51c39371e1fe None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:01.512460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 177/365] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:01.514992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311d5e6-f1ad-47db-b2b7-cc06bf6903b5 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:01.539040 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:01.574194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd0a75-dcce-4b1c-8f7b-51c39371e1fe None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:01.625576 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a7eac-0256-496d-b19a-19656118ea97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:01.626243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a7eac-0256-496d-b19a-19656118ea97 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:01.626531 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a7eac-0256-496d-b19a-19656118ea97 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:01.626847 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a7eac-0256-496d-b19a-19656118ea97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:01.628228 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a7eac-0256-496d-b19a-19656118ea97 None admin] RBAC: Adding query filter params (role.id=eb94b5e764af483db56184d52333f6da, user.id=1ab651d081204015a22e74cb17f56edc, scope.system=all) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:01.628542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a7eac-0256-496d-b19a-19656118ea97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:01.630564 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a7eac-0256-496d-b19a-19656118ea97 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:01.647281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 189/366] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Jul 19 12:18:01 2022] GET /identity/v3/role_assignments?user.id=1ab651d081204015a22e74cb17f56edc&scope.system=all&role.id=eb94b5e764af483db56184d52333f6da => generated 510 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:01.648136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a7eac-0256-496d-b19a-19656118ea97 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:01.649165 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311d5e6-f1ad-47db-b2b7-cc06bf6903b5 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:01.669614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:01.759619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd690b-0099-4f92-a4c9-8e132c5bd8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:01.760571 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd690b-0099-4f92-a4c9-8e132c5bd8ed None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:01.760859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd690b-0099-4f92-a4c9-8e132c5bd8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:01.761126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd690b-0099-4f92-a4c9-8e132c5bd8ed None admin] PATH_INFO: `/v3/groups/ee994d30d4784b6fa845b0b1db117752` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:01.762404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd690b-0099-4f92-a4c9-8e132c5bd8ed None admin] RBAC: Authorizing `identity:get_group(group_id=ee994d30d4784b6fa845b0b1db117752)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:01.764243 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd690b-0099-4f92-a4c9-8e132c5bd8ed None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:01.765830 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 178/367] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 19 12:18:01 2022] GET /identity/v3/groups/ee994d30d4784b6fa845b0b1db117752 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:01.766591 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd690b-0099-4f92-a4c9-8e132c5bd8ed None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:01.776410 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a7eac-0256-496d-b19a-19656118ea97 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:01.813796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:01.820911 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9b7d9-b1c0-42fb-9e18-8c898db30248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:01.821741 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9b7d9-b1c0-42fb-9e18-8c898db30248 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:01.822026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9b7d9-b1c0-42fb-9e18-8c898db30248 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:01.822306 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9b7d9-b1c0-42fb-9e18-8c898db30248 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:01.838868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9b7d9-b1c0-42fb-9e18-8c898db30248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:01.848113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ceb9b7d9-b1c0-42fb-9e18-8c898db30248 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:18:01.848113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:01.848113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:01.848113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:01.848113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:01.848113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:01.848113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:01.848113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:01.848113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:01.848113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:01.848113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:01.848113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:01.848113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:01.848113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:01.848113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:01.848113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:01.849119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:01.849119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:01.849119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:01.849119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:01.849119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:01.849119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:01.849119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:01.849119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:01.849119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:01.849119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:01.849119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:01.849119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:01.849119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:01.849119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:01.849119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:01.849119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:01.849894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:01.849894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:01.849894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:01.849894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:01.849894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:01.849894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:01.849894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:01.849894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:01.849894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:01.849894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:01.849894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:18:01.849894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:01.851300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 190/368] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:18:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:01.851300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9b7d9-b1c0-42fb-9e18-8c898db30248 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:01.973372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9b7d9-b1c0-42fb-9e18-8c898db30248 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:02.012455 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd690b-0099-4f92-a4c9-8e132c5bd8ed None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:02.024807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad160c-054b-4b67-8498-1b96060c9da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:02.025714 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad160c-054b-4b67-8498-1b96060c9da7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:02.026544 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad160c-054b-4b67-8498-1b96060c9da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:02.027008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad160c-054b-4b67-8498-1b96060c9da7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:02.028343 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad160c-054b-4b67-8498-1b96060c9da7 None admin] RBAC: Adding query filter params (group.id=ee994d30d4784b6fa845b0b1db117752, role.id=61c33763c453452d82531c56aeb67287, scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:02.029086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad160c-054b-4b67-8498-1b96060c9da7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:02.030910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad160c-054b-4b67-8498-1b96060c9da7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:02.039319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 191/369] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 19 12:18:01 2022] GET /identity/v3/role_assignments?group.id=ee994d30d4784b6fa845b0b1db117752&scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb&role.id=61c33763c453452d82531c56aeb67287 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:02.040941 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad160c-054b-4b67-8498-1b96060c9da7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:02.059711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d300eb0-cb9b-4d08-8d51-7deb992e7431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:02.061008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d300eb0-cb9b-4d08-8d51-7deb992e7431 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:02.061720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d300eb0-cb9b-4d08-8d51-7deb992e7431 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:02.062249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d300eb0-cb9b-4d08-8d51-7deb992e7431 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:02.078339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d300eb0-cb9b-4d08-8d51-7deb992e7431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:02.088418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-2d300eb0-cb9b-4d08-8d51-7deb992e7431 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:18:02.088418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:02.088418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:02.088418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:02.088418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:02.088418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:02.088418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:02.088418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:02.088418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:02.088418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:02.088418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:02.088418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:02.088418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:02.088418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:02.088418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:02.088418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:02.089323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:02.089323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:02.089323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:02.089323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:02.089323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:02.089323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:02.089323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:02.089323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:02.089323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:02.089323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:02.089323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:02.089323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:02.089323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:02.089323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:02.089323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:02.089323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:02.090101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:02.090101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:02.090101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:02.090101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:02.090101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:02.090101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:02.090101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:02.090101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:02.090101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:02.090101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:02.090101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:18:02.090101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:02.090101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 179/370] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:18:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:02.098461 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d300eb0-cb9b-4d08-8d51-7deb992e7431 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:02.135102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:02.155585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:02.209724 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad160c-054b-4b67-8498-1b96060c9da7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:02.246138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d300eb0-cb9b-4d08-8d51-7deb992e7431 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:02.256061 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d7f9d-57fc-41c1-8390-acca61fe21e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:02.256746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d7f9d-57fc-41c1-8390-acca61fe21e8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:02.257025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d7f9d-57fc-41c1-8390-acca61fe21e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:02.257297 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d7f9d-57fc-41c1-8390-acca61fe21e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:02.258037 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d7f9d-57fc-41c1-8390-acca61fe21e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:02.258461 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d7f9d-57fc-41c1-8390-acca61fe21e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:02.259885 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d7f9d-57fc-41c1-8390-acca61fe21e8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:02.272817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 192/371] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:02.274205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d442922-9ae5-4a2d-aa86-7e27be3453ea None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:02.274497 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d442922-9ae5-4a2d-aa86-7e27be3453ea None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:02.274806 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d442922-9ae5-4a2d-aa86-7e27be3453ea None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:02.277515 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 193/372] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:02.284846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb0754-a7b0-4bd6-955f-9f429ced4d90 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:02.284846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb0754-a7b0-4bd6-955f-9f429ced4d90 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:02.285054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb0754-a7b0-4bd6-955f-9f429ced4d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:02.291737 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e96eaf-e83a-4a2e-bedd-f1f756f4b2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:02.292707 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e96eaf-e83a-4a2e-bedd-f1f756f4b2ec None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:02.293168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e96eaf-e83a-4a2e-bedd-f1f756f4b2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:02.293618 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e96eaf-e83a-4a2e-bedd-f1f756f4b2ec None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:02.294544 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e96eaf-e83a-4a2e-bedd-f1f756f4b2ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:02.295047 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e96eaf-e83a-4a2e-bedd-f1f756f4b2ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:02.296770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e96eaf-e83a-4a2e-bedd-f1f756f4b2ec None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:02.302982 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-aedb0754-a7b0-4bd6-955f-9f429ced4d90 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:02.304190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-aedb0754-a7b0-4bd6-955f-9f429ced4d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:02.306864 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 180/373] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:02.307960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e96eaf-e83a-4a2e-bedd-f1f756f4b2ec None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:02.402880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 194/374] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:02.404042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb0754-a7b0-4bd6-955f-9f429ced4d90 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:02.437457 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:02.447566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e96eaf-e83a-4a2e-bedd-f1f756f4b2ec None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:02.472342 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:02.491822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f413bd-5745-4209-b7d8-4aec83370204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:02.492488 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f413bd-5745-4209-b7d8-4aec83370204 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:02.492770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f413bd-5745-4209-b7d8-4aec83370204 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:02.493044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f413bd-5745-4209-b7d8-4aec83370204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:02.548560 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb0754-a7b0-4bd6-955f-9f429ced4d90 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:02.581009 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f413bd-5745-4209-b7d8-4aec83370204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:02.583206 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f413bd-5745-4209-b7d8-4aec83370204 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:02.592856 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce9e27-6dc3-4672-97fd-6f4a479cd7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:02.593997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce9e27-6dc3-4672-97fd-6f4a479cd7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:02.594487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce9e27-6dc3-4672-97fd-6f4a479cd7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:02.595096 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce9e27-6dc3-4672-97fd-6f4a479cd7f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:02.714819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce9e27-6dc3-4672-97fd-6f4a479cd7f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:02.716003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:02.716440 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce9e27-6dc3-4672-97fd-6f4a479cd7f8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:02.723693 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 181/375] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:02.724535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f413bd-5745-4209-b7d8-4aec83370204 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:02.771277 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:02.832088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 195/376] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:02.832868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce9e27-6dc3-4672-97fd-6f4a479cd7f8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:02.834069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f413bd-5745-4209-b7d8-4aec83370204 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:02.874628 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b2a80-ab3f-4817-8ab9-1e572cbe6e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:02.875677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b2a80-ab3f-4817-8ab9-1e572cbe6e11 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:02.876143 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b2a80-ab3f-4817-8ab9-1e572cbe6e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:02.876555 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b2a80-ab3f-4817-8ab9-1e572cbe6e11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:02.888609 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b2a80-ab3f-4817-8ab9-1e572cbe6e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:02.897670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-470b2a80-ab3f-4817-8ab9-1e572cbe6e11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:18:02.897670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:02.897670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:02.897670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:02.897670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:02.897670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:02.897670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:02.897670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:02.897670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:02.897670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:02.897670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:02.897670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:02.897670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:02.897670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:02.897670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:02.897670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:02.898727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:02.898727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:02.898727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:02.898727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:02.898727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:02.898727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:02.898727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:02.898727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:02.898727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:02.898727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:02.898727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:02.898727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:02.898727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:02.898727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:02.898727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:02.898727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:02.899605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:02.899605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:02.899605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:02.899605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:02.899605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:02.899605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:02.899605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:02.899605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:02.899605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:02.899605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:02.899605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:18:02.899605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:02.901901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 182/377] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:02.904675 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b2a80-ab3f-4817-8ab9-1e572cbe6e11 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:02.962150 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce9e27-6dc3-4672-97fd-6f4a479cd7f8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:02.979163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:03.015366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54bfeeb-283a-4d20-8b45-08a0b38d5705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:03.015366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bfeeb-283a-4d20-8b45-08a0b38d5705 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:03.015652 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bfeeb-283a-4d20-8b45-08a0b38d5705 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:03.015899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bfeeb-283a-4d20-8b45-08a0b38d5705 None admin] PATH_INFO: `/v3/projects/0a118b268db6472d8ac22365fb14ce5a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:03.017114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54bfeeb-283a-4d20-8b45-08a0b38d5705 None admin] RBAC: Authorizing `identity:get_project(project_id=0a118b268db6472d8ac22365fb14ce5a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:03.019415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54bfeeb-283a-4d20-8b45-08a0b38d5705 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:03.021968 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 196/378] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:18:02 2022] GET /identity/v3/projects/0a118b268db6472d8ac22365fb14ce5a => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:03.022785 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54bfeeb-283a-4d20-8b45-08a0b38d5705 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:03.040181 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b2a80-ab3f-4817-8ab9-1e572cbe6e11 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:03.046465 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:03.092223 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04d9d1-6e34-4d4b-bc4b-cb69ca5fa1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:03.093514 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04d9d1-6e34-4d4b-bc4b-cb69ca5fa1cd None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:03.094001 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04d9d1-6e34-4d4b-bc4b-cb69ca5fa1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:03.094474 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04d9d1-6e34-4d4b-bc4b-cb69ca5fa1cd None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:03.098562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04d9d1-6e34-4d4b-bc4b-cb69ca5fa1cd None admin] RBAC: Authorizing `identity:get_project(project_id=5a14beb3e8e643bca9af26f2ac0062bb)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:03.100500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04d9d1-6e34-4d4b-bc4b-cb69ca5fa1cd None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:03.102597 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 183/379] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:18:02 2022] GET /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:03.103677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04d9d1-6e34-4d4b-bc4b-cb69ca5fa1cd None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:03.167581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54bfeeb-283a-4d20-8b45-08a0b38d5705 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:03.210102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d3e68-bd70-45b4-af23-d1a1af7fb086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:03.210825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d3e68-bd70-45b4-af23-d1a1af7fb086 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:03.211109 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d3e68-bd70-45b4-af23-d1a1af7fb086 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:03.211381 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d3e68-bd70-45b4-af23-d1a1af7fb086 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:03.212131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d3e68-bd70-45b4-af23-d1a1af7fb086 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:03.212433 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d3e68-bd70-45b4-af23-d1a1af7fb086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:03.214238 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d3e68-bd70-45b4-af23-d1a1af7fb086 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:03.223909 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 197/380] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:18:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:03.224674 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d3e68-bd70-45b4-af23-d1a1af7fb086 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:03.227675 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04d9d1-6e34-4d4b-bc4b-cb69ca5fa1cd None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:03.254063 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:03.267264 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276489a0-2887-44e2-a6f4-0dc01c381843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:03.267921 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276489a0-2887-44e2-a6f4-0dc01c381843 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:03.268294 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276489a0-2887-44e2-a6f4-0dc01c381843 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:03.268660 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276489a0-2887-44e2-a6f4-0dc01c381843 None admin] PATH_INFO: `/v3/groups/2a4b84cba80848919a5dc29874ce3983` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:03.275419 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276489a0-2887-44e2-a6f4-0dc01c381843 None admin] RBAC: Authorizing `identity:get_group(group_id=2a4b84cba80848919a5dc29874ce3983)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:03.277718 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276489a0-2887-44e2-a6f4-0dc01c381843 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:03.279750 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 184/381] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 19 12:18:03 2022] GET /identity/v3/groups/2a4b84cba80848919a5dc29874ce3983 => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:03.280713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276489a0-2887-44e2-a6f4-0dc01c381843 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:03.316783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:03.341172 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d3e68-bd70-45b4-af23-d1a1af7fb086 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:03.381242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598faa4a-9068-4756-9a9b-864b55719cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:03.382476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598faa4a-9068-4756-9a9b-864b55719cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:03.383036 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598faa4a-9068-4756-9a9b-864b55719cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:03.383614 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598faa4a-9068-4756-9a9b-864b55719cf7 None admin] PATH_INFO: `/v3/groups/ee994d30d4784b6fa845b0b1db117752` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:03.385070 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598faa4a-9068-4756-9a9b-864b55719cf7 None admin] RBAC: Authorizing `identity:get_group(group_id=ee994d30d4784b6fa845b0b1db117752)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:03.386985 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598faa4a-9068-4756-9a9b-864b55719cf7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:03.389252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 198/382] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 19 12:18:03 2022] GET /identity/v3/groups/ee994d30d4784b6fa845b0b1db117752 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:03.390335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598faa4a-9068-4756-9a9b-864b55719cf7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:03.392708 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276489a0-2887-44e2-a6f4-0dc01c381843 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:03.431920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac09dbe-42d5-4199-9211-5098e58320bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:03.432468 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac09dbe-42d5-4199-9211-5098e58320bc None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:03.432739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac09dbe-42d5-4199-9211-5098e58320bc None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:03.433007 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac09dbe-42d5-4199-9211-5098e58320bc None admin] PATH_INFO: `/v3/groups/ee994d30d4784b6fa845b0b1db117752` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:03.434304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac09dbe-42d5-4199-9211-5098e58320bc None admin] RBAC: Authorizing `identity:get_group(group_id=ee994d30d4784b6fa845b0b1db117752)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:03.435777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac09dbe-42d5-4199-9211-5098e58320bc None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:03.437426 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 185/383] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 19 12:18:03 2022] GET /identity/v3/groups/ee994d30d4784b6fa845b0b1db117752 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:03.438522 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac09dbe-42d5-4199-9211-5098e58320bc None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:03.508044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:03.508546 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598faa4a-9068-4756-9a9b-864b55719cf7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:03.549827 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50f5ff-86af-470f-b079-420c3d0c6c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:03.551539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50f5ff-86af-470f-b079-420c3d0c6c5f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:03.552056 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50f5ff-86af-470f-b079-420c3d0c6c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:03.552644 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50f5ff-86af-470f-b079-420c3d0c6c5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:03.553809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50f5ff-86af-470f-b079-420c3d0c6c5f None admin] RBAC: Adding query filter params (group.id=2a4b84cba80848919a5dc29874ce3983, role.id=386cb814e8464fda8832b13c75eabdaf, scope.project.id=0a118b268db6472d8ac22365fb14ce5a) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:03.554339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50f5ff-86af-470f-b079-420c3d0c6c5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:03.556013 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50f5ff-86af-470f-b079-420c3d0c6c5f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:03.556218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac09dbe-42d5-4199-9211-5098e58320bc None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:03.562780 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 199/384] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 19 12:18:03 2022] GET /identity/v3/role_assignments?group.id=2a4b84cba80848919a5dc29874ce3983&scope.project.id=0a118b268db6472d8ac22365fb14ce5a&role.id=386cb814e8464fda8832b13c75eabdaf => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:03.563974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50f5ff-86af-470f-b079-420c3d0c6c5f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:03.578680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:03.598795 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0d1c3-89bf-4ef1-981b-b55a21fc5633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:03.599727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0d1c3-89bf-4ef1-981b-b55a21fc5633 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:03.600154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0d1c3-89bf-4ef1-981b-b55a21fc5633 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:03.600639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0d1c3-89bf-4ef1-981b-b55a21fc5633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:03.601718 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0d1c3-89bf-4ef1-981b-b55a21fc5633 None admin] RBAC: Adding query filter params (group.id=ee994d30d4784b6fa845b0b1db117752, role.id=b929adc09fcc41daaf5cf39de856c1b6, scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:03.602165 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0d1c3-89bf-4ef1-981b-b55a21fc5633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:03.603846 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0d1c3-89bf-4ef1-981b-b55a21fc5633 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:03.610445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 186/385] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 19 12:18:03 2022] GET /identity/v3/role_assignments?group.id=ee994d30d4784b6fa845b0b1db117752&scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb&role.id=b929adc09fcc41daaf5cf39de856c1b6 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:03.684843 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50f5ff-86af-470f-b079-420c3d0c6c5f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:03.717315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a474506-0527-4028-b7d2-1629a79070d4 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:03.717961 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a474506-0527-4028-b7d2-1629a79070d4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:03.718512 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a474506-0527-4028-b7d2-1629a79070d4 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:03.720253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 187/386] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:03.724810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e98008-362d-43e5-ab20-2fbbbb054680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:03.725798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e98008-362d-43e5-ab20-2fbbbb054680 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:03.726087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e98008-362d-43e5-ab20-2fbbbb054680 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:03.726363 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e98008-362d-43e5-ab20-2fbbbb054680 None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:03.727808 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e98008-362d-43e5-ab20-2fbbbb054680 None admin] RBAC: Authorizing `identity:get_project(project_id=554f819c0ee841348da0445f933c4c69)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:03.729195 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa1698-4f24-4a56-b486-54d36eb9d9ea None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:03.729324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e98008-362d-43e5-ab20-2fbbbb054680 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:03.729847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa1698-4f24-4a56-b486-54d36eb9d9ea None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:03.730315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa1698-4f24-4a56-b486-54d36eb9d9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:03.731345 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 200/387] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:18:03 2022] GET /identity/v3/projects/554f819c0ee841348da0445f933c4c69 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:03.737162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e98008-362d-43e5-ab20-2fbbbb054680 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:03.752787 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e5fa1698-4f24-4a56-b486-54d36eb9d9ea None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:03.754808 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e5fa1698-4f24-4a56-b486-54d36eb9d9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:03.876276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:03.886767 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 188/388] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:18:03.905463 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e98008-362d-43e5-ab20-2fbbbb054680 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:03.911363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa1698-4f24-4a56-b486-54d36eb9d9ea None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:03.962754 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eef452-ea1f-48f7-8a84-28a5fafe0df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:03.963988 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eef452-ea1f-48f7-8a84-28a5fafe0df3 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:03.964286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eef452-ea1f-48f7-8a84-28a5fafe0df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:03.964569 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eef452-ea1f-48f7-8a84-28a5fafe0df3 None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69/groups/ee994d30d4784b6fa845b0b1db117752/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:03.967562 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eef452-ea1f-48f7-8a84-28a5fafe0df3 None admin] RBAC: Authorizing `identity:create_grant(project_id=554f819c0ee841348da0445f933c4c69, group_id=ee994d30d4784b6fa845b0b1db117752, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:03.969011 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eef452-ea1f-48f7-8a84-28a5fafe0df3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:04.002919 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 201/389] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Jul 19 12:18:03 2022] PUT /identity/v3/projects/554f819c0ee841348da0445f933c4c69/groups/ee994d30d4784b6fa845b0b1db117752/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:18:04.013233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:04.078722 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa1698-4f24-4a56-b486-54d36eb9d9ea None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:04.125009 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7888b-d021-48d1-8ef2-3bf89c647ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:04.125844 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7888b-d021-48d1-8ef2-3bf89c647ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:04.126127 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7888b-d021-48d1-8ef2-3bf89c647ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:04.126401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7888b-d021-48d1-8ef2-3bf89c647ba1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:04.147051 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7888b-d021-48d1-8ef2-3bf89c647ba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:04.155531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-77e7888b-d021-48d1-8ef2-3bf89c647ba1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:18:04.155531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:04.155531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:04.155531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:04.155531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:04.155531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:04.155531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:04.155531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:04.155531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:04.155531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:04.155531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:04.155531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:04.155531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:04.155531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:04.155531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:04.155531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:04.156466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:04.156466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:04.156466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:04.156466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:04.156466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:04.156466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:04.156466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:04.156466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:04.156466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:04.156466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:04.156466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:04.156466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:04.156466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:04.156466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:04.156466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:04.156466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:04.157224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:04.157224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:04.157224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:04.157224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:04.157224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:04.157224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:04.157224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:04.157224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:04.157224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:04.157224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:04.157224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:18:04.157224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:04.157224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 189/390] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:18:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:04.165675 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eef452-ea1f-48f7-8a84-28a5fafe0df3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:04.354542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eef452-ea1f-48f7-8a84-28a5fafe0df3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:04.413080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6114d-b3b9-4c31-b642-c76c9b0d14e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:04.413760 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6114d-b3b9-4c31-b642-c76c9b0d14e8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:04.414042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6114d-b3b9-4c31-b642-c76c9b0d14e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:04.414319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6114d-b3b9-4c31-b642-c76c9b0d14e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:04.415092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6114d-b3b9-4c31-b642-c76c9b0d14e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:04.415400 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6114d-b3b9-4c31-b642-c76c9b0d14e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:04.416784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6114d-b3b9-4c31-b642-c76c9b0d14e8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:04.423002 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:04.426349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 202/391] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:04.432137 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7888b-d021-48d1-8ef2-3bf89c647ba1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:04.590575 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7888b-d021-48d1-8ef2-3bf89c647ba1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:04.602567 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:04.606777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadac70-68ad-4a17-8f92-ea265531ee9c None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:04.607044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadac70-68ad-4a17-8f92-ea265531ee9c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:04.607351 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadac70-68ad-4a17-8f92-ea265531ee9c None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:04.608894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 203/392] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:04.614370 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5c999-b839-496d-bada-8b36b3f28b13 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:04.614655 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5c999-b839-496d-bada-8b36b3f28b13 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:04.614956 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5c999-b839-496d-bada-8b36b3f28b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:04.645026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7d3d4-a7e9-4f96-b379-03cd6581a038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:04.646198 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7d3d4-a7e9-4f96-b379-03cd6581a038 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:04.646681 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7d3d4-a7e9-4f96-b379-03cd6581a038 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:04.647165 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7d3d4-a7e9-4f96-b379-03cd6581a038 None admin] PATH_INFO: `/v3/groups/ee994d30d4784b6fa845b0b1db117752` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:04.648839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2cc5c999-b839-496d-bada-8b36b3f28b13 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:04.649637 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7d3d4-a7e9-4f96-b379-03cd6581a038 None admin] RBAC: Authorizing `identity:get_group(group_id=ee994d30d4784b6fa845b0b1db117752)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:04.651323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7d3d4-a7e9-4f96-b379-03cd6581a038 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:04.652718 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2cc5c999-b839-496d-bada-8b36b3f28b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:04.656996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 190/393] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 19 12:18:04 2022] GET /identity/v3/groups/ee994d30d4784b6fa845b0b1db117752 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:04.663679 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7d3d4-a7e9-4f96-b379-03cd6581a038 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:04.795645 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 204/394] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:18:04.819236 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5c999-b839-496d-bada-8b36b3f28b13 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:04.863637 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7d3d4-a7e9-4f96-b379-03cd6581a038 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:04.942245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5c999-b839-496d-bada-8b36b3f28b13 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:04.975474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:04.981812 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800aec3-ad17-4250-a79e-552ffaee0bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:04.982788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800aec3-ad17-4250-a79e-552ffaee0bba None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:04.983169 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800aec3-ad17-4250-a79e-552ffaee0bba None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:04.983699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800aec3-ad17-4250-a79e-552ffaee0bba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:04.991469 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1c7a8-499b-422b-a742-56821d7d248d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:04.992361 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1c7a8-499b-422b-a742-56821d7d248d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:04.992646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1c7a8-499b-422b-a742-56821d7d248d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:04.992922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1c7a8-499b-422b-a742-56821d7d248d None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:04.997177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800aec3-ad17-4250-a79e-552ffaee0bba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:04.999493 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1c7a8-499b-422b-a742-56821d7d248d None admin] RBAC: Authorizing `identity:get_project(project_id=554f819c0ee841348da0445f933c4c69)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:05.000977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1c7a8-499b-422b-a742-56821d7d248d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:05.003212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 191/395] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:18:04 2022] GET /identity/v3/projects/554f819c0ee841348da0445f933c4c69 => generated 298 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:05.006058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-c800aec3-ad17-4250-a79e-552ffaee0bba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:18:05.006058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:05.006058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:05.006058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:05.006058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:05.006058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:05.006058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:05.006058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:05.006058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:05.006058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:05.006058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:05.006058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:05.006058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:05.006058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:05.006058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:05.006058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:05.006960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:05.006960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:05.006960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:05.006960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:05.006960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:05.006960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:05.006960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:05.006960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:05.006960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:05.006960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:05.006960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:05.006960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:05.006960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:05.006960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:05.006960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:05.006960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:05.007747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:05.007747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:05.007747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:05.007747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:05.007747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:05.007747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:05.007747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:05.007747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:05.007747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:05.007747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:05.007747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:18:05.007747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:05.008499 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1c7a8-499b-422b-a742-56821d7d248d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:05.009973 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 205/396] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:05.016063 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800aec3-ad17-4250-a79e-552ffaee0bba None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:05.100771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:05.169825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800aec3-ad17-4250-a79e-552ffaee0bba None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:05.183902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1c7a8-499b-422b-a742-56821d7d248d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:05.210454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fb805-c1e4-4885-8db6-0c3c997f28e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:05.211516 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fb805-c1e4-4885-8db6-0c3c997f28e7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:05.211964 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fb805-c1e4-4885-8db6-0c3c997f28e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:05.212423 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fb805-c1e4-4885-8db6-0c3c997f28e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:05.213348 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fb805-c1e4-4885-8db6-0c3c997f28e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:05.213817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fb805-c1e4-4885-8db6-0c3c997f28e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:05.215796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fb805-c1e4-4885-8db6-0c3c997f28e7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:05.229434 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 206/397] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:18:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:05.234550 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fb805-c1e4-4885-8db6-0c3c997f28e7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:05.241832 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f1a3e-3815-4eb8-a4df-c31e22fbb9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:05.242846 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f1a3e-3815-4eb8-a4df-c31e22fbb9f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:05.243204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f1a3e-3815-4eb8-a4df-c31e22fbb9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:05.243550 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f1a3e-3815-4eb8-a4df-c31e22fbb9f2 None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69/groups/ee994d30d4784b6fa845b0b1db117752/roles/b929adc09fcc41daaf5cf39de856c1b6` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:05.247828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f1a3e-3815-4eb8-a4df-c31e22fbb9f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=554f819c0ee841348da0445f933c4c69, group_id=ee994d30d4784b6fa845b0b1db117752, role_id=b929adc09fcc41daaf5cf39de856c1b6)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:05.249454 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f1a3e-3815-4eb8-a4df-c31e22fbb9f2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:05.277484 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 192/398] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Jul 19 12:18:05 2022] PUT /identity/v3/projects/554f819c0ee841348da0445f933c4c69/groups/ee994d30d4784b6fa845b0b1db117752/roles/b929adc09fcc41daaf5cf39de856c1b6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:18:05.301945 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:05.355233 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fb805-c1e4-4885-8db6-0c3c997f28e7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:05.393973 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e94cc2-bbb5-4b62-99bc-2ef82d87033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:05.395207 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e94cc2-bbb5-4b62-99bc-2ef82d87033a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:05.395669 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e94cc2-bbb5-4b62-99bc-2ef82d87033a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:05.396120 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e94cc2-bbb5-4b62-99bc-2ef82d87033a None admin] PATH_INFO: `/v3/groups/ee994d30d4784b6fa845b0b1db117752` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:05.397573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e94cc2-bbb5-4b62-99bc-2ef82d87033a None admin] RBAC: Authorizing `identity:get_group(group_id=ee994d30d4784b6fa845b0b1db117752)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:05.399248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e94cc2-bbb5-4b62-99bc-2ef82d87033a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:05.401545 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 207/399] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 19 12:18:05 2022] GET /identity/v3/groups/ee994d30d4784b6fa845b0b1db117752 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:05.406988 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f1a3e-3815-4eb8-a4df-c31e22fbb9f2 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:05.543877 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f1a3e-3815-4eb8-a4df-c31e22fbb9f2 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:05.549699 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:05.583812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfdc18-e82b-47be-b0ef-db55666575ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:05.584694 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfdc18-e82b-47be-b0ef-db55666575ab None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:05.584975 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfdc18-e82b-47be-b0ef-db55666575ab None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:05.585250 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfdc18-e82b-47be-b0ef-db55666575ab None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:05.586486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfdc18-e82b-47be-b0ef-db55666575ab None admin] RBAC: Authorizing `identity:get_project(project_id=5a14beb3e8e643bca9af26f2ac0062bb)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:05.587954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfdc18-e82b-47be-b0ef-db55666575ab None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:05.590017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 193/400] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:18:05 2022] GET /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:05.595473 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e94cc2-bbb5-4b62-99bc-2ef82d87033a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:05.731562 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e94cc2-bbb5-4b62-99bc-2ef82d87033a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:05.757085 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:05.780150 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33c237-a4ad-41d7-9285-daf546295ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:05.781046 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33c237-a4ad-41d7-9285-daf546295ad9 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:05.781327 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33c237-a4ad-41d7-9285-daf546295ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:05.781605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33c237-a4ad-41d7-9285-daf546295ad9 None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb/groups/ee994d30d4784b6fa845b0b1db117752/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:05.783704 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33c237-a4ad-41d7-9285-daf546295ad9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a14beb3e8e643bca9af26f2ac0062bb, group_id=ee994d30d4784b6fa845b0b1db117752, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:05.785217 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33c237-a4ad-41d7-9285-daf546295ad9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:05.807491 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 208/401] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Jul 19 12:18:05 2022] PUT /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb/groups/ee994d30d4784b6fa845b0b1db117752/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:18:06.159934 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa818b-466c-41f2-8605-2dc1771c3bb2 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:06.160625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa818b-466c-41f2-8605-2dc1771c3bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:06.161112 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa818b-466c-41f2-8605-2dc1771c3bb2 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:06.163069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 194/402] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:06.171030 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864ef2a-82e5-4bbc-b791-4626affd4b0f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:06.171599 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864ef2a-82e5-4bbc-b791-4626affd4b0f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:06.172075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864ef2a-82e5-4bbc-b791-4626affd4b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:06.194583 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d864ef2a-82e5-4bbc-b791-4626affd4b0f None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:06.196182 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d864ef2a-82e5-4bbc-b791-4626affd4b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:06.292668 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 209/403] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:06.327297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa818b-466c-41f2-8605-2dc1771c3bb2 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:06.480466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa818b-466c-41f2-8605-2dc1771c3bb2 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:06.485987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d79256-f84c-4228-acd7-b7bbcbefaa78 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:06.486443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d79256-f84c-4228-acd7-b7bbcbefaa78 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:06.487227 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d79256-f84c-4228-acd7-b7bbcbefaa78 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:06.495225 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 210/404] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:18:06.496823 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3a62d-2613-470e-9238-e680f5205153 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:06.497110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3a62d-2613-470e-9238-e680f5205153 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:06.497382 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3a62d-2613-470e-9238-e680f5205153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:06.518299 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8aaf0-032c-4ed0-bf8e-93b821232028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:06.519394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8aaf0-032c-4ed0-bf8e-93b821232028 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:06.519855 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8aaf0-032c-4ed0-bf8e-93b821232028 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:06.520304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8aaf0-032c-4ed0-bf8e-93b821232028 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:06.527818 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9ff3a62d-2613-470e-9238-e680f5205153 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:06.529125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9ff3a62d-2613-470e-9238-e680f5205153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:06.531261 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8aaf0-032c-4ed0-bf8e-93b821232028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:06.539614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-fec8aaf0-032c-4ed0-bf8e-93b821232028 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:18:06.539614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:06.539614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:06.539614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:06.539614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:06.539614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:06.539614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:06.539614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:06.539614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:06.539614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:06.539614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:06.539614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:06.539614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:06.539614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:06.539614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:06.539614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:06.540497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:06.540497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:06.540497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:06.540497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:06.540497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:06.540497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:06.540497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:06.540497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:06.540497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:06.540497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:06.540497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:06.540497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:06.540497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:06.540497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:06.540497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:06.540497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:06.541259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:06.541259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:06.541259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:06.541259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:06.541259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:06.541259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:06.541259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:06.541259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:06.541259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:06.541259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:06.541259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:18:06.541259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:06.543532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 195/405] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:18:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:06.555762 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8aaf0-032c-4ed0-bf8e-93b821232028 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:06.612246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 211/406] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:06.623311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:06.668023 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3a62d-2613-470e-9238-e680f5205153 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:06.737204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8aaf0-032c-4ed0-bf8e-93b821232028 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:06.743062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:06.795166 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcfe37-1bd7-4212-961a-ecffee3105ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:06.795848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcfe37-1bd7-4212-961a-ecffee3105ff None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:06.796131 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcfe37-1bd7-4212-961a-ecffee3105ff None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:06.796408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcfe37-1bd7-4212-961a-ecffee3105ff None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:06.797165 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcfe37-1bd7-4212-961a-ecffee3105ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:06.797467 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcfe37-1bd7-4212-961a-ecffee3105ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:06.798869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcfe37-1bd7-4212-961a-ecffee3105ff None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:06.817490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 196/407] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:06.824846 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcfe37-1bd7-4212-961a-ecffee3105ff None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:06.853557 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3a62d-2613-470e-9238-e680f5205153 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:06.892949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53463c-f7d5-40a9-98ea-e952982f0f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:06.893771 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53463c-f7d5-40a9-98ea-e952982f0f9d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:06.894045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53463c-f7d5-40a9-98ea-e952982f0f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:06.894315 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53463c-f7d5-40a9-98ea-e952982f0f9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:06.905339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53463c-f7d5-40a9-98ea-e952982f0f9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:06.914092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9d53463c-f7d5-40a9-98ea-e952982f0f9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:18:06.914092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:06.914092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:06.914092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:06.914092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:06.914092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:06.914092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:06.914092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:06.914092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:06.914092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:06.914092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:06.914092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:06.914092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:06.914092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:06.914092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:06.914092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:06.914995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:06.914995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:06.914995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:06.914995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:06.914995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:06.914995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:06.914995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:06.914995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:06.914995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:06.914995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:06.914995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:06.914995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:06.914995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:06.914995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:06.914995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:06.914995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:06.915799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:06.915799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:06.915799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:06.915799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:06.915799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:06.915799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:06.915799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:06.915799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:06.915799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:06.915799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:06.915799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:18:06.915799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:06.920111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 212/408] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:18:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:06.921471 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab9580-2f30-40f5-a2e7-e53fafda7005 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:06.921753 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab9580-2f30-40f5-a2e7-e53fafda7005 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:06.922030 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab9580-2f30-40f5-a2e7-e53fafda7005 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:06.927773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 213/409] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:06.927773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab9580-2f30-40f5-a2e7-e53fafda7005 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:06.963689 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcfe37-1bd7-4212-961a-ecffee3105ff None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:06.972179 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:07.007647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90deac3b-043d-4980-9861-6c4c739ec1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:07.008819 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90deac3b-043d-4980-9861-6c4c739ec1bb None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:07.009507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90deac3b-043d-4980-9861-6c4c739ec1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:07.010333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90deac3b-043d-4980-9861-6c4c739ec1bb None admin] PATH_INFO: `/v3/groups/2a4b84cba80848919a5dc29874ce3983` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:07.011991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90deac3b-043d-4980-9861-6c4c739ec1bb None admin] RBAC: Authorizing `identity:get_group(group_id=2a4b84cba80848919a5dc29874ce3983)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:07.014084 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90deac3b-043d-4980-9861-6c4c739ec1bb None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:07.017040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 197/410] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 19 12:18:06 2022] GET /identity/v3/groups/2a4b84cba80848919a5dc29874ce3983 => generated 229 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:07.018692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac29b7-d44d-4862-a457-cff24e964a62 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:07.019260 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac29b7-d44d-4862-a457-cff24e964a62 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:07.019683 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac29b7-d44d-4862-a457-cff24e964a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:07.041957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-40ac29b7-d44d-4862-a457-cff24e964a62 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:07.043916 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-40ac29b7-d44d-4862-a457-cff24e964a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:07.053787 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:07.058005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab9580-2f30-40f5-a2e7-e53fafda7005 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:07.094978 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d8be4-41b9-4b88-b60f-87439212e491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:07.095802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d8be4-41b9-4b88-b60f-87439212e491 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:07.096231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d8be4-41b9-4b88-b60f-87439212e491 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:07.096604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d8be4-41b9-4b88-b60f-87439212e491 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:07.097502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d8be4-41b9-4b88-b60f-87439212e491 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:07.097943 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d8be4-41b9-4b88-b60f-87439212e491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:07.099449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d8be4-41b9-4b88-b60f-87439212e491 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:07.113599 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 214/411] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:07.114563 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d8be4-41b9-4b88-b60f-87439212e491 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:07.143652 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 198/412] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:07.143652 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac29b7-d44d-4862-a457-cff24e964a62 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:07.237833 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d8be4-41b9-4b88-b60f-87439212e491 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:07.264884 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:07.273262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac29b7-d44d-4862-a457-cff24e964a62 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:07.275135 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092ce3f-a104-404b-b55e-91d4fd83b0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:07.276212 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092ce3f-a104-404b-b55e-91d4fd83b0fb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:07.276690 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092ce3f-a104-404b-b55e-91d4fd83b0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:07.277104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092ce3f-a104-404b-b55e-91d4fd83b0fb None admin] PATH_INFO: `/v3/projects/0a118b268db6472d8ac22365fb14ce5a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:07.278446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092ce3f-a104-404b-b55e-91d4fd83b0fb None admin] RBAC: Authorizing `identity:get_project(project_id=0a118b268db6472d8ac22365fb14ce5a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:07.280062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092ce3f-a104-404b-b55e-91d4fd83b0fb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:07.286969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 215/413] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:18:07 2022] GET /identity/v3/projects/0a118b268db6472d8ac22365fb14ce5a => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:07.288098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092ce3f-a104-404b-b55e-91d4fd83b0fb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:07.321214 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03e0f1-a29b-4c19-a4dc-07da2fe5f5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:07.322224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03e0f1-a29b-4c19-a4dc-07da2fe5f5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:07.322825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03e0f1-a29b-4c19-a4dc-07da2fe5f5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:07.322999 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03e0f1-a29b-4c19-a4dc-07da2fe5f5b2 None admin] PATH_INFO: `/v3/groups/ee994d30d4784b6fa845b0b1db117752` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:07.324390 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03e0f1-a29b-4c19-a4dc-07da2fe5f5b2 None admin] RBAC: Authorizing `identity:get_group(group_id=ee994d30d4784b6fa845b0b1db117752)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:07.325985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03e0f1-a29b-4c19-a4dc-07da2fe5f5b2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:07.327795 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 199/414] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 19 12:18:07 2022] GET /identity/v3/groups/ee994d30d4784b6fa845b0b1db117752 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:07.329209 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03e0f1-a29b-4c19-a4dc-07da2fe5f5b2 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:07.330284 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:07.411218 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092ce3f-a104-404b-b55e-91d4fd83b0fb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:07.437438 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03e0f1-a29b-4c19-a4dc-07da2fe5f5b2 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:07.448274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f55f0-7e35-467f-b164-d83a6dd46825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:07.449364 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f55f0-7e35-467f-b164-d83a6dd46825 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:07.449842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f55f0-7e35-467f-b164-d83a6dd46825 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:07.450337 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f55f0-7e35-467f-b164-d83a6dd46825 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:07.461495 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f55f0-7e35-467f-b164-d83a6dd46825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:07.469466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-e33f55f0-7e35-467f-b164-d83a6dd46825 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:18:07.469466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:07.469466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:07.469466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:07.469466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:07.469466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:07.469466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:07.469466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:07.469466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:07.469466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:07.469466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:07.469466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:07.469466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:07.469466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:07.469466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:07.469466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:07.470339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:07.470339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:07.470339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:07.470339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:07.470339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:07.470339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:07.470339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:07.470339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:07.470339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:07.470339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:07.470339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:07.470339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:07.470339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:07.470339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:07.470339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:07.470339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:07.471679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:07.471679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:07.471679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:07.471679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:07.471679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:07.471679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:07.471679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:07.471679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:07.471679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:07.471679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:07.471679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:18:07.471679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:07.474085 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 216/415] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:07.475183 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f55f0-7e35-467f-b164-d83a6dd46825 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:07.480441 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fac9d-046d-42ab-bc42-2f58b27d2a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:07.481158 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fac9d-046d-42ab-bc42-2f58b27d2a4e None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:07.481445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fac9d-046d-42ab-bc42-2f58b27d2a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:07.481717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fac9d-046d-42ab-bc42-2f58b27d2a4e None admin] PATH_INFO: `/v3/projects/0a118b268db6472d8ac22365fb14ce5a/groups/2a4b84cba80848919a5dc29874ce3983/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:07.483799 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fac9d-046d-42ab-bc42-2f58b27d2a4e None admin] RBAC: Authorizing `identity:create_grant(project_id=0a118b268db6472d8ac22365fb14ce5a, group_id=2a4b84cba80848919a5dc29874ce3983, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:07.485302 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fac9d-046d-42ab-bc42-2f58b27d2a4e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:07.503303 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 200/416] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Jul 19 12:18:07 2022] PUT /identity/v3/projects/0a118b268db6472d8ac22365fb14ce5a/groups/2a4b84cba80848919a5dc29874ce3983/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:18:07.506906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fac9d-046d-42ab-bc42-2f58b27d2a4e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:07.535603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:07.635134 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fac9d-046d-42ab-bc42-2f58b27d2a4e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:07.677136 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fe6ee-d50a-44c1-a55c-36a38684fc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:07.677837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fe6ee-d50a-44c1-a55c-36a38684fc4c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:07.678127 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fe6ee-d50a-44c1-a55c-36a38684fc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:07.678407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fe6ee-d50a-44c1-a55c-36a38684fc4c None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:07.679231 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fe6ee-d50a-44c1-a55c-36a38684fc4c None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:07.679542 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fe6ee-d50a-44c1-a55c-36a38684fc4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:07.681311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fe6ee-d50a-44c1-a55c-36a38684fc4c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:07.692049 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 201/417] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:18:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:07.697816 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fe6ee-d50a-44c1-a55c-36a38684fc4c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:07.721372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:07.741998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f55f0-7e35-467f-b164-d83a6dd46825 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:07.791972 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c96c0-19d0-4b47-be6c-2ff872f0f525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:07.792411 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c96c0-19d0-4b47-be6c-2ff872f0f525 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:07.792793 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c96c0-19d0-4b47-be6c-2ff872f0f525 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:07.793172 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c96c0-19d0-4b47-be6c-2ff872f0f525 None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:07.794498 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c96c0-19d0-4b47-be6c-2ff872f0f525 None admin] RBAC: Authorizing `identity:get_project(project_id=5a14beb3e8e643bca9af26f2ac0062bb)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:07.796148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c96c0-19d0-4b47-be6c-2ff872f0f525 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:07.803655 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 217/418] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:18:07 2022] GET /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:07.806291 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c96c0-19d0-4b47-be6c-2ff872f0f525 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:07.814181 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:07.834329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fe6ee-d50a-44c1-a55c-36a38684fc4c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:07.871796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c700d-7dcc-4312-8f68-98e0c486cfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:07.872509 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c700d-7dcc-4312-8f68-98e0c486cfca None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:07.872800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c700d-7dcc-4312-8f68-98e0c486cfca None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:07.873078 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c700d-7dcc-4312-8f68-98e0c486cfca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:07.952992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c700d-7dcc-4312-8f68-98e0c486cfca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:07.954840 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c700d-7dcc-4312-8f68-98e0c486cfca None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:07.958490 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c96c0-19d0-4b47-be6c-2ff872f0f525 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:07.996207 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c58142-aab3-4bbf-8d2f-3b86287db530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:07.997258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c58142-aab3-4bbf-8d2f-3b86287db530 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:07.997440 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c58142-aab3-4bbf-8d2f-3b86287db530 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:07.997682 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c58142-aab3-4bbf-8d2f-3b86287db530 None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb/groups/ee994d30d4784b6fa845b0b1db117752/roles/b929adc09fcc41daaf5cf39de856c1b6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:08.000039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c58142-aab3-4bbf-8d2f-3b86287db530 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a14beb3e8e643bca9af26f2ac0062bb, group_id=ee994d30d4784b6fa845b0b1db117752, role_id=b929adc09fcc41daaf5cf39de856c1b6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:08.001599 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c58142-aab3-4bbf-8d2f-3b86287db530 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:08.022814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 218/419] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Jul 19 12:18:07 2022] PUT /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb/groups/ee994d30d4784b6fa845b0b1db117752/roles/b929adc09fcc41daaf5cf39de856c1b6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:18:08.022814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4e665-8947-4ff6-a632-3e9e01d19c37 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:08.022814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4e665-8947-4ff6-a632-3e9e01d19c37 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:08.022814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4e665-8947-4ff6-a632-3e9e01d19c37 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:08.023324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 219/420] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:08.029347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14ac25-61cf-4766-b59d-fe6be474cbbe None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:08.029731 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14ac25-61cf-4766-b59d-fe6be474cbbe None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:08.030081 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14ac25-61cf-4766-b59d-fe6be474cbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:08.053194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5f14ac25-61cf-4766-b59d-fe6be474cbbe None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:08.054469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5f14ac25-61cf-4766-b59d-fe6be474cbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:08.071648 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:08.097742 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:08.136172 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 202/421] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:08.141665 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c700d-7dcc-4312-8f68-98e0c486cfca None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:08.142466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 220/422] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:18:08.167666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14ac25-61cf-4766-b59d-fe6be474cbbe None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:08.289571 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14ac25-61cf-4766-b59d-fe6be474cbbe None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:08.332288 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c700d-7dcc-4312-8f68-98e0c486cfca None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:08.338571 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e81874-84e9-49b1-9323-d01b446def6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:08.339444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e81874-84e9-49b1-9323-d01b446def6c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:08.339726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e81874-84e9-49b1-9323-d01b446def6c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:08.339998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e81874-84e9-49b1-9323-d01b446def6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:08.351331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e81874-84e9-49b1-9323-d01b446def6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:08.360146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a3e81874-84e9-49b1-9323-d01b446def6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:18:08.360146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:08.360146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:08.360146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:08.360146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:08.360146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:08.360146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:08.360146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:08.360146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:08.360146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:08.360146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:08.360146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:08.360146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:08.360146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:08.360146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:08.360146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:08.361128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:08.361128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:08.361128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:08.361128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:08.361128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:08.361128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:08.361128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:08.361128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:08.361128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:08.361128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:08.361128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:08.361128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:08.361128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:08.361128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:08.361128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:08.361128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:08.362131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:08.362131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:08.362131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:08.362131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:08.362131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:08.362131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:08.362131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:08.362131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:08.362131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:08.362131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:08.362131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:18:08.362131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:08.362131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 221/423] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:18:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:08.363796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8a294-2766-4559-b5d7-fcf64c715736 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:08.363796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8a294-2766-4559-b5d7-fcf64c715736 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:08.363796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8a294-2766-4559-b5d7-fcf64c715736 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:08.365325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 222/424] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:08.370315 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8a294-2766-4559-b5d7-fcf64c715736 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:08.380138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42913981-b095-47d1-bd94-99966cdc28b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:08.381472 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42913981-b095-47d1-bd94-99966cdc28b5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:08.381754 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42913981-b095-47d1-bd94-99966cdc28b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:08.382031 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42913981-b095-47d1-bd94-99966cdc28b5 None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:08.383627 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42913981-b095-47d1-bd94-99966cdc28b5 None admin] RBAC: Authorizing `identity:get_project(project_id=554f819c0ee841348da0445f933c4c69)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:08.385684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42913981-b095-47d1-bd94-99966cdc28b5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:08.388220 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 203/425] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:18:08 2022] GET /identity/v3/projects/554f819c0ee841348da0445f933c4c69 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:08.388986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:08.389945 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b3ad7-107f-4679-b2bb-f6b1e94e130d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:08.390232 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b3ad7-107f-4679-b2bb-f6b1e94e130d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:08.390505 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b3ad7-107f-4679-b2bb-f6b1e94e130d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:08.412894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-045b3ad7-107f-4679-b2bb-f6b1e94e130d None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:08.414286 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-045b3ad7-107f-4679-b2bb-f6b1e94e130d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:08.468407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:08.490700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 204/426] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:08.496517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b3ad7-107f-4679-b2bb-f6b1e94e130d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:08.506595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8a294-2766-4559-b5d7-fcf64c715736 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:08.550030 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c0e6a-b831-48b9-8e1f-001168c46563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:08.551037 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c0e6a-b831-48b9-8e1f-001168c46563 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:08.551653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c0e6a-b831-48b9-8e1f-001168c46563 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:08.552099 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c0e6a-b831-48b9-8e1f-001168c46563 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:08.553802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c0e6a-b831-48b9-8e1f-001168c46563 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:08.554285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c0e6a-b831-48b9-8e1f-001168c46563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:08.555875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c0e6a-b831-48b9-8e1f-001168c46563 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:08.567241 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 223/427] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:08.569024 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c0e6a-b831-48b9-8e1f-001168c46563 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:08.624953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b3ad7-107f-4679-b2bb-f6b1e94e130d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:08.657065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:08.669060 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52133bc-41fe-4528-a456-85c27b84334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:08.670313 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52133bc-41fe-4528-a456-85c27b84334e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:08.670422 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52133bc-41fe-4528-a456-85c27b84334e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:08.670755 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52133bc-41fe-4528-a456-85c27b84334e None admin] PATH_INFO: `/v3/groups/ee994d30d4784b6fa845b0b1db117752` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:08.672306 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52133bc-41fe-4528-a456-85c27b84334e None admin] RBAC: Authorizing `identity:get_group(group_id=ee994d30d4784b6fa845b0b1db117752)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:08.673679 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52133bc-41fe-4528-a456-85c27b84334e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:08.676530 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 205/428] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 19 12:18:08 2022] GET /identity/v3/groups/ee994d30d4784b6fa845b0b1db117752 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:08.677572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52133bc-41fe-4528-a456-85c27b84334e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:08.710203 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c0e6a-b831-48b9-8e1f-001168c46563 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:08.748677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:08.748861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef0467-8aa0-48d1-9d70-f0de693d235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:08.749523 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef0467-8aa0-48d1-9d70-f0de693d235e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:08.749801 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef0467-8aa0-48d1-9d70-f0de693d235e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:08.750071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef0467-8aa0-48d1-9d70-f0de693d235e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:08.764737 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef0467-8aa0-48d1-9d70-f0de693d235e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:08.773493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-dbef0467-8aa0-48d1-9d70-f0de693d235e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:18:08.773493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:08.773493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:08.773493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:08.773493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:08.773493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:08.773493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:08.773493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:08.773493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:08.773493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:08.773493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:08.773493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:08.773493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:08.773493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:08.773493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:08.773493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:08.774366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:08.774366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:08.774366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:08.774366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:08.774366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:08.774366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:08.774366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:08.774366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:08.774366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:08.774366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:08.774366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:08.774366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:08.774366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:08.774366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:08.774366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:08.774366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:08.775204 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:08.775204 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:08.775204 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:08.775204 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:08.775204 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:08.775204 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:08.775204 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:08.775204 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:08.775204 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:08.775204 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:08.775204 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 12:18:08.775204 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:08.779508 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 224/429] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:08.780346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef0467-8aa0-48d1-9d70-f0de693d235e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:08.814603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52133bc-41fe-4528-a456-85c27b84334e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:08.858971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897fbb4-d665-4e60-9030-198c1ab9e8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:08.860140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897fbb4-d665-4e60-9030-198c1ab9e8aa None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:08.861363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897fbb4-d665-4e60-9030-198c1ab9e8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:08.862530 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897fbb4-d665-4e60-9030-198c1ab9e8aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:08.897128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef0467-8aa0-48d1-9d70-f0de693d235e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:08.929313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:08.936150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897fbb4-d665-4e60-9030-198c1ab9e8aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:08.937164 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9233ba-b81b-43d0-8ecf-ac9917439380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:08.937919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897fbb4-d665-4e60-9030-198c1ab9e8aa None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:08.938178 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9233ba-b81b-43d0-8ecf-ac9917439380 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:08.938596 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9233ba-b81b-43d0-8ecf-ac9917439380 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:08.939033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9233ba-b81b-43d0-8ecf-ac9917439380 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:08.940774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9233ba-b81b-43d0-8ecf-ac9917439380 None admin] RBAC: Adding query filter params (group.id=ee994d30d4784b6fa845b0b1db117752, role.id=61c33763c453452d82531c56aeb67287, scope.project.id=554f819c0ee841348da0445f933c4c69) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:08.941318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9233ba-b81b-43d0-8ecf-ac9917439380 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:08.943021 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9233ba-b81b-43d0-8ecf-ac9917439380 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:08.950384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 225/430] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 19 12:18:08 2022] GET /identity/v3/role_assignments?group.id=ee994d30d4784b6fa845b0b1db117752&scope.project.id=554f819c0ee841348da0445f933c4c69&role.id=61c33763c453452d82531c56aeb67287 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:08.951569 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9233ba-b81b-43d0-8ecf-ac9917439380 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:08.993542 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:09.050366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 206/431] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:09.059500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897fbb4-d665-4e60-9030-198c1ab9e8aa None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:09.074512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9233ba-b81b-43d0-8ecf-ac9917439380 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:09.114681 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098842cd-820f-4137-9f79-903a9df924f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:09.115744 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098842cd-820f-4137-9f79-903a9df924f9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:09.116221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098842cd-820f-4137-9f79-903a9df924f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:09.116715 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098842cd-820f-4137-9f79-903a9df924f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:09.117766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098842cd-820f-4137-9f79-903a9df924f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:09.118267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098842cd-820f-4137-9f79-903a9df924f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:09.119910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098842cd-820f-4137-9f79-903a9df924f9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:09.130423 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 226/432] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:18:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:09.146388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098842cd-820f-4137-9f79-903a9df924f9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:09.240747 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897fbb4-d665-4e60-9030-198c1ab9e8aa None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:09.256362 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:09.294514 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2503ca3-1c5e-46d5-96d4-66f4cedc2ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:09.295403 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2503ca3-1c5e-46d5-96d4-66f4cedc2ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:09.295680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2503ca3-1c5e-46d5-96d4-66f4cedc2ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:09.295949 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2503ca3-1c5e-46d5-96d4-66f4cedc2ec1 None admin] PATH_INFO: `/v3/projects/554f819c0ee841348da0445f933c4c69` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:09.297146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2503ca3-1c5e-46d5-96d4-66f4cedc2ec1 None admin] RBAC: Authorizing `identity:get_project(project_id=554f819c0ee841348da0445f933c4c69)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:09.298583 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2503ca3-1c5e-46d5-96d4-66f4cedc2ec1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:09.302429 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 207/433] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:18:09 2022] GET /identity/v3/projects/554f819c0ee841348da0445f933c4c69 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:09.312070 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2503ca3-1c5e-46d5-96d4-66f4cedc2ec1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:09.331840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098842cd-820f-4137-9f79-903a9df924f9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:09.336151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:09.382236 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb2cb4-75a0-455f-a73c-0aa78e8bbb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:09.383042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb2cb4-75a0-455f-a73c-0aa78e8bbb0f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:09.383397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb2cb4-75a0-455f-a73c-0aa78e8bbb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:09.383748 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb2cb4-75a0-455f-a73c-0aa78e8bbb0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:09.453502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2503ca3-1c5e-46d5-96d4-66f4cedc2ec1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:09.481469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb2cb4-75a0-455f-a73c-0aa78e8bbb0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:09.483763 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb2cb4-75a0-455f-a73c-0aa78e8bbb0f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:09.506279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb44205-c4ab-47ec-94be-69922b71df48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:09.507123 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb44205-c4ab-47ec-94be-69922b71df48 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:09.507400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb44205-c4ab-47ec-94be-69922b71df48 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:09.507704 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb44205-c4ab-47ec-94be-69922b71df48 None admin] PATH_INFO: `/v3/groups/ee994d30d4784b6fa845b0b1db117752` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:09.508936 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb44205-c4ab-47ec-94be-69922b71df48 None admin] RBAC: Authorizing `identity:get_group(group_id=ee994d30d4784b6fa845b0b1db117752)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:09.510606 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb44205-c4ab-47ec-94be-69922b71df48 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:09.512044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 208/434] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 19 12:18:09 2022] GET /identity/v3/groups/ee994d30d4784b6fa845b0b1db117752 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:09.521319 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb44205-c4ab-47ec-94be-69922b71df48 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:09.568092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:09.634941 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 227/435] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:09.640853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:09.646550 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb2cb4-75a0-455f-a73c-0aa78e8bbb0f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:09.660062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb44205-c4ab-47ec-94be-69922b71df48 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:09.704400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ade49-60a5-4781-a5c5-3dd6ebffd1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:09.705217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ade49-60a5-4781-a5c5-3dd6ebffd1df None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:09.705639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ade49-60a5-4781-a5c5-3dd6ebffd1df None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:09.706020 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ade49-60a5-4781-a5c5-3dd6ebffd1df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:09.707296 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ade49-60a5-4781-a5c5-3dd6ebffd1df None admin] RBAC: Adding query filter params (group.id=ee994d30d4784b6fa845b0b1db117752, role.id=b929adc09fcc41daaf5cf39de856c1b6, scope.project.id=554f819c0ee841348da0445f933c4c69) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:09.707711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ade49-60a5-4781-a5c5-3dd6ebffd1df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:09.709313 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ade49-60a5-4781-a5c5-3dd6ebffd1df None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:09.721312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 209/436] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 19 12:18:09 2022] GET /identity/v3/role_assignments?group.id=ee994d30d4784b6fa845b0b1db117752&scope.project.id=554f819c0ee841348da0445f933c4c69&role.id=b929adc09fcc41daaf5cf39de856c1b6 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:09.766145 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb2cb4-75a0-455f-a73c-0aa78e8bbb0f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:09.804739 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0913f-95bf-4485-a11b-cbc0f7e38b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:09.805651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0913f-95bf-4485-a11b-cbc0f7e38b54 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:09.805931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0913f-95bf-4485-a11b-cbc0f7e38b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:09.806206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0913f-95bf-4485-a11b-cbc0f7e38b54 None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:09.811934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0913f-95bf-4485-a11b-cbc0f7e38b54 None admin] RBAC: Authorizing `identity:get_project(project_id=5a14beb3e8e643bca9af26f2ac0062bb)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:09.813729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0913f-95bf-4485-a11b-cbc0f7e38b54 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:09.817093 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 228/437] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:18:09 2022] GET /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:09.822346 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ade49-60a5-4781-a5c5-3dd6ebffd1df None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:09.941855 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ade49-60a5-4781-a5c5-3dd6ebffd1df None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:09.955263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de8850-8f64-4070-9d26-b614e60f4ce3 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:09.956065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de8850-8f64-4070-9d26-b614e60f4ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:09.956351 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de8850-8f64-4070-9d26-b614e60f4ce3 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:09.957874 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 229/438] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:09.964740 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a2f04-b7fa-4d52-806a-b9fc6cb0a136 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:09.965025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a2f04-b7fa-4d52-806a-b9fc6cb0a136 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:09.965305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a2f04-b7fa-4d52-806a-b9fc6cb0a136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:09.987673 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf57cb-4e1d-4d70-812b-0ec5f070d399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:09.988950 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf57cb-4e1d-4d70-812b-0ec5f070d399 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:09.989088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-978a2f04-b7fa-4d52-806a-b9fc6cb0a136 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:09.989537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf57cb-4e1d-4d70-812b-0ec5f070d399 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:09.989957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf57cb-4e1d-4d70-812b-0ec5f070d399 None admin] PATH_INFO: `/v3/groups/ee994d30d4784b6fa845b0b1db117752` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:09.990176 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-978a2f04-b7fa-4d52-806a-b9fc6cb0a136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:09.991512 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf57cb-4e1d-4d70-812b-0ec5f070d399 None admin] RBAC: Authorizing `identity:get_group(group_id=ee994d30d4784b6fa845b0b1db117752)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:09.994518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf57cb-4e1d-4d70-812b-0ec5f070d399 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:09.996465 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 210/439] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 19 12:18:09 2022] GET /identity/v3/groups/ee994d30d4784b6fa845b0b1db117752 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:10.003552 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf57cb-4e1d-4d70-812b-0ec5f070d399 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:10.013313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:10.028843 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:10.077819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 230/440] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:10.101438 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a2f04-b7fa-4d52-806a-b9fc6cb0a136 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:10.134086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf57cb-4e1d-4d70-812b-0ec5f070d399 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:10.178492 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbd35a-bdeb-4d41-a9e4-dd8e0289fc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:10.179207 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbd35a-bdeb-4d41-a9e4-dd8e0289fc3b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:10.179491 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbd35a-bdeb-4d41-a9e4-dd8e0289fc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:10.180650 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbd35a-bdeb-4d41-a9e4-dd8e0289fc3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:10.180650 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbd35a-bdeb-4d41-a9e4-dd8e0289fc3b None admin] RBAC: Adding query filter params (group.id=ee994d30d4784b6fa845b0b1db117752, role.id=61c33763c453452d82531c56aeb67287, scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:10.180902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbd35a-bdeb-4d41-a9e4-dd8e0289fc3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:10.182336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbd35a-bdeb-4d41-a9e4-dd8e0289fc3b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:10.188855 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 211/441] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 19 12:18:10 2022] GET /identity/v3/role_assignments?group.id=ee994d30d4784b6fa845b0b1db117752&scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb&role.id=61c33763c453452d82531c56aeb67287 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:10.229904 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a2f04-b7fa-4d52-806a-b9fc6cb0a136 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:10.271456 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44a308-e16a-4c55-ae86-535590551867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:10.272284 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44a308-e16a-4c55-ae86-535590551867 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:10.272564 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44a308-e16a-4c55-ae86-535590551867 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:10.272837 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44a308-e16a-4c55-ae86-535590551867 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:10.285182 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44a308-e16a-4c55-ae86-535590551867 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:10.293276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6b44a308-e16a-4c55-ae86-535590551867 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:18:10.293276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:10.293276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:10.293276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:10.293276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:10.293276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:10.293276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:10.293276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:10.293276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:10.293276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:10.293276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:10.293276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:10.293276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:10.293276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:10.293276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:10.293276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:10.294224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:10.294224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:10.294224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:10.294224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:10.294224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:10.294224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:10.294224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:10.294224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:10.294224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:10.294224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:10.294224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:10.294224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:10.294224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:10.294224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:10.294224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:10.294224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:10.295050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:10.295050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:10.295050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:10.295050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:10.295050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:10.295050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:10.295050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:10.295050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:10.295050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:10.295050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:10.295050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:18:10.295050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:10.295050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 231/442] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:18:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:10.301369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbd35a-bdeb-4d41-a9e4-dd8e0289fc3b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:10.374795 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf83176-62c8-4314-9355-9a4b80d27766 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:10.375085 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf83176-62c8-4314-9355-9a4b80d27766 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:10.375390 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf83176-62c8-4314-9355-9a4b80d27766 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:10.376801 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 232/443] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:18:10.382977 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb64de-80b4-46d4-bba2-658315245a32 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:10.383260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb64de-80b4-46d4-bba2-658315245a32 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:10.383533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb64de-80b4-46d4-bba2-658315245a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:10.399565 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:10.407144 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0edb64de-80b4-46d4-bba2-658315245a32 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:10.409333 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0edb64de-80b4-46d4-bba2-658315245a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:10.419893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:10.422026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbd35a-bdeb-4d41-a9e4-dd8e0289fc3b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:10.463423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4f034-8319-496f-8008-62a362602e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:10.464107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4f034-8319-496f-8008-62a362602e29 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:10.464395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4f034-8319-496f-8008-62a362602e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:10.464673 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4f034-8319-496f-8008-62a362602e29 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:10.465425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4f034-8319-496f-8008-62a362602e29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:10.465731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4f034-8319-496f-8008-62a362602e29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:10.467170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4f034-8319-496f-8008-62a362602e29 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:10.476725 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 212/444] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:10.482237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4f034-8319-496f-8008-62a362602e29 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:10.490516 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 233/445] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:18:10.514034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb64de-80b4-46d4-bba2-658315245a32 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:10.594958 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4f034-8319-496f-8008-62a362602e29 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:10.618506 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb64de-80b4-46d4-bba2-658315245a32 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:10.628245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828cf2a-2709-41c0-9bd3-4aafb67beafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:10.628897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828cf2a-2709-41c0-9bd3-4aafb67beafd None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:10.629191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828cf2a-2709-41c0-9bd3-4aafb67beafd None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:10.629462 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828cf2a-2709-41c0-9bd3-4aafb67beafd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:10.643739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:10.652421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9a6b4-864e-403b-a019-fc555a4baba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:10.653224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9a6b4-864e-403b-a019-fc555a4baba6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:10.653503 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9a6b4-864e-403b-a019-fc555a4baba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:10.653778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9a6b4-864e-403b-a019-fc555a4baba6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:10.664712 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9a6b4-864e-403b-a019-fc555a4baba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:10.672703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-66b9a6b4-864e-403b-a019-fc555a4baba6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:18:10.672703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:10.672703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:10.672703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:10.672703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:10.672703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:10.672703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:10.672703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:10.672703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:10.672703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:10.672703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:10.672703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:10.672703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:10.672703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:10.672703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:10.672703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:10.673594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:10.673594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:10.673594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:10.673594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:10.673594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:10.673594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:10.673594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:10.673594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:10.673594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:10.673594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:10.673594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:10.673594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:10.673594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:10.673594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:10.673594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:10.673594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:10.675094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:10.675094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:10.675094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:10.675094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:10.675094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:10.675094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:10.675094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:10.675094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:10.675094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:10.675094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:10.675094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:18:10.675094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:10.675094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 234/446] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:18:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:10.680353 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9a6b4-864e-403b-a019-fc555a4baba6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:10.690441 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:10.699674 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828cf2a-2709-41c0-9bd3-4aafb67beafd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:10.701030 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828cf2a-2709-41c0-9bd3-4aafb67beafd None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:10.780491 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9a6b4-864e-403b-a019-fc555a4baba6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:10.801356 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 213/447] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:10.806532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828cf2a-2709-41c0-9bd3-4aafb67beafd None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:10.815541 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8da7a7-9584-40b9-9fff-cc96f3871b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:10.816207 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8da7a7-9584-40b9-9fff-cc96f3871b29 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:10.816516 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8da7a7-9584-40b9-9fff-cc96f3871b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:10.816791 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8da7a7-9584-40b9-9fff-cc96f3871b29 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:10.817537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8da7a7-9584-40b9-9fff-cc96f3871b29 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:10.817839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8da7a7-9584-40b9-9fff-cc96f3871b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:10.819281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8da7a7-9584-40b9-9fff-cc96f3871b29 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:10.827248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 235/448] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:10.833136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8da7a7-9584-40b9-9fff-cc96f3871b29 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:10.854996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:10.898311 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:10.909763 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828cf2a-2709-41c0-9bd3-4aafb67beafd None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:10.934362 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8da7a7-9584-40b9-9fff-cc96f3871b29 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:10.942619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8c932-7f8c-45f9-940d-4d37f59d6075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:10.943499 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8c932-7f8c-45f9-940d-4d37f59d6075 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:10.943781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8c932-7f8c-45f9-940d-4d37f59d6075 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:10.944063 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8c932-7f8c-45f9-940d-4d37f59d6075 None admin] PATH_INFO: `/v3/projects/0a118b268db6472d8ac22365fb14ce5a` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:10.945256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8c932-7f8c-45f9-940d-4d37f59d6075 None admin] RBAC: Authorizing `identity:get_project(project_id=0a118b268db6472d8ac22365fb14ce5a)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:10.946699 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8c932-7f8c-45f9-940d-4d37f59d6075 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:10.953036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 214/449] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:18:10 2022] GET /identity/v3/projects/0a118b268db6472d8ac22365fb14ce5a => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:10.953949 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8c932-7f8c-45f9-940d-4d37f59d6075 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:10.969932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbed7b6-5389-47e8-8219-87d5013f2f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:10.970582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbed7b6-5389-47e8-8219-87d5013f2f1c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:10.971476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbed7b6-5389-47e8-8219-87d5013f2f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:10.971750 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbed7b6-5389-47e8-8219-87d5013f2f1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:11.039422 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbed7b6-5389-47e8-8219-87d5013f2f1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:11.040899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbed7b6-5389-47e8-8219-87d5013f2f1c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:11.054061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8c932-7f8c-45f9-940d-4d37f59d6075 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:11.068039 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:11.089514 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff2202-169d-4ced-9b26-322cbe258866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:11.090366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff2202-169d-4ced-9b26-322cbe258866 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:11.090648 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff2202-169d-4ced-9b26-322cbe258866 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:11.090949 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff2202-169d-4ced-9b26-322cbe258866 None admin] PATH_INFO: `/v3/groups/2a4b84cba80848919a5dc29874ce3983` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:11.092148 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff2202-169d-4ced-9b26-322cbe258866 None admin] RBAC: Authorizing `identity:get_group(group_id=2a4b84cba80848919a5dc29874ce3983)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:11.093575 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff2202-169d-4ced-9b26-322cbe258866 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:11.095254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 215/450] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 19 12:18:10 2022] GET /identity/v3/groups/2a4b84cba80848919a5dc29874ce3983 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:11.101771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff2202-169d-4ced-9b26-322cbe258866 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:11.104808 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:11.140326 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 236/451] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 12:18:11.146301 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbed7b6-5389-47e8-8219-87d5013f2f1c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:11.201792 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff2202-169d-4ced-9b26-322cbe258866 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:11.236189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318519d1-6bb9-431d-a9ab-aeb2caf8a449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:11.236867 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318519d1-6bb9-431d-a9ab-aeb2caf8a449 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:11.237150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318519d1-6bb9-431d-a9ab-aeb2caf8a449 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:11.237421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318519d1-6bb9-431d-a9ab-aeb2caf8a449 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:11.238253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318519d1-6bb9-431d-a9ab-aeb2caf8a449 None admin] RBAC: Adding query filter params (group.id=2a4b84cba80848919a5dc29874ce3983, role.id=386cb814e8464fda8832b13c75eabdaf, scope.project.id=0a118b268db6472d8ac22365fb14ce5a) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:11.238560 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318519d1-6bb9-431d-a9ab-aeb2caf8a449 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:11.240033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318519d1-6bb9-431d-a9ab-aeb2caf8a449 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:11.243422 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbed7b6-5389-47e8-8219-87d5013f2f1c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:11.245797 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 216/452] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 19 12:18:11 2022] GET /identity/v3/role_assignments?group.id=2a4b84cba80848919a5dc29874ce3983&scope.project.id=0a118b268db6472d8ac22365fb14ce5a&role.id=386cb814e8464fda8832b13c75eabdaf => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:11.281152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c01687-a7ad-4a0b-b300-96af6ec4bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:11.282027 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c01687-a7ad-4a0b-b300-96af6ec4bbcf None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:11.282306 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c01687-a7ad-4a0b-b300-96af6ec4bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:11.282579 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c01687-a7ad-4a0b-b300-96af6ec4bbcf None admin] PATH_INFO: `/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:11.283908 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c01687-a7ad-4a0b-b300-96af6ec4bbcf None admin] RBAC: Authorizing `identity:get_project(project_id=5a14beb3e8e643bca9af26f2ac0062bb)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:11.285381 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c01687-a7ad-4a0b-b300-96af6ec4bbcf None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:11.287156 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 237/453] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:18:11 2022] GET /identity/v3/projects/5a14beb3e8e643bca9af26f2ac0062bb => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:11.293055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318519d1-6bb9-431d-a9ab-aeb2caf8a449 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:11.346995 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:11.404746 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318519d1-6bb9-431d-a9ab-aeb2caf8a449 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:11.439811 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab918688-37cb-4202-8b67-b33adfa3098f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:11.440681 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab918688-37cb-4202-8b67-b33adfa3098f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:11.440963 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab918688-37cb-4202-8b67-b33adfa3098f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:11.441235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab918688-37cb-4202-8b67-b33adfa3098f None admin] PATH_INFO: `/v3/groups/ee994d30d4784b6fa845b0b1db117752` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:11.442424 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab918688-37cb-4202-8b67-b33adfa3098f None admin] RBAC: Authorizing `identity:get_group(group_id=ee994d30d4784b6fa845b0b1db117752)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:11.443929 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab918688-37cb-4202-8b67-b33adfa3098f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:11.445703 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 217/454] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Jul 19 12:18:11 2022] GET /identity/v3/groups/ee994d30d4784b6fa845b0b1db117752 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:11.451611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c01687-a7ad-4a0b-b300-96af6ec4bbcf None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:11.485527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:11.551197 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c01687-a7ad-4a0b-b300-96af6ec4bbcf None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:11.584562 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedcc16-a20f-4017-b1fe-d9bc19afe6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:11.585207 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedcc16-a20f-4017-b1fe-d9bc19afe6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:11.585486 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedcc16-a20f-4017-b1fe-d9bc19afe6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:11.585759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedcc16-a20f-4017-b1fe-d9bc19afe6d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:11.586579 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedcc16-a20f-4017-b1fe-d9bc19afe6d8 None admin] RBAC: Adding query filter params (group.id=ee994d30d4784b6fa845b0b1db117752, role.id=b929adc09fcc41daaf5cf39de856c1b6, scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:11.586920 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedcc16-a20f-4017-b1fe-d9bc19afe6d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:11.588338 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedcc16-a20f-4017-b1fe-d9bc19afe6d8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:11.593998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 238/455] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Jul 19 12:18:11 2022] GET /identity/v3/role_assignments?group.id=ee994d30d4784b6fa845b0b1db117752&scope.project.id=5a14beb3e8e643bca9af26f2ac0062bb&role.id=b929adc09fcc41daaf5cf39de856c1b6 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:14.234338 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fd394-761a-4a19-9c48-da63d471e4cc None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:14.234338 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fd394-761a-4a19-9c48-da63d471e4cc None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:14.234338 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fd394-761a-4a19-9c48-da63d471e4cc None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:14.234338 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 218/456] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:18:14.252943 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43fe66-5a23-4176-bb66-73f50bf46e0b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:14.253456 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43fe66-5a23-4176-bb66-73f50bf46e0b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:14.253456 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43fe66-5a23-4176-bb66-73f50bf46e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:14.278819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2a43fe66-5a23-4176-bb66-73f50bf46e0b None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:14.280009 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2a43fe66-5a23-4176-bb66-73f50bf46e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:14.374900 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98056282-3c63-4aef-84c5-9eca94ec7aef None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:14.375226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98056282-3c63-4aef-84c5-9eca94ec7aef None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:14.375450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98056282-3c63-4aef-84c5-9eca94ec7aef None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:14.377644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 219/457] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:14.383276 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11161d93-ca47-4776-8adc-2effc3ba2d4b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:14.383832 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11161d93-ca47-4776-8adc-2effc3ba2d4b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:14.384423 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 239/458] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:14.384716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11161d93-ca47-4776-8adc-2effc3ba2d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:14.410055 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43fe66-5a23-4176-bb66-73f50bf46e0b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:14.414107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-11161d93-ca47-4776-8adc-2effc3ba2d4b None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:14.419377 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-11161d93-ca47-4776-8adc-2effc3ba2d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:14.458956 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:14.531992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 220/459] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:14.533920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8475301-b43e-4e22-8a01-308c14376b66 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:14.534410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8475301-b43e-4e22-8a01-308c14376b66 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:14.534921 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8475301-b43e-4e22-8a01-308c14376b66 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:14.536495 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 221/460] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:14.543804 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90746764-c2cb-4e97-8226-86bc01bf319a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:14.544332 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90746764-c2cb-4e97-8226-86bc01bf319a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:14.544796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90746764-c2cb-4e97-8226-86bc01bf319a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:14.550505 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43fe66-5a23-4176-bb66-73f50bf46e0b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:14.568731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-90746764-c2cb-4e97-8226-86bc01bf319a None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:14.570248 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-90746764-c2cb-4e97-8226-86bc01bf319a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:14.599391 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74440559-ad21-48d4-8f29-3d2b7d453114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:14.600171 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74440559-ad21-48d4-8f29-3d2b7d453114 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:14.600755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74440559-ad21-48d4-8f29-3d2b7d453114 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:14.601231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74440559-ad21-48d4-8f29-3d2b7d453114 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:14.615634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74440559-ad21-48d4-8f29-3d2b7d453114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:14.617564 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74440559-ad21-48d4-8f29-3d2b7d453114 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:14.618775 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:14.646080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-74440559-ad21-48d4-8f29-3d2b7d453114 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:14.646080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:14.646080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:14.646080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:14.646080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:14.646080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:14.646080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:14.646080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:14.646080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:14.646080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:14.646080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:14.646080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:14.646080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:14.646080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:14.646080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:14.647014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:14.647014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:14.647014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:14.647014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:14.647014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:14.647014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:14.647014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:14.647014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:14.647014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:14.647014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:14.647014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:14.647014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:14.647014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:14.647014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:14.647014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:14.647014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:14.647014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:14.647934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:14.647934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:14.647934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:14.647934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:14.650132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 240/461] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:14.654893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74440559-ad21-48d4-8f29-3d2b7d453114 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:14.664500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 222/462] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:14.665367 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90746764-c2cb-4e97-8226-86bc01bf319a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:14.764772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:14.787821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74440559-ad21-48d4-8f29-3d2b7d453114 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:14.805593 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90746764-c2cb-4e97-8226-86bc01bf319a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:14.828335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47cac1-4a51-49dd-a654-f139a2094734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:14.829396 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47cac1-4a51-49dd-a654-f139a2094734 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:14.829824 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47cac1-4a51-49dd-a654-f139a2094734 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:14.830836 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47cac1-4a51-49dd-a654-f139a2094734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:14.842311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff2f96-fe11-49be-aa0d-979ba9c36cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:14.842705 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47cac1-4a51-49dd-a654-f139a2094734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:14.843384 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff2f96-fe11-49be-aa0d-979ba9c36cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:14.843802 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff2f96-fe11-49be-aa0d-979ba9c36cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:14.844202 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47cac1-4a51-49dd-a654-f139a2094734 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:14.844329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff2f96-fe11-49be-aa0d-979ba9c36cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:14.845163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff2f96-fe11-49be-aa0d-979ba9c36cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:14.845644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff2f96-fe11-49be-aa0d-979ba9c36cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:14.847463 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff2f96-fe11-49be-aa0d-979ba9c36cd7 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:14.864649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-aa47cac1-4a51-49dd-a654-f139a2094734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:14.864649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:14.864649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:14.864649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:14.864649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:14.864649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:14.864649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:14.864649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:14.864649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:14.864649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:14.864649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:14.864649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:14.864649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:14.864649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:14.864649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:14.865729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:14.865729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:14.865729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:14.865729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:14.865729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:14.865729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:14.865729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:14.865729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:14.865729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:14.865729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:14.865729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:14.865729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:14.865729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:14.865729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:14.865729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:14.865729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:14.865729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:14.866724 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:14.866724 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:14.866724 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:14.866724 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:14.866967 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 223/463] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:14.866967 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff2f96-fe11-49be-aa0d-979ba9c36cd7 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:14.868748 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 241/464] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:14.869746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47cac1-4a51-49dd-a654-f139a2094734 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:14.904120 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:14.977769 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47cac1-4a51-49dd-a654-f139a2094734 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:14.981917 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff2f96-fe11-49be-aa0d-979ba9c36cd7 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:15.009761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:15.016064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bedd1-7b1c-4cf3-a4f3-f4f6ffe9fcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:15.016723 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bedd1-7b1c-4cf3-a4f3-f4f6ffe9fcf4 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:15.016995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bedd1-7b1c-4cf3-a4f3-f4f6ffe9fcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:15.017261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bedd1-7b1c-4cf3-a4f3-f4f6ffe9fcf4 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:15.018770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bedd1-7b1c-4cf3-a4f3-f4f6ffe9fcf4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:15.019928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f725c-24d3-43f9-be4e-548bd6d688b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:15.020373 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bedd1-7b1c-4cf3-a4f3-f4f6ffe9fcf4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:15.020724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f725c-24d3-43f9-be4e-548bd6d688b4 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:15.021009 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f725c-24d3-43f9-be4e-548bd6d688b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:15.021283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f725c-24d3-43f9-be4e-548bd6d688b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:15.032779 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f725c-24d3-43f9-be4e-548bd6d688b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:15.034532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f725c-24d3-43f9-be4e-548bd6d688b4 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:15.041498 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 242/465] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 19 12:18:14 2022] POST /identity/v3/users => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:18:15.044029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bedd1-7b1c-4cf3-a4f3-f4f6ffe9fcf4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:15.066460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-782f725c-24d3-43f9-be4e-548bd6d688b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:15.066460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:15.066460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:15.066460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:15.066460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:15.066460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:15.066460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:15.066460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:15.066460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:15.066460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:15.066460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:15.066460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:15.066460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:15.066460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:15.066460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:15.067421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:15.067421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:15.067421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:15.067421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:15.067421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:15.067421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:15.067421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:15.067421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:15.067421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:15.067421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:15.067421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:15.067421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:15.067421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:15.067421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:15.067421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:15.067421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:15.067421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:15.068253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:15.068253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:15.068253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:15.068253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:15.068253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 224/466] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:15.072238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4dd06-e1d7-4699-a313-17c2147a1dca None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:15.072830 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4dd06-e1d7-4699-a313-17c2147a1dca None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:15.073353 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4dd06-e1d7-4699-a313-17c2147a1dca None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:15.078270 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 225/467] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:15.079172 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4dd06-e1d7-4699-a313-17c2147a1dca None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:15.180519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bedd1-7b1c-4cf3-a4f3-f4f6ffe9fcf4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:15.196600 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:15.220089 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4dd06-e1d7-4699-a313-17c2147a1dca None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:15.229867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644725c-bd03-4a83-9b00-c35d63c88d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:15.230554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644725c-bd03-4a83-9b00-c35d63c88d55 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:15.230879 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644725c-bd03-4a83-9b00-c35d63c88d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:15.231155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644725c-bd03-4a83-9b00-c35d63c88d55 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:15.231977 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644725c-bd03-4a83-9b00-c35d63c88d55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:15.232933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644725c-bd03-4a83-9b00-c35d63c88d55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:15.234088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644725c-bd03-4a83-9b00-c35d63c88d55 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:15.250813 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 243/468] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:15.251370 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258535a2-6ddb-4a96-ad90-9ea548fec0d6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:15.251658 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258535a2-6ddb-4a96-ad90-9ea548fec0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:15.252464 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258535a2-6ddb-4a96-ad90-9ea548fec0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:15.272134 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6feac6-a29c-4399-953b-f26d1efb2f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:15.273359 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6feac6-a29c-4399-953b-f26d1efb2f90 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:15.273780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6feac6-a29c-4399-953b-f26d1efb2f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:15.274186 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6feac6-a29c-4399-953b-f26d1efb2f90 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:15.275122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6feac6-a29c-4399-953b-f26d1efb2f90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:15.275393 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-258535a2-6ddb-4a96-ad90-9ea548fec0d6 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:15.276012 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6feac6-a29c-4399-953b-f26d1efb2f90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:15.276666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-258535a2-6ddb-4a96-ad90-9ea548fec0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:15.277665 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6feac6-a29c-4399-953b-f26d1efb2f90 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:15.296344 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 226/469] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:15.297684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6feac6-a29c-4399-953b-f26d1efb2f90 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:15.355334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:15.370056 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 244/470] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:15.375069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258535a2-6ddb-4a96-ad90-9ea548fec0d6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:15.422563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6feac6-a29c-4399-953b-f26d1efb2f90 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:15.464550 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c23b32-d99b-44a4-84ec-d6d92b6b15d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:15.465470 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c23b32-d99b-44a4-84ec-d6d92b6b15d6 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:15.465890 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c23b32-d99b-44a4-84ec-d6d92b6b15d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:15.466348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c23b32-d99b-44a4-84ec-d6d92b6b15d6 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:15.467326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c23b32-d99b-44a4-84ec-d6d92b6b15d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:15.468921 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c23b32-d99b-44a4-84ec-d6d92b6b15d6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:15.487812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:15.495624 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 227/471] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 19 12:18:15 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:18:15.497006 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c23b32-d99b-44a4-84ec-d6d92b6b15d6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:15.508452 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258535a2-6ddb-4a96-ad90-9ea548fec0d6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:15.549500 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628ec0e-1c5e-4f68-81b0-94f216888c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:15.550191 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628ec0e-1c5e-4f68-81b0-94f216888c07 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:15.550475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628ec0e-1c5e-4f68-81b0-94f216888c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:15.550762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628ec0e-1c5e-4f68-81b0-94f216888c07 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:15.551515 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628ec0e-1c5e-4f68-81b0-94f216888c07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:15.553055 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628ec0e-1c5e-4f68-81b0-94f216888c07 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:15.578437 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 245/472] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 19 12:18:15 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:18:15.637328 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c23b32-d99b-44a4-84ec-d6d92b6b15d6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:15.701750 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3043aee-55af-47eb-a1ba-f80b8b2c2aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:15.702774 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3043aee-55af-47eb-a1ba-f80b8b2c2aff None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:15.702774 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3043aee-55af-47eb-a1ba-f80b8b2c2aff None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:15.702774 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3043aee-55af-47eb-a1ba-f80b8b2c2aff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:15.724359 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3043aee-55af-47eb-a1ba-f80b8b2c2aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:15.725825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3043aee-55af-47eb-a1ba-f80b8b2c2aff None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:15.731465 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5501bc-84f8-433a-916f-9b49c4d6cda8 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:15.731779 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5501bc-84f8-433a-916f-9b49c4d6cda8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:15.732024 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5501bc-84f8-433a-916f-9b49c4d6cda8 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:15.734543 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 246/473] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:18:15.742292 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd205a-b9fc-4a87-b03c-411903fcb3ed None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:15.742594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd205a-b9fc-4a87-b03c-411903fcb3ed None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:15.742892 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd205a-b9fc-4a87-b03c-411903fcb3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:15.746598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-d3043aee-55af-47eb-a1ba-f80b8b2c2aff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:15.746598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:15.746598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:15.746598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:15.746598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:15.746598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:15.746598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:15.746598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:15.746598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:15.746598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:15.746598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:15.746598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:15.746598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:15.746598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:15.746598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:15.747450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:15.747450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:15.747450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:15.747450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:15.747450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:15.747450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:15.747450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:15.747450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:15.747450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:15.747450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:15.747450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:15.747450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:15.747450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:15.747450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:15.747450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:15.747450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:15.747450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:15.748266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:15.748266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:15.748266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:15.748266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:15.748266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 228/474] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:15.755630 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3043aee-55af-47eb-a1ba-f80b8b2c2aff None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:15.768634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0ffd205a-b9fc-4a87-b03c-411903fcb3ed None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:15.769856 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0ffd205a-b9fc-4a87-b03c-411903fcb3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:15.803081 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:15.833959 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:15.857650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 247/475] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:15.882046 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd205a-b9fc-4a87-b03c-411903fcb3ed None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:15.890452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3043aee-55af-47eb-a1ba-f80b8b2c2aff None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:15.931547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52c6c2-74a9-4757-885f-048b32fcae75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:15.932458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52c6c2-74a9-4757-885f-048b32fcae75 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:15.932905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52c6c2-74a9-4757-885f-048b32fcae75 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:15.933317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52c6c2-74a9-4757-885f-048b32fcae75 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:15.934244 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52c6c2-74a9-4757-885f-048b32fcae75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:15.934684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52c6c2-74a9-4757-885f-048b32fcae75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:15.936222 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52c6c2-74a9-4757-885f-048b32fcae75 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:15.954106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 229/476] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:15.961923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52c6c2-74a9-4757-885f-048b32fcae75 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:16.018934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd205a-b9fc-4a87-b03c-411903fcb3ed None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:16.059644 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041c50d-2add-4f4f-a1ff-62ce2bbc895f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:16.059644 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041c50d-2add-4f4f-a1ff-62ce2bbc895f None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:16.059903 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041c50d-2add-4f4f-a1ff-62ce2bbc895f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:16.060098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041c50d-2add-4f4f-a1ff-62ce2bbc895f None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:16.060843 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041c50d-2add-4f4f-a1ff-62ce2bbc895f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:16.062207 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041c50d-2add-4f4f-a1ff-62ce2bbc895f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:16.083049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.sql.core [None req-6041c50d-2add-4f4f-a1ff-62ce2bbc895f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 12:18:16.083049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 19 12:18:16.083049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [parameters: {'id': '2ba31c0c374f44cebd1336b24139a95d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 19 12:18:16.083049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80231) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 12:18:16.092736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52c6c2-74a9-4757-885f-048b32fcae75 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:16.107871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6041c50d-2add-4f4f-a1ff-62ce2bbc895f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 19 12:18:16.107871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:16.107871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 12:18:16.107871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 12:18:16.107871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 12:18:16.107871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 12:18:16.107871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 12:18:16.107871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 12:18:16.107871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 12:18:16.107871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application conn.query(q) Jul 19 12:18:16.107871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 12:18:16.107871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 12:18:16.107871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 12:18:16.107871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result.read() Jul 19 12:18:16.107871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 12:18:16.109041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 12:18:16.109041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 12:18:16.109041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 12:18:16.109041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 12:18:16.109041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 12:18:16.109041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 12:18:16.109041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 12:18:16.109041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 12:18:16.109041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:16.109041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 12:18:16.109041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:16.109041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:16.109041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 12:18:16.109041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 12:18:16.109041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 19 12:18:16.109041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return ref.to_dict() Jul 19 12:18:16.109041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 12:18:16.109041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application next(self.gen) Jul 19 12:18:16.110146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 12:18:16.110146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application yield resource Jul 19 12:18:16.110146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 12:18:16.110146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application next(self.gen) Jul 19 12:18:16.110146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 12:18:16.110146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 12:18:16.110146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 12:18:16.110146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 12:18:16.110146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 12:18:16.110146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise self.value Jul 19 12:18:16.110146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 12:18:16.110146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 12:18:16.110146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 12:18:16.110146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application session.commit() Jul 19 12:18:16.110146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 12:18:16.110146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 12:18:16.110146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 12:18:16.111095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 12:18:16.111095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 12:18:16.111095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.session.flush() Jul 19 12:18:16.111095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 12:18:16.111095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 12:18:16.111095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 12:18:16.111095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 12:18:16.111095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 12:18:16.111095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application compat.raise_( Jul 19 12:18:16.111095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 12:18:16.111095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception Jul 19 12:18:16.111095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 12:18:16.111095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 12:18:16.111095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 12:18:16.111095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 12:18:16.111095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 12:18:16.111095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 12:18:16.112617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 12:18:16.112617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 12:18:16.112617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 19 12:18:16.112617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 19 12:18:16.112617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 12:18:16.112617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 12:18:16.112617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 12:18:16.112617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 12:18:16.112617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 12:18:16.112617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 12:18:16.112617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 12:18:16.112617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 12:18:16.112617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 12:18:16.112617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 12:18:16.112617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 12:18:16.112617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception Jul 19 12:18:16.113386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 12:18:16.113386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 12:18:16.113386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 12:18:16.113386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 12:18:16.113386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 12:18:16.113386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 12:18:16.113386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 12:18:16.113386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application conn.query(q) Jul 19 12:18:16.113386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 12:18:16.113386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 12:18:16.113386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 12:18:16.113386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result.read() Jul 19 12:18:16.113386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 12:18:16.113386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 12:18:16.113386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 12:18:16.113386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 12:18:16.114140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 12:18:16.114140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 12:18:16.114140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 12:18:16.114140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 12:18:16.114140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 12:18:16.114140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 19 12:18:16.114140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [parameters: {'id': '2ba31c0c374f44cebd1336b24139a95d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 19 12:18:16.114140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 12:18:16.114140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:16.114140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:18:16.114140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:16.114140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:16.114140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:16.114140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:16.114140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:16.114140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:16.114931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:16.114931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:16.114931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:16.114931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:16.114931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:16.114931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:16.114931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 19 12:18:16.114931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 19 12:18:16.114931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:16.114931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:16.114931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 19 12:18:16.114931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 19 12:18:16.114931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 12:18:16.114931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 12:18:16.114931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 19 12:18:16.114931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:16.116023 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:16.116104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 248/477] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Jul 19 12:18:15 2022] POST /identity/v3/roles => generated 144 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:16.121638 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041c50d-2add-4f4f-a1ff-62ce2bbc895f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:16.139772 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c374c8-2c4c-4792-842e-d66a49e168fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:16.140718 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c374c8-2c4c-4792-842e-d66a49e168fe None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:16.141215 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c374c8-2c4c-4792-842e-d66a49e168fe None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:16.141625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c374c8-2c4c-4792-842e-d66a49e168fe None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:16.143004 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c374c8-2c4c-4792-842e-d66a49e168fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:16.144618 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c374c8-2c4c-4792-842e-d66a49e168fe None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:16.169252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 230/478] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 19 12:18:15 2022] POST /identity/v3/users => generated 249 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:18:16.190942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:16.274893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041c50d-2add-4f4f-a1ff-62ce2bbc895f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:16.312911 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab62f0c-ee04-4aee-bab6-cf243d6714de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:16.314406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab62f0c-ee04-4aee-bab6-cf243d6714de None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:16.314886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab62f0c-ee04-4aee-bab6-cf243d6714de None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:16.315322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab62f0c-ee04-4aee-bab6-cf243d6714de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:16.326693 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab62f0c-ee04-4aee-bab6-cf243d6714de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:16.335861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-eab62f0c-ee04-4aee-bab6-cf243d6714de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:18:16.335861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:16.335861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:16.335861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:16.335861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:16.335861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:16.335861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:16.335861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:16.335861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:16.335861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:16.335861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:16.335861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:16.335861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:16.335861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:16.335861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:16.335861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:16.336959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:16.336959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:16.336959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:16.336959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:16.336959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:16.336959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:16.336959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:16.336959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:16.336959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:16.336959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:16.336959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:16.336959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:16.336959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:16.336959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:16.336959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:16.336959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:16.337950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:16.337950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:16.337950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:16.337950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:16.337950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:16.337950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:16.337950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:16.337950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:16.337950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:16.337950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:16.337950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 12:18:16.337950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:16.340506 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 249/479] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:18:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:16.348784 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c374c8-2c4c-4792-842e-d66a49e168fe None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:16.462694 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c374c8-2c4c-4792-842e-d66a49e168fe None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:16.497868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa856d-be5e-4a9e-8b2d-f8ef341f9172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:16.498797 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa856d-be5e-4a9e-8b2d-f8ef341f9172 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:16.499217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa856d-be5e-4a9e-8b2d-f8ef341f9172 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:16.499652 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa856d-be5e-4a9e-8b2d-f8ef341f9172 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:16.500535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa856d-be5e-4a9e-8b2d-f8ef341f9172 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:16.500978 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa856d-be5e-4a9e-8b2d-f8ef341f9172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:16.503244 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa856d-be5e-4a9e-8b2d-f8ef341f9172 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:16.512134 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 231/480] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:17.487239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26cf91-2ccf-4dc2-9980-ed4aaef53508 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:17.487781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26cf91-2ccf-4dc2-9980-ed4aaef53508 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:17.487781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26cf91-2ccf-4dc2-9980-ed4aaef53508 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:17.489385 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 250/481] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:17.494946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac4a9f-214e-415a-b12e-0f93f6ec24b6 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:17.495361 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac4a9f-214e-415a-b12e-0f93f6ec24b6 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:17.495547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac4a9f-214e-415a-b12e-0f93f6ec24b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:17.523178 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-5bac4a9f-214e-415a-b12e-0f93f6ec24b6 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:17.524389 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5bac4a9f-214e-415a-b12e-0f93f6ec24b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:17.554221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:17.607166 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 232/482] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:18:17.643810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26cf91-2ccf-4dc2-9980-ed4aaef53508 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:17.759285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:17.772335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26cf91-2ccf-4dc2-9980-ed4aaef53508 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:17.807610 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b6318-06db-400d-8236-c6b0c54d37e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:17.808416 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6318-06db-400d-8236-c6b0c54d37e8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:17.808698 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6318-06db-400d-8236-c6b0c54d37e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:17.808975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6318-06db-400d-8236-c6b0c54d37e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:17.819739 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b6318-06db-400d-8236-c6b0c54d37e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:17.827802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f47b6318-06db-400d-8236-c6b0c54d37e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:17.827802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:17.827802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:17.827802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:17.827802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:17.827802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:17.827802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:17.827802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:17.827802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:17.827802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:17.827802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:17.827802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:17.827802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:17.827802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:17.827802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:17.827802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:17.828749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:17.828749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:17.828749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:17.828749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:17.828749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:17.828749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:17.828749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:17.828749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:17.828749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:17.828749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:17.828749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:17.828749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:17.828749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:17.828749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:17.828749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:17.828749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:17.829527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:17.829527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:17.829527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:17.829527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:17.829527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:17.829527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:17.829527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:17.829527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:17.829527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:17.829527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:17.829527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:17.829527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:17.829527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 251/483] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:17.837645 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac4a9f-214e-415a-b12e-0f93f6ec24b6 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:18.007345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac4a9f-214e-415a-b12e-0f93f6ec24b6 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:18.062197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41ca29-cef9-47d2-840f-8d06fad5af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:18.062836 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41ca29-cef9-47d2-840f-8d06fad5af4c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:18.063122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41ca29-cef9-47d2-840f-8d06fad5af4c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:18.063398 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41ca29-cef9-47d2-840f-8d06fad5af4c None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:18.064162 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41ca29-cef9-47d2-840f-8d06fad5af4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:18.065000 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41ca29-cef9-47d2-840f-8d06fad5af4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:18.066517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41ca29-cef9-47d2-840f-8d06fad5af4c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:18.087744 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 233/484] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:18:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:18.093563 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b6318-06db-400d-8236-c6b0c54d37e8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:18.236283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b6318-06db-400d-8236-c6b0c54d37e8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:18.245199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e37da-9041-4f59-9ced-651a29fc0699 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:18.245771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e37da-9041-4f59-9ced-651a29fc0699 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:18.246236 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e37da-9041-4f59-9ced-651a29fc0699 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:18.248045 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 234/485] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:18.254032 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672be77-5f1c-4402-a1bb-9ca3b9518467 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:18.254330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672be77-5f1c-4402-a1bb-9ca3b9518467 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:18.254613 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672be77-5f1c-4402-a1bb-9ca3b9518467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:18.285222 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9672be77-5f1c-4402-a1bb-9ca3b9518467 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:18.287615 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9672be77-5f1c-4402-a1bb-9ca3b9518467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:18.291083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40191d44-833f-48f8-9302-c9f68579634d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:18.292121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40191d44-833f-48f8-9302-c9f68579634d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:18.292615 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40191d44-833f-48f8-9302-c9f68579634d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:18.293076 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40191d44-833f-48f8-9302-c9f68579634d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:18.310868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40191d44-833f-48f8-9302-c9f68579634d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:18.313885 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40191d44-833f-48f8-9302-c9f68579634d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:18.325680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:18.328837 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:18.344713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-40191d44-833f-48f8-9302-c9f68579634d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:18.344713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:18.344713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:18.344713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:18.344713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:18.344713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:18.344713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:18.344713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:18.344713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:18.344713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:18.344713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:18.344713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:18.344713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:18.344713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:18.344713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:18.346283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:18.346283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:18.346283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:18.346283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:18.346283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:18.346283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:18.346283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:18.346283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:18.346283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:18.346283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:18.346283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:18.346283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:18.346283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:18.346283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:18.346283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:18.346283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:18.346283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:18.347220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:18.347220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:18.347220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:18.347220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:18.353329 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 252/486] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:18.355113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404fa9a-63f5-4a79-9895-a7b21d688c96 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:18.355600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404fa9a-63f5-4a79-9895-a7b21d688c96 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:18.356125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404fa9a-63f5-4a79-9895-a7b21d688c96 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:18.358439 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 253/487] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:18.359642 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404fa9a-63f5-4a79-9895-a7b21d688c96 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:18.410456 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 235/488] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:18.418754 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b8924-23a0-49e2-9278-a43c656f6107 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:18.419335 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b8924-23a0-49e2-9278-a43c656f6107 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:18.419810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b8924-23a0-49e2-9278-a43c656f6107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:18.451263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c19b8924-23a0-49e2-9278-a43c656f6107 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:18.452770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c19b8924-23a0-49e2-9278-a43c656f6107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:18.484961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404fa9a-63f5-4a79-9895-a7b21d688c96 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:18.527809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d21ba-82a1-47d6-9579-1428e78fc080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:18.529252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d21ba-82a1-47d6-9579-1428e78fc080 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:18.529758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d21ba-82a1-47d6-9579-1428e78fc080 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:18.530219 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d21ba-82a1-47d6-9579-1428e78fc080 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:18.531160 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d21ba-82a1-47d6-9579-1428e78fc080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:18.531654 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d21ba-82a1-47d6-9579-1428e78fc080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:18.532269 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 236/489] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:18.533172 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b8924-23a0-49e2-9278-a43c656f6107 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:18.534252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d21ba-82a1-47d6-9579-1428e78fc080 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:18.559210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 254/490] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:18.565843 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d21ba-82a1-47d6-9579-1428e78fc080 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:18.636176 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:18.644200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:18.657719 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b8924-23a0-49e2-9278-a43c656f6107 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:18.702620 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d21ba-82a1-47d6-9579-1428e78fc080 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:18.704617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ee4d8-030b-4625-bb0e-8068a32c16ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:18.705825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ee4d8-030b-4625-bb0e-8068a32c16ad None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:18.706337 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ee4d8-030b-4625-bb0e-8068a32c16ad None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:18.706834 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ee4d8-030b-4625-bb0e-8068a32c16ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:18.718425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ee4d8-030b-4625-bb0e-8068a32c16ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:18.727326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-920ee4d8-030b-4625-bb0e-8068a32c16ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:18.727326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:18.727326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:18.727326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:18.727326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:18.727326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:18.727326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:18.727326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:18.727326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:18.727326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:18.727326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:18.727326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:18.727326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:18.727326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:18.727326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:18.727326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:18.728204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:18.728204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:18.728204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:18.728204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:18.728204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:18.728204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:18.728204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:18.728204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:18.728204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:18.728204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:18.728204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:18.728204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:18.728204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:18.728204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:18.728204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:18.728204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:18.728957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:18.728957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:18.728957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:18.728957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:18.728957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:18.728957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:18.728957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:18.728957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:18.728957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:18.728957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:18.728957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:18.728957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:18.736260 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 237/491] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:18.738110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ee4d8-030b-4625-bb0e-8068a32c16ad None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:18.743011 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9ee7c-a1f7-4ab3-9197-5ff048c3fcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:18.743815 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9ee7c-a1f7-4ab3-9197-5ff048c3fcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:18.744094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9ee7c-a1f7-4ab3-9197-5ff048c3fcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:18.744364 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9ee7c-a1f7-4ab3-9197-5ff048c3fcc0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:18.754375 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9ee7c-a1f7-4ab3-9197-5ff048c3fcc0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:18.756314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9ee7c-a1f7-4ab3-9197-5ff048c3fcc0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:18.774308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-13f9ee7c-a1f7-4ab3-9197-5ff048c3fcc0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 12:18:18.774308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:18.774308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:18.774308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:18.774308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:18.774308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:18.774308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:18.774308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:18.774308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:18.774308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:18.774308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:18.774308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:18.774308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:18.774308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:18.774308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:18.774308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:18.775242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:18.775242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:18.775242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:18.775242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:18.775242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:18.775242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:18.775242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:18.775242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:18.775242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:18.775242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:18.775242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:18.775242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:18.775242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:18.775242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:18.775242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:18.775242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:18.775242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:18.775242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:18.776104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:18.776104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:18.776104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:18.776104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:18.776104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:18.776104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:18.776104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:18.776104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:18.776104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 12:18:18.776104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:18.778583 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 255/492] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Jul 19 12:18:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:18.779709 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9ee7c-a1f7-4ab3-9197-5ff048c3fcc0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:18.874484 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ee4d8-030b-4625-bb0e-8068a32c16ad None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:18.894035 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9ee7c-a1f7-4ab3-9197-5ff048c3fcc0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:18.917418 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:18.920294 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2e906-3522-4a9b-a143-37f15305d81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:18.921939 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2e906-3522-4a9b-a143-37f15305d81c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:18.922217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2e906-3522-4a9b-a143-37f15305d81c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:18.922493 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2e906-3522-4a9b-a143-37f15305d81c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:18.937518 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890f66c-4ccb-4efd-942f-d15e0dbf7d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:18.937680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2e906-3522-4a9b-a143-37f15305d81c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:18.938652 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890f66c-4ccb-4efd-942f-d15e0dbf7d19 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:18.939178 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890f66c-4ccb-4efd-942f-d15e0dbf7d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:18.940221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890f66c-4ccb-4efd-942f-d15e0dbf7d19 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:18.941153 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890f66c-4ccb-4efd-942f-d15e0dbf7d19 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:18.941644 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890f66c-4ccb-4efd-942f-d15e0dbf7d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:18.943259 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890f66c-4ccb-4efd-942f-d15e0dbf7d19 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:18.946928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-15f2e906-3522-4a9b-a143-37f15305d81c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:18.946928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:18.946928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:18.946928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:18.946928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:18.946928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:18.946928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:18.946928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:18.946928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:18.946928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:18.946928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:18.946928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:18.946928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:18.946928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:18.946928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:18.946928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:18.947796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:18.947796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:18.947796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:18.947796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:18.947796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:18.947796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:18.947796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:18.947796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:18.947796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:18.947796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:18.947796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:18.947796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:18.947796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:18.947796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:18.947796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:18.947796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:18.948580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:18.948580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:18.948580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:18.948580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:18.948580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:18.948580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:18.948580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:18.948580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:18.948580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:18.948580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:18.948580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:18.948580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:18.953475 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 238/493] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:18.954626 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2e906-3522-4a9b-a143-37f15305d81c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:18.957195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 256/494] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:18:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:18.962164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:18.964238 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890f66c-4ccb-4efd-942f-d15e0dbf7d19 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:19.072651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890f66c-4ccb-4efd-942f-d15e0dbf7d19 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:19.075837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2e906-3522-4a9b-a143-37f15305d81c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:19.108069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa5d07-6f98-4f2a-89cb-93a923c3ebb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:19.108740 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa5d07-6f98-4f2a-89cb-93a923c3ebb5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:19.109019 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa5d07-6f98-4f2a-89cb-93a923c3ebb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:19.109289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa5d07-6f98-4f2a-89cb-93a923c3ebb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:19.110024 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa5d07-6f98-4f2a-89cb-93a923c3ebb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:19.110326 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa5d07-6f98-4f2a-89cb-93a923c3ebb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:19.111769 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa5d07-6f98-4f2a-89cb-93a923c3ebb5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:19.114953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58f2b0-38a7-4f00-9f26-8b3eece6c91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:19.115793 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58f2b0-38a7-4f00-9f26-8b3eece6c91a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:19.116223 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58f2b0-38a7-4f00-9f26-8b3eece6c91a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:19.116741 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58f2b0-38a7-4f00-9f26-8b3eece6c91a None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:19.117746 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58f2b0-38a7-4f00-9f26-8b3eece6c91a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:19.118255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58f2b0-38a7-4f00-9f26-8b3eece6c91a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:19.119904 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58f2b0-38a7-4f00-9f26-8b3eece6c91a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:19.120026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 257/495] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:18:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:19.120782 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa5d07-6f98-4f2a-89cb-93a923c3ebb5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:19.163442 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 239/496] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Jul 19 12:18:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:19.164810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccefc0-92f6-4dd4-84d6-fdd8a528e87c None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:19.165097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccefc0-92f6-4dd4-84d6-fdd8a528e87c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:19.165368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccefc0-92f6-4dd4-84d6-fdd8a528e87c None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:19.166814 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 240/497] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:19.167321 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccefc0-92f6-4dd4-84d6-fdd8a528e87c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:19.174957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:19.227631 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:19.231201 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa5d07-6f98-4f2a-89cb-93a923c3ebb5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:19.264270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba5af7-8680-4c99-84db-8c1c749740d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:19.265050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba5af7-8680-4c99-84db-8c1c749740d1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:19.265333 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba5af7-8680-4c99-84db-8c1c749740d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:19.265600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba5af7-8680-4c99-84db-8c1c749740d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:19.270152 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccefc0-92f6-4dd4-84d6-fdd8a528e87c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:19.276514 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba5af7-8680-4c99-84db-8c1c749740d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:19.277951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba5af7-8680-4c99-84db-8c1c749740d1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:19.295080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8fba5af7-8680-4c99-84db-8c1c749740d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:19.295080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:19.295080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:19.295080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:19.295080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:19.295080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:19.295080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:19.295080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:19.295080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:19.295080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:19.295080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:19.295080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:19.295080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:19.295080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:19.295080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:19.295996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:19.295996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:19.295996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:19.295996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:19.295996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:19.295996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:19.295996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:19.295996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:19.295996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:19.295996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:19.295996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:19.295996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:19.295996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:19.295996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:19.295996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:19.295996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:19.295996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:19.296828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:19.296828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:19.296828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:19.296828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:19.296828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 258/498] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:19.297410 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73afbe8-6183-4d09-9475-5d12373df9e2 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:19.297688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73afbe8-6183-4d09-9475-5d12373df9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:19.297952 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73afbe8-6183-4d09-9475-5d12373df9e2 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:19.299535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 259/499] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:19.299937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73afbe8-6183-4d09-9475-5d12373df9e2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:19.311110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2f1f3-cfd0-44c7-bd7f-b33f2a0f3b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:19.311909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2f1f3-cfd0-44c7-bd7f-b33f2a0f3b92 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:19.312191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2f1f3-cfd0-44c7-bd7f-b33f2a0f3b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:19.312465 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2f1f3-cfd0-44c7-bd7f-b33f2a0f3b92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:19.322716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2f1f3-cfd0-44c7-bd7f-b33f2a0f3b92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:19.324186 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2f1f3-cfd0-44c7-bd7f-b33f2a0f3b92 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:19.342174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-b9f2f1f3-cfd0-44c7-bd7f-b33f2a0f3b92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:19.342174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:19.342174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:19.342174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:19.342174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:19.342174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:19.342174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:19.342174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:19.342174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:19.342174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:19.342174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:19.342174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:19.342174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:19.342174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:19.342174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:19.343065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:19.343065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:19.343065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:19.343065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:19.343065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:19.343065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:19.343065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:19.343065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:19.343065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:19.343065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:19.343065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:19.343065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:19.343065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:19.343065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:19.343065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:19.343065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:19.343065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:19.343923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:19.343923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:19.343923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:19.343923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:19.343923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 241/500] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:19.345043 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51a775-cf28-489c-9ac2-b0dfe5eaaad5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:19.345332 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51a775-cf28-489c-9ac2-b0dfe5eaaad5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:19.345790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51a775-cf28-489c-9ac2-b0dfe5eaaad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:19.363071 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7d51a775-cf28-489c-9ac2-b0dfe5eaaad5 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:19.364279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7d51a775-cf28-489c-9ac2-b0dfe5eaaad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:19.400778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:19.407998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73afbe8-6183-4d09-9475-5d12373df9e2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:19.446757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 242/501] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:19.446757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51a775-cf28-489c-9ac2-b0dfe5eaaad5 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:19.454403 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdda02-66a3-4317-8564-16790c77ac66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:19.455763 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdda02-66a3-4317-8564-16790c77ac66 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:19.456131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdda02-66a3-4317-8564-16790c77ac66 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:19.456473 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdda02-66a3-4317-8564-16790c77ac66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:19.479335 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:19.526009 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdda02-66a3-4317-8564-16790c77ac66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:19.527487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdda02-66a3-4317-8564-16790c77ac66 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:19.536419 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51a775-cf28-489c-9ac2-b0dfe5eaaad5 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:19.570065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86094b9f-cafb-4b9a-8bcc-5f3cc696cbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:19.570751 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86094b9f-cafb-4b9a-8bcc-5f3cc696cbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:19.571043 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86094b9f-cafb-4b9a-8bcc-5f3cc696cbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:19.571315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86094b9f-cafb-4b9a-8bcc-5f3cc696cbd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:19.572027 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86094b9f-cafb-4b9a-8bcc-5f3cc696cbd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:19.572332 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86094b9f-cafb-4b9a-8bcc-5f3cc696cbd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:19.573699 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86094b9f-cafb-4b9a-8bcc-5f3cc696cbd9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:19.585638 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 243/502] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:19.586858 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40873a-7ec5-4215-82b5-40531104e4a2 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:19.587149 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40873a-7ec5-4215-82b5-40531104e4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:19.587432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40873a-7ec5-4215-82b5-40531104e4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:19.604401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0f40873a-7ec5-4215-82b5-40531104e4a2 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:19.605606 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0f40873a-7ec5-4215-82b5-40531104e4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:19.621969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:19.629408 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 260/503] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:19.630216 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdda02-66a3-4317-8564-16790c77ac66 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:19.671510 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 244/504] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:19.672246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40873a-7ec5-4215-82b5-40531104e4a2 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:19.710344 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:19.743188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdda02-66a3-4317-8564-16790c77ac66 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:19.777667 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0b23d-4e7e-4d91-b0b4-d0f3cc0545e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:19.778342 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0b23d-4e7e-4d91-b0b4-d0f3cc0545e4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:19.778498 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40873a-7ec5-4215-82b5-40531104e4a2 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:19.778618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0b23d-4e7e-4d91-b0b4-d0f3cc0545e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:19.778922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0b23d-4e7e-4d91-b0b4-d0f3cc0545e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:19.779627 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0b23d-4e7e-4d91-b0b4-d0f3cc0545e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:19.779926 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0b23d-4e7e-4d91-b0b4-d0f3cc0545e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:19.781282 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0b23d-4e7e-4d91-b0b4-d0f3cc0545e4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:19.792290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 261/505] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:19.793073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0b23d-4e7e-4d91-b0b4-d0f3cc0545e4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:19.812669 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0d279-f538-4848-b5cb-e2a04363f1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:19.813470 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d279-f538-4848-b5cb-e2a04363f1cc None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:19.813752 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d279-f538-4848-b5cb-e2a04363f1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:19.814028 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d279-f538-4848-b5cb-e2a04363f1cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:19.824788 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0d279-f538-4848-b5cb-e2a04363f1cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:19.832680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-54c0d279-f538-4848-b5cb-e2a04363f1cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:19.832680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:19.832680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:19.832680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:19.832680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:19.832680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:19.832680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:19.832680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:19.832680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:19.832680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:19.832680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:19.832680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:19.832680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:19.832680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:19.832680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:19.832680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:19.833641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:19.833641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:19.833641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:19.833641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:19.833641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:19.833641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:19.833641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:19.833641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:19.833641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:19.833641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:19.833641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:19.833641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:19.833641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:19.833641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:19.833641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:19.833641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:19.834407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:19.834407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:19.834407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:19.834407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:19.834407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:19.834407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:19.834407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:19.834407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:19.834407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:19.834407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:19.834407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:19.834407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:19.834407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 245/506] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:19.835430 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0d279-f538-4848-b5cb-e2a04363f1cc None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:19.849382 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:19.893278 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0b23d-4e7e-4d91-b0b4-d0f3cc0545e4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:19.927862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:19.928653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d93b4-e66e-425b-95dd-f913a1dddf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:19.929532 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d93b4-e66e-425b-95dd-f913a1dddf7d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:19.930042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d93b4-e66e-425b-95dd-f913a1dddf7d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:19.930399 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d93b4-e66e-425b-95dd-f913a1dddf7d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:19.937625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0d279-f538-4848-b5cb-e2a04363f1cc None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:19.938134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d93b4-e66e-425b-95dd-f913a1dddf7d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:19.939662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d93b4-e66e-425b-95dd-f913a1dddf7d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:19.953609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-1a2d93b4-e66e-425b-95dd-f913a1dddf7d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 12:18:19.953609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:19.953609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:19.953609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:19.953609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:19.953609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:19.953609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:19.953609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:19.953609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:19.953609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:19.953609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:19.953609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:19.953609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:19.953609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:19.953609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:19.953609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:19.954502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:19.954502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:19.954502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:19.954502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:19.954502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:19.954502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:19.954502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:19.954502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:19.954502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:19.954502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:19.954502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:19.954502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:19.954502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:19.954502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:19.954502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:19.954502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:19.954502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:19.954502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:19.956213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:19.956213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:19.956213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:19.956213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:19.956213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:19.956213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:19.956213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:19.956213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:19.956213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 12:18:19.956213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:19.956213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 262/507] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:19.956213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d93b4-e66e-425b-95dd-f913a1dddf7d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:19.975781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54356134-a9ca-4057-b37d-b7e34fa421a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:19.976579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54356134-a9ca-4057-b37d-b7e34fa421a5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:19.976858 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54356134-a9ca-4057-b37d-b7e34fa421a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:19.977127 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54356134-a9ca-4057-b37d-b7e34fa421a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:19.988274 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54356134-a9ca-4057-b37d-b7e34fa421a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:19.989720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54356134-a9ca-4057-b37d-b7e34fa421a5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:20.007297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-54356134-a9ca-4057-b37d-b7e34fa421a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:20.007297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:20.007297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:20.007297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:20.007297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:20.007297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:20.007297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:20.007297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:20.007297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:20.007297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:20.007297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:20.007297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:20.007297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:20.007297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:20.007297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:20.008114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:20.008114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:20.008114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:20.008114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:20.008114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:20.008114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:20.008114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:20.008114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:20.008114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:20.008114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:20.008114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:20.008114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:20.008114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:20.008114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:20.008114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:20.008114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:20.008114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:20.008923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:20.008923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:20.008923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:20.008923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:20.008923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 246/508] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:20.009248 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54356134-a9ca-4057-b37d-b7e34fa421a5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:20.063475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d93b4-e66e-425b-95dd-f913a1dddf7d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:20.080460 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:20.098935 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baca25-2458-43af-b81d-e0c770fd3f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:20.099721 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baca25-2458-43af-b81d-e0c770fd3f73 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:20.099999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baca25-2458-43af-b81d-e0c770fd3f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:20.100268 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baca25-2458-43af-b81d-e0c770fd3f73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:20.108742 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54356134-a9ca-4057-b37d-b7e34fa421a5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:20.110563 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baca25-2458-43af-b81d-e0c770fd3f73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:20.112542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baca25-2458-43af-b81d-e0c770fd3f73 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:20.129796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-21baca25-2458-43af-b81d-e0c770fd3f73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:20.129796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:20.129796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:20.129796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:20.129796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:20.129796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:20.129796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:20.129796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:20.129796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:20.129796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:20.129796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:20.129796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:20.129796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:20.129796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:20.129796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:20.130817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:20.130817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:20.130817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:20.130817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:20.130817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:20.130817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:20.130817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:20.130817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:20.130817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:20.130817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:20.130817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:20.130817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:20.130817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:20.130817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:20.130817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:20.130817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:20.130817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:20.131689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:20.131689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:20.131689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:20.131689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:20.131689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 263/509] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:20.131951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baca25-2458-43af-b81d-e0c770fd3f73 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:20.147356 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfe687-d5ff-4ffd-ae8c-a521b036a7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:20.148152 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfe687-d5ff-4ffd-ae8c-a521b036a7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:20.148428 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfe687-d5ff-4ffd-ae8c-a521b036a7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:20.148696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfe687-d5ff-4ffd-ae8c-a521b036a7a5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:20.159230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfe687-d5ff-4ffd-ae8c-a521b036a7a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:20.160656 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfe687-d5ff-4ffd-ae8c-a521b036a7a5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:20.176308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-79dfe687-d5ff-4ffd-ae8c-a521b036a7a5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 12:18:20.176308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:20.176308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:20.176308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:20.176308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:20.176308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:20.176308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:20.176308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:20.176308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:20.176308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:20.176308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:20.176308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:20.176308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:20.176308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:20.176308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:20.176308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:20.177368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:20.177368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:20.177368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:20.177368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:20.177368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:20.177368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:20.177368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:20.177368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:20.177368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:20.177368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:20.177368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:20.177368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:20.177368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:20.177368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:20.177368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:20.177368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:20.177368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:20.177368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:20.178374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:20.178374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:20.178374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:20.178374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:20.178374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:20.178374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:20.178374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:20.178374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:20.178374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 12:18:20.178374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:20.178374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 247/510] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:20.178374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfe687-d5ff-4ffd-ae8c-a521b036a7a5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:20.183247 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:20.236032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baca25-2458-43af-b81d-e0c770fd3f73 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:20.270162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a440ed8-373e-4ee3-aa2c-63bfc1ed26cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:20.270849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a440ed8-373e-4ee3-aa2c-63bfc1ed26cc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:20.271116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a440ed8-373e-4ee3-aa2c-63bfc1ed26cc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:20.271389 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a440ed8-373e-4ee3-aa2c-63bfc1ed26cc None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:20.272116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a440ed8-373e-4ee3-aa2c-63bfc1ed26cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:20.272413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a440ed8-373e-4ee3-aa2c-63bfc1ed26cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:20.273772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a440ed8-373e-4ee3-aa2c-63bfc1ed26cc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:20.281502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 264/511] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:18:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:20.282057 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfe687-d5ff-4ffd-ae8c-a521b036a7a5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:20.282265 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a440ed8-373e-4ee3-aa2c-63bfc1ed26cc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:20.316721 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:20.318198 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e9936-f18b-43e3-87c3-11eb8011d671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:20.318873 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e9936-f18b-43e3-87c3-11eb8011d671 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:20.319141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e9936-f18b-43e3-87c3-11eb8011d671 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:20.319418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e9936-f18b-43e3-87c3-11eb8011d671 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:20.320245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e9936-f18b-43e3-87c3-11eb8011d671 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:20.320550 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e9936-f18b-43e3-87c3-11eb8011d671 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:20.321969 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e9936-f18b-43e3-87c3-11eb8011d671 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:20.340988 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 248/512] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Jul 19 12:18:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:20.341796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e9936-f18b-43e3-87c3-11eb8011d671 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:20.388009 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a440ed8-373e-4ee3-aa2c-63bfc1ed26cc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:20.403753 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:20.423512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ca577-4708-470b-8b00-b8f3edfece58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:20.424267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ca577-4708-470b-8b00-b8f3edfece58 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:20.424654 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ca577-4708-470b-8b00-b8f3edfece58 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:20.424931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ca577-4708-470b-8b00-b8f3edfece58 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:20.425644 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ca577-4708-470b-8b00-b8f3edfece58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:20.425947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ca577-4708-470b-8b00-b8f3edfece58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:20.427367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ca577-4708-470b-8b00-b8f3edfece58 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:20.440043 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 265/513] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:20.440809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ca577-4708-470b-8b00-b8f3edfece58 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:20.443296 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e9936-f18b-43e3-87c3-11eb8011d671 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:20.476929 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d46f9-06d8-4139-8840-ba0926796bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:20.477609 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d46f9-06d8-4139-8840-ba0926796bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:20.477889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d46f9-06d8-4139-8840-ba0926796bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:20.478161 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d46f9-06d8-4139-8840-ba0926796bf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:20.478904 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d46f9-06d8-4139-8840-ba0926796bf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:20.479203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d46f9-06d8-4139-8840-ba0926796bf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:20.480561 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d46f9-06d8-4139-8840-ba0926796bf8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:20.492725 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 249/514] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:20.493441 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d46f9-06d8-4139-8840-ba0926796bf8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:20.536197 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:20.546164 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ca577-4708-470b-8b00-b8f3edfece58 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:20.581393 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd270409-1bbb-4a74-aced-c6002a83cce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:20.582056 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd270409-1bbb-4a74-aced-c6002a83cce0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:20.582336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd270409-1bbb-4a74-aced-c6002a83cce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:20.582608 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd270409-1bbb-4a74-aced-c6002a83cce0 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:20.583460 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd270409-1bbb-4a74-aced-c6002a83cce0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:20.583769 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd270409-1bbb-4a74-aced-c6002a83cce0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:20.585194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd270409-1bbb-4a74-aced-c6002a83cce0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:20.592535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d46f9-06d8-4139-8840-ba0926796bf8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:20.614550 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:20.621058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 266/515] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Jul 19 12:18:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:20.621882 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd270409-1bbb-4a74-aced-c6002a83cce0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:20.630617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6b49b-bd77-42c6-875d-0c6b691c9a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:20.631436 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6b49b-bd77-42c6-875d-0c6b691c9a07 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:20.631713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6b49b-bd77-42c6-875d-0c6b691c9a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:20.631981 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6b49b-bd77-42c6-875d-0c6b691c9a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:20.643413 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6b49b-bd77-42c6-875d-0c6b691c9a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:20.644833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6b49b-bd77-42c6-875d-0c6b691c9a07 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:20.662117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-95d6b49b-bd77-42c6-875d-0c6b691c9a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:20.662117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:20.662117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:20.662117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:20.662117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:20.662117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:20.662117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:20.662117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:20.662117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:20.662117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:20.662117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:20.662117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:20.662117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:20.662117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:20.662117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:20.663211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:20.663211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:20.663211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:20.663211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:20.663211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:20.663211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:20.663211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:20.663211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:20.663211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:20.663211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:20.663211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:20.663211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:20.663211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:20.663211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:20.663211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:20.663211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:20.663211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:20.664038 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:20.664038 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:20.664038 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:20.664038 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:20.664038 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 250/516] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:20.664304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6b49b-bd77-42c6-875d-0c6b691c9a07 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:20.729251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd270409-1bbb-4a74-aced-c6002a83cce0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:20.762336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a9c55-23c5-4466-8c24-1b67912f2008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:20.762839 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6b49b-bd77-42c6-875d-0c6b691c9a07 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:20.762952 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a9c55-23c5-4466-8c24-1b67912f2008 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:20.763206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a9c55-23c5-4466-8c24-1b67912f2008 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:20.763474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a9c55-23c5-4466-8c24-1b67912f2008 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:20.781230 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:20.796992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ccfb9-f381-445a-ab21-6a34746249d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:20.797785 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ccfb9-f381-445a-ab21-6a34746249d0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:20.798157 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ccfb9-f381-445a-ab21-6a34746249d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:20.798331 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ccfb9-f381-445a-ab21-6a34746249d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:20.805103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ccfb9-f381-445a-ab21-6a34746249d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:20.806523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ccfb9-f381-445a-ab21-6a34746249d0 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:20.822932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-269ccfb9-f381-445a-ab21-6a34746249d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:20.822932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:20.822932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:20.822932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:20.822932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:20.822932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:20.822932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:20.822932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:20.822932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:20.822932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:20.822932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:20.822932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:20.822932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:20.822932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:20.822932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:20.823859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:20.823859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:20.823859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:20.823859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:20.823859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:20.823859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:20.823859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:20.823859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:20.823859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:20.823859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:20.823859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:20.823859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:20.823859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:20.823859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:20.823859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:20.823859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:20.823859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:20.824678 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:20.824678 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:20.824678 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:20.824678 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:20.824678 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:20.824678 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:20.824678 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:20.824678 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:20.824678 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 251/517] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:20.825138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ccfb9-f381-445a-ab21-6a34746249d0 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:20.837627 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a9c55-23c5-4466-8c24-1b67912f2008 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:20.839121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a9c55-23c5-4466-8c24-1b67912f2008 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:20.857890 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:20.924728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ccfb9-f381-445a-ab21-6a34746249d0 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:20.938252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 267/518] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:20.939114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a9c55-23c5-4466-8c24-1b67912f2008 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:20.959182 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e4ea0-6d26-434f-9712-ee54939fb5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:20.959852 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e4ea0-6d26-434f-9712-ee54939fb5c2 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:20.960133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e4ea0-6d26-434f-9712-ee54939fb5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:20.960404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e4ea0-6d26-434f-9712-ee54939fb5c2 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:20.961101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e4ea0-6d26-434f-9712-ee54939fb5c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:20.962522 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e4ea0-6d26-434f-9712-ee54939fb5c2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:20.982540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 252/519] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 19 12:18:20 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:18:20.983281 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e4ea0-6d26-434f-9712-ee54939fb5c2 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:20.991576 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:21.057947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a9c55-23c5-4466-8c24-1b67912f2008 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:21.089777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:21.099582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40ffc3-9879-4749-8552-939cae83a1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:21.100251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40ffc3-9879-4749-8552-939cae83a1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:21.100528 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40ffc3-9879-4749-8552-939cae83a1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:21.100798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40ffc3-9879-4749-8552-939cae83a1b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:21.103410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e4ea0-6d26-434f-9712-ee54939fb5c2 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:21.143987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf42819-36f7-430c-9d1e-bff3daa4e0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:21.144660 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf42819-36f7-430c-9d1e-bff3daa4e0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:21.144944 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf42819-36f7-430c-9d1e-bff3daa4e0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:21.145219 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf42819-36f7-430c-9d1e-bff3daa4e0a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:21.145938 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf42819-36f7-430c-9d1e-bff3daa4e0a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:21.146241 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf42819-36f7-430c-9d1e-bff3daa4e0a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:21.148031 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf42819-36f7-430c-9d1e-bff3daa4e0a0 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:21.161807 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 253/520] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:21.162525 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf42819-36f7-430c-9d1e-bff3daa4e0a0 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:21.182257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40ffc3-9879-4749-8552-939cae83a1b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:21.183931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40ffc3-9879-4749-8552-939cae83a1b7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:21.235380 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:21.286031 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf42819-36f7-430c-9d1e-bff3daa4e0a0 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:21.293307 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 268/521] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:21.293307 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40ffc3-9879-4749-8552-939cae83a1b7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:21.327058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf2e6b-02f0-4a68-87a1-b36358bb4db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:21.327945 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf2e6b-02f0-4a68-87a1-b36358bb4db0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:21.328424 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf2e6b-02f0-4a68-87a1-b36358bb4db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:21.328892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf2e6b-02f0-4a68-87a1-b36358bb4db0 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:21.329815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf2e6b-02f0-4a68-87a1-b36358bb4db0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:21.330933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf2e6b-02f0-4a68-87a1-b36358bb4db0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:21.332565 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf2e6b-02f0-4a68-87a1-b36358bb4db0 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:21.352377 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 254/522] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:21.353542 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf2e6b-02f0-4a68-87a1-b36358bb4db0 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:21.367523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:21.397926 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40ffc3-9879-4749-8552-939cae83a1b7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:21.437950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a1b8a-8593-4106-92d5-a5f3c82f36a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:21.438894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a1b8a-8593-4106-92d5-a5f3c82f36a5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:21.439289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a1b8a-8593-4106-92d5-a5f3c82f36a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:21.439717 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a1b8a-8593-4106-92d5-a5f3c82f36a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:21.451161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a1b8a-8593-4106-92d5-a5f3c82f36a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:21.452698 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a1b8a-8593-4106-92d5-a5f3c82f36a5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:21.460516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf2e6b-02f0-4a68-87a1-b36358bb4db0 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:21.462468 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:21.473900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9f6a1b8a-8593-4106-92d5-a5f3c82f36a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:21.473900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:21.473900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:21.473900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:21.473900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:21.473900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:21.473900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:21.473900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:21.473900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:21.473900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:21.473900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:21.473900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:21.473900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:21.473900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:21.473900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:21.474995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:21.474995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:21.474995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:21.474995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:21.474995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:21.474995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:21.474995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:21.474995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:21.474995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:21.474995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:21.474995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:21.474995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:21.474995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:21.474995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:21.474995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:21.474995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:21.474995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:21.476008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:21.476008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:21.476008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:21.476008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:21.482260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 269/523] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:21.482260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a1b8a-8593-4106-92d5-a5f3c82f36a5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:21.506412 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa81b80-adb6-431e-893b-0a446b282b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:21.507469 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa81b80-adb6-431e-893b-0a446b282b8f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:21.507845 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa81b80-adb6-431e-893b-0a446b282b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:21.508189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa81b80-adb6-431e-893b-0a446b282b8f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:21.516146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa81b80-adb6-431e-893b-0a446b282b8f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:21.518176 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa81b80-adb6-431e-893b-0a446b282b8f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:21.533266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-eaa81b80-adb6-431e-893b-0a446b282b8f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 12:18:21.533266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:21.533266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:21.533266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:21.533266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:21.533266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:21.533266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:21.533266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:21.533266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:21.533266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:21.533266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:21.533266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:21.533266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:21.533266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:21.533266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:21.533266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:21.534395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:21.534395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:21.534395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:21.534395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:21.534395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:21.534395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:21.534395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:21.534395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:21.534395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:21.534395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:21.534395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:21.534395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:21.534395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:21.534395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:21.534395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:21.534395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:21.534395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:21.534395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:21.535695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:21.535695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:21.535695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:21.535695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:21.535695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:21.535695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:21.535695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:21.535695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:21.535695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 12:18:21.535695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:21.535695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 255/524] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:21.541186 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa81b80-adb6-431e-893b-0a446b282b8f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:21.592097 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a1b8a-8593-4106-92d5-a5f3c82f36a5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:21.620368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:21.629223 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41464d29-b73e-4e97-98af-40ae7164f913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:21.630177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41464d29-b73e-4e97-98af-40ae7164f913 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:21.630467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41464d29-b73e-4e97-98af-40ae7164f913 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:21.630760 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41464d29-b73e-4e97-98af-40ae7164f913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:21.642265 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41464d29-b73e-4e97-98af-40ae7164f913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:21.644720 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41464d29-b73e-4e97-98af-40ae7164f913 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:21.652742 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa81b80-adb6-431e-893b-0a446b282b8f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:21.664083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-41464d29-b73e-4e97-98af-40ae7164f913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:21.664083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:21.664083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:21.664083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:21.664083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:21.664083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:21.664083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:21.664083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:21.664083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:21.664083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:21.664083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:21.664083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:21.664083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:21.664083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:21.664083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:21.664957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:21.664957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:21.664957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:21.664957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:21.664957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:21.664957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:21.664957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:21.664957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:21.664957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:21.664957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:21.664957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:21.664957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:21.664957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:21.664957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:21.664957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:21.664957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:21.664957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:21.665766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:21.665766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:21.665766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:21.665766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:21.665766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 270/525] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:21.666121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41464d29-b73e-4e97-98af-40ae7164f913 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:21.693329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2b12e-528f-474b-9d71-26fb8b7aef5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:21.694403 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2b12e-528f-474b-9d71-26fb8b7aef5c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:21.694863 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2b12e-528f-474b-9d71-26fb8b7aef5c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:21.695285 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2b12e-528f-474b-9d71-26fb8b7aef5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:21.698096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2b12e-528f-474b-9d71-26fb8b7aef5c None admin] RBAC: Adding query filter params (role.id=42cae330d9ab456c8212ca146daf9322, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=5d9543657e1e4a6d85632bf57f6ba6eb) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:21.698096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2b12e-528f-474b-9d71-26fb8b7aef5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:21.698660 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2b12e-528f-474b-9d71-26fb8b7aef5c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:21.705570 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 256/526] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:18:21 2022] GET /identity/v3/role_assignments?user.id=5d9543657e1e4a6d85632bf57f6ba6eb&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=42cae330d9ab456c8212ca146daf9322 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:21.706378 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2b12e-528f-474b-9d71-26fb8b7aef5c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:21.748900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:21.822776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41464d29-b73e-4e97-98af-40ae7164f913 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:21.827668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2b12e-528f-474b-9d71-26fb8b7aef5c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:21.874488 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c0fcd-241a-4f83-bda3-7f94a4a08896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:21.875827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c0fcd-241a-4f83-bda3-7f94a4a08896 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:21.875827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c0fcd-241a-4f83-bda3-7f94a4a08896 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:21.875827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c0fcd-241a-4f83-bda3-7f94a4a08896 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:21.877610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c0fcd-241a-4f83-bda3-7f94a4a08896 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:21.877610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c0fcd-241a-4f83-bda3-7f94a4a08896 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:21.877768 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd7957-5548-4b96-9196-1c0f557a2715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:21.878307 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd7957-5548-4b96-9196-1c0f557a2715 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:21.878584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd7957-5548-4b96-9196-1c0f557a2715 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:21.878886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd7957-5548-4b96-9196-1c0f557a2715 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:21.879058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c0fcd-241a-4f83-bda3-7f94a4a08896 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:21.879661 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd7957-5548-4b96-9196-1c0f557a2715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:21.879966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd7957-5548-4b96-9196-1c0f557a2715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:21.880823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:21.881606 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd7957-5548-4b96-9196-1c0f557a2715 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:21.900235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 257/527] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Jul 19 12:18:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:21.901128 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c0fcd-241a-4f83-bda3-7f94a4a08896 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:21.901237 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 271/528] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:21.911305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd7957-5548-4b96-9196-1c0f557a2715 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:22.014220 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c0fcd-241a-4f83-bda3-7f94a4a08896 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:22.037398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd7957-5548-4b96-9196-1c0f557a2715 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:22.052557 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b67ac-41c9-48a7-af5d-c8d39ffacfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:22.053289 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b67ac-41c9-48a7-af5d-c8d39ffacfb1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:22.053579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b67ac-41c9-48a7-af5d-c8d39ffacfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:22.053826 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b67ac-41c9-48a7-af5d-c8d39ffacfb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:22.054547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b67ac-41c9-48a7-af5d-c8d39ffacfb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:22.054925 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b67ac-41c9-48a7-af5d-c8d39ffacfb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:22.056298 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b67ac-41c9-48a7-af5d-c8d39ffacfb1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:22.057180 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:22.071658 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 258/529] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:22.072434 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b67ac-41c9-48a7-af5d-c8d39ffacfb1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:22.086343 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f8aa6-4980-48a1-8efd-7ce393369af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:22.088065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f8aa6-4980-48a1-8efd-7ce393369af0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:22.088557 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f8aa6-4980-48a1-8efd-7ce393369af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:22.089057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f8aa6-4980-48a1-8efd-7ce393369af0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:22.098635 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f8aa6-4980-48a1-8efd-7ce393369af0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:22.100528 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f8aa6-4980-48a1-8efd-7ce393369af0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:22.117102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9d8f8aa6-4980-48a1-8efd-7ce393369af0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:22.117102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:22.117102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:22.117102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:22.117102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:22.117102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:22.117102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:22.117102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:22.117102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:22.117102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:22.117102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:22.117102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:22.117102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:22.117102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:22.117102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:22.117958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:22.117958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:22.117958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:22.117958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:22.117958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:22.117958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:22.117958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:22.117958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:22.117958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:22.117958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:22.117958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:22.117958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:22.117958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:22.117958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:22.117958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:22.117958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:22.117958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:22.118820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:22.118820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:22.118820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:22.118820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:22.118820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:22.118820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:22.118820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:22.118820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:22.123077 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 272/530] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:22.123935 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f8aa6-4980-48a1-8efd-7ce393369af0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:22.143408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:22.203505 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b67ac-41c9-48a7-af5d-c8d39ffacfb1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:22.234893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f8aa6-4980-48a1-8efd-7ce393369af0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:22.247449 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cbae5-0d93-4620-beda-3111d8e03a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:22.248771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cbae5-0d93-4620-beda-3111d8e03a6c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:22.249581 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cbae5-0d93-4620-beda-3111d8e03a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:22.250221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cbae5-0d93-4620-beda-3111d8e03a6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:22.281525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebecc49-e09a-4386-9f7b-af5ee3fb425d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:22.282683 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebecc49-e09a-4386-9f7b-af5ee3fb425d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:22.283126 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebecc49-e09a-4386-9f7b-af5ee3fb425d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:22.283686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebecc49-e09a-4386-9f7b-af5ee3fb425d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:22.293513 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebecc49-e09a-4386-9f7b-af5ee3fb425d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:22.295086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebecc49-e09a-4386-9f7b-af5ee3fb425d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:22.313248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-bebecc49-e09a-4386-9f7b-af5ee3fb425d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:22.313248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:22.313248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:22.313248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:22.313248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:22.313248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:22.313248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:22.313248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:22.313248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:22.313248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:22.313248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:22.313248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:22.313248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:22.313248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:22.313248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:22.314110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:22.314110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:22.314110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:22.314110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:22.314110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:22.314110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:22.314110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:22.314110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:22.314110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:22.314110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:22.314110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:22.314110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:22.314110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:22.314110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:22.314110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:22.314110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:22.314110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:22.315173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:22.315173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:22.315173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:22.315173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:22.315173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:22.315173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:22.315173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:22.315173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:22.315173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 273/531] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:22.316515 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebecc49-e09a-4386-9f7b-af5ee3fb425d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:22.333456 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812cbae5-0d93-4620-beda-3111d8e03a6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:22.335617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812cbae5-0d93-4620-beda-3111d8e03a6c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:22.354641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:22.402832 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:22.442894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebecc49-e09a-4386-9f7b-af5ee3fb425d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:22.464566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 259/532] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:22.465983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cbae5-0d93-4620-beda-3111d8e03a6c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:22.491705 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df35f61-ce3a-4f34-b361-33f379a41f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:22.492626 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df35f61-ce3a-4f34-b361-33f379a41f32 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:22.492983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df35f61-ce3a-4f34-b361-33f379a41f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:22.493334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df35f61-ce3a-4f34-b361-33f379a41f32 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:22.494201 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df35f61-ce3a-4f34-b361-33f379a41f32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:22.494603 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df35f61-ce3a-4f34-b361-33f379a41f32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:22.496601 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df35f61-ce3a-4f34-b361-33f379a41f32 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:22.522815 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 274/533] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:22.523950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df35f61-ce3a-4f34-b361-33f379a41f32 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:22.588453 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cbae5-0d93-4620-beda-3111d8e03a6c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:22.625543 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:22.628723 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4224b8-3509-4111-b63d-c643ae462cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:22.630116 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4224b8-3509-4111-b63d-c643ae462cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:22.630548 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4224b8-3509-4111-b63d-c643ae462cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:22.631090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4224b8-3509-4111-b63d-c643ae462cb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:22.632687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4224b8-3509-4111-b63d-c643ae462cb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:22.633650 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4224b8-3509-4111-b63d-c643ae462cb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:22.635260 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4224b8-3509-4111-b63d-c643ae462cb6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:22.636500 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df35f61-ce3a-4f34-b361-33f379a41f32 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:22.649153 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 260/534] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:22.650314 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4224b8-3509-4111-b63d-c643ae462cb6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:22.667471 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:22.677894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84d997-fc54-41cb-a9d6-00b30c9e4ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:22.678820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84d997-fc54-41cb-a9d6-00b30c9e4ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:22.679202 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84d997-fc54-41cb-a9d6-00b30c9e4ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:22.679579 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84d997-fc54-41cb-a9d6-00b30c9e4ea4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:22.692681 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84d997-fc54-41cb-a9d6-00b30c9e4ea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:22.693914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84d997-fc54-41cb-a9d6-00b30c9e4ea4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:22.713755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-fc84d997-fc54-41cb-a9d6-00b30c9e4ea4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:22.713755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:22.713755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:22.713755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:22.713755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:22.713755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:22.713755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:22.713755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:22.713755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:22.713755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:22.713755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:22.713755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:22.713755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:22.713755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:22.713755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:22.714612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:22.714612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:22.714612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:22.714612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:22.714612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:22.714612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:22.714612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:22.714612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:22.714612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:22.714612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:22.714612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:22.714612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:22.714612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:22.714612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:22.714612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:22.714612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:22.714612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:22.715487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:22.715487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:22.715487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:22.715487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:22.715487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 275/535] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:22.716149 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84d997-fc54-41cb-a9d6-00b30c9e4ea4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:22.767075 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4224b8-3509-4111-b63d-c643ae462cb6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:22.809321 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b818b-c340-4590-8b68-e200987878f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:22.810272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b818b-c340-4590-8b68-e200987878f0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:22.810726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b818b-c340-4590-8b68-e200987878f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:22.811220 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b818b-c340-4590-8b68-e200987878f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:22.813154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b818b-c340-4590-8b68-e200987878f0 None admin] RBAC: Adding query filter params (role.id=42cae330d9ab456c8212ca146daf9322, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=726c2035855c444b88ec07a7811ea711) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:22.813644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b818b-c340-4590-8b68-e200987878f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:22.815666 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b818b-c340-4590-8b68-e200987878f0 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:22.830987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 261/536] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:18:22 2022] GET /identity/v3/role_assignments?user.id=726c2035855c444b88ec07a7811ea711&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=42cae330d9ab456c8212ca146daf9322 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:22.832400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b818b-c340-4590-8b68-e200987878f0 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:22.837042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84d997-fc54-41cb-a9d6-00b30c9e4ea4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:22.898788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c528984-c580-44bd-98d2-31957dec9b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:22.898788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c528984-c580-44bd-98d2-31957dec9b52 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:22.898788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c528984-c580-44bd-98d2-31957dec9b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:22.898788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c528984-c580-44bd-98d2-31957dec9b52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:22.899198 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c528984-c580-44bd-98d2-31957dec9b52 None admin] RBAC: Adding query filter params (role.id=42cae330d9ab456c8212ca146daf9322, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=1af8b237e2df41668bc5409d8fdd3f67) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:22.899198 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c528984-c580-44bd-98d2-31957dec9b52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:22.899198 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c528984-c580-44bd-98d2-31957dec9b52 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:22.914767 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 276/537] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:18:22 2022] GET /identity/v3/role_assignments?user.id=1af8b237e2df41668bc5409d8fdd3f67&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=42cae330d9ab456c8212ca146daf9322 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:22.989982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:23.020452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b818b-c340-4590-8b68-e200987878f0 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:23.068968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124c1ee-4868-4a65-8060-66b6d1895bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:23.070066 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124c1ee-4868-4a65-8060-66b6d1895bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:23.070552 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124c1ee-4868-4a65-8060-66b6d1895bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:23.071087 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124c1ee-4868-4a65-8060-66b6d1895bd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:23.072195 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124c1ee-4868-4a65-8060-66b6d1895bd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:23.072707 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124c1ee-4868-4a65-8060-66b6d1895bd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:23.074320 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124c1ee-4868-4a65-8060-66b6d1895bd6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:23.089479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 262/538] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:23.094714 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c528984-c580-44bd-98d2-31957dec9b52 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:23.110689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:23.255754 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c528984-c580-44bd-98d2-31957dec9b52 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:23.318289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae64177-bf8d-45f5-a539-056696b36519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:23.319132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae64177-bf8d-45f5-a539-056696b36519 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:23.319407 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae64177-bf8d-45f5-a539-056696b36519 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:23.322757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae64177-bf8d-45f5-a539-056696b36519 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:23.325983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2a8fd-3c7c-4e91-991c-1abd2196891b None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:23.327047 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2a8fd-3c7c-4e91-991c-1abd2196891b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:23.327047 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2a8fd-3c7c-4e91-991c-1abd2196891b None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:23.338769 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 263/539] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:23.340248 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7fcbc-d820-447c-98fd-13499ce2afb4 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:23.340447 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae64177-bf8d-45f5-a539-056696b36519 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:23.340547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7fcbc-d820-447c-98fd-13499ce2afb4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:23.340806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7fcbc-d820-447c-98fd-13499ce2afb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:23.342417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae64177-bf8d-45f5-a539-056696b36519 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:23.367435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-cae64177-bf8d-45f5-a539-056696b36519 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:23.367435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:23.367435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:23.367435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:23.367435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:23.367435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:23.367435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:23.367435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:23.367435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:23.367435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:23.367435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:23.367435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:23.367435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:23.367435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:23.367435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:23.368314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:23.368314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:23.368314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:23.368314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:23.368314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:23.368314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:23.368314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:23.368314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:23.368314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:23.368314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:23.368314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:23.368314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:23.368314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:23.368314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:23.368314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:23.368314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:23.368314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:23.369143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:23.369143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:23.369143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:23.369143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:23.369143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:23.369143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:23.369143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:23.369143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:23.371502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 277/540] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:23.377494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae64177-bf8d-45f5-a539-056696b36519 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:23.391789 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-58c7fcbc-d820-447c-98fd-13499ce2afb4 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:23.393680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-58c7fcbc-d820-447c-98fd-13499ce2afb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:23.519619 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:23.544164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 264/541] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:23.567678 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7fcbc-d820-447c-98fd-13499ce2afb4 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:23.592895 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae64177-bf8d-45f5-a539-056696b36519 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:23.649221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb9dcc-e3c6-4a34-b345-247d5dd6b87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:23.649886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb9dcc-e3c6-4a34-b345-247d5dd6b87f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:23.650162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb9dcc-e3c6-4a34-b345-247d5dd6b87f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:23.650430 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb9dcc-e3c6-4a34-b345-247d5dd6b87f None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:23.651239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb9dcc-e3c6-4a34-b345-247d5dd6b87f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:23.651542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb9dcc-e3c6-4a34-b345-247d5dd6b87f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:23.652963 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb9dcc-e3c6-4a34-b345-247d5dd6b87f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:23.663113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:23.692191 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 278/542] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:23.700887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb9dcc-e3c6-4a34-b345-247d5dd6b87f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:23.739536 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7fcbc-d820-447c-98fd-13499ce2afb4 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:23.828090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84682847-f86c-4abb-a8db-276fccdb1558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:23.828825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84682847-f86c-4abb-a8db-276fccdb1558 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:23.829107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84682847-f86c-4abb-a8db-276fccdb1558 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:23.829379 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84682847-f86c-4abb-a8db-276fccdb1558 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:23.843736 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb9dcc-e3c6-4a34-b345-247d5dd6b87f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:23.859675 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84682847-f86c-4abb-a8db-276fccdb1558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:23.873677 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:23.876851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-84682847-f86c-4abb-a8db-276fccdb1558 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:23.876851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:23.876851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:23.876851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:23.876851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:23.876851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:23.876851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:23.876851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:23.876851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:23.876851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:23.876851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:23.876851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:23.876851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:23.876851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:23.876851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:23.876851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:23.877892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:23.877892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:23.877892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:23.877892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:23.877892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:23.877892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:23.877892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:23.877892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:23.877892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:23.877892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:23.877892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:23.877892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:23.877892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:23.877892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:23.877892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:23.877892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:23.879217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:23.879217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:23.879217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:23.879217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:23.879217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:23.879217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:23.879217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:23.879217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:23.879217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:23.879217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:23.879217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:23.879217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:23.879217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 265/543] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:23.884859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84682847-f86c-4abb-a8db-276fccdb1558 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:23.890802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516e949-79a5-42d5-b4cc-8b19bf7a22eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:23.896931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516e949-79a5-42d5-b4cc-8b19bf7a22eb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:23.897378 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516e949-79a5-42d5-b4cc-8b19bf7a22eb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:23.897828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516e949-79a5-42d5-b4cc-8b19bf7a22eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:23.898838 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516e949-79a5-42d5-b4cc-8b19bf7a22eb None admin] RBAC: Adding query filter params (role.id=42cae330d9ab456c8212ca146daf9322, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=977392666b5a4076884416489b935ad6) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:23.899318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516e949-79a5-42d5-b4cc-8b19bf7a22eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:23.900894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516e949-79a5-42d5-b4cc-8b19bf7a22eb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:23.911032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 279/544] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:18:23 2022] GET /identity/v3/role_assignments?user.id=977392666b5a4076884416489b935ad6&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=42cae330d9ab456c8212ca146daf9322 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:24.043421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84682847-f86c-4abb-a8db-276fccdb1558 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:24.083816 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:24.097794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48c506-5f58-4879-bbf0-fd7101ea291b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:24.097983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f08a7-03dc-4de1-b198-c9b237694868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:24.098438 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48c506-5f58-4879-bbf0-fd7101ea291b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:24.098553 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f08a7-03dc-4de1-b198-c9b237694868 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:24.098886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f08a7-03dc-4de1-b198-c9b237694868 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:24.099121 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f08a7-03dc-4de1-b198-c9b237694868 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:24.099384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48c506-5f58-4879-bbf0-fd7101ea291b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:24.099878 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f08a7-03dc-4de1-b198-c9b237694868 None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:24.100184 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f08a7-03dc-4de1-b198-c9b237694868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:24.102466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f08a7-03dc-4de1-b198-c9b237694868 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:24.107487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 280/545] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:24.108515 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce78223-830f-4943-98f4-e168954b1fdb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:24.108807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce78223-830f-4943-98f4-e168954b1fdb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:24.109083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce78223-830f-4943-98f4-e168954b1fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:24.111294 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 266/546] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:18:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:24.118318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f08a7-03dc-4de1-b198-c9b237694868 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:24.139810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0ce78223-830f-4943-98f4-e168954b1fdb None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:24.141276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0ce78223-830f-4943-98f4-e168954b1fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:24.231802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 281/547] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:24.255358 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce78223-830f-4943-98f4-e168954b1fdb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:24.274530 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f08a7-03dc-4de1-b198-c9b237694868 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:24.314036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb487be-afb2-4c78-a587-27d9d52a0e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:24.316115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb487be-afb2-4c78-a587-27d9d52a0e43 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:24.316544 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb487be-afb2-4c78-a587-27d9d52a0e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:24.316981 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb487be-afb2-4c78-a587-27d9d52a0e43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:24.329061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb487be-afb2-4c78-a587-27d9d52a0e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:24.330886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb487be-afb2-4c78-a587-27d9d52a0e43 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:24.349928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-7eb487be-afb2-4c78-a587-27d9d52a0e43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:24.349928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:24.349928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:24.349928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:24.349928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:24.349928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:24.349928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:24.349928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:24.349928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:24.349928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:24.349928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:24.349928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:24.349928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:24.349928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:24.349928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:24.350986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:24.350986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:24.350986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:24.350986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:24.350986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:24.350986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:24.350986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:24.350986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:24.350986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:24.350986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:24.350986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:24.350986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:24.350986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:24.350986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:24.350986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:24.350986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:24.350986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:24.352059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:24.352059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:24.352059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:24.352059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:24.353945 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 267/548] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:24.359491 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb487be-afb2-4c78-a587-27d9d52a0e43 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:24.409226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:24.487411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb487be-afb2-4c78-a587-27d9d52a0e43 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:24.494657 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce78223-830f-4943-98f4-e168954b1fdb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:24.522001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:24.533908 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533f24b-c2e3-4dee-bbb5-acfee0387146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:24.535176 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533f24b-c2e3-4dee-bbb5-acfee0387146 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:24.535667 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533f24b-c2e3-4dee-bbb5-acfee0387146 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:24.536161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533f24b-c2e3-4dee-bbb5-acfee0387146 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:24.550090 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533f24b-c2e3-4dee-bbb5-acfee0387146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:24.563851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f533f24b-c2e3-4dee-bbb5-acfee0387146 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:24.563851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:24.563851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:24.563851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:24.563851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:24.563851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:24.563851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:24.563851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:24.563851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:24.563851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:24.563851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:24.563851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:24.563851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:24.563851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:24.563851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:24.563851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:24.564877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:24.564877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:24.564877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:24.564877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:24.564877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:24.564877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:24.564877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:24.564877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:24.564877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:24.564877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:24.564877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:24.564877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:24.564877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:24.564877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:24.564877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:24.564877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:24.566179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:24.566179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:24.566179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:24.566179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:24.566179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:24.566179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:24.566179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:24.566179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:24.566179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:24.566179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:24.566179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:24.566179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:24.569320 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 282/549] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:24.572989 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcbc44-d12a-4d90-9b89-4d2cb5e462a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:24.573909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcbc44-d12a-4d90-9b89-4d2cb5e462a9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:24.574463 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcbc44-d12a-4d90-9b89-4d2cb5e462a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:24.575606 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcbc44-d12a-4d90-9b89-4d2cb5e462a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:24.576044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533f24b-c2e3-4dee-bbb5-acfee0387146 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:24.577393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcbc44-d12a-4d90-9b89-4d2cb5e462a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:24.578321 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcbc44-d12a-4d90-9b89-4d2cb5e462a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:24.582509 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcbc44-d12a-4d90-9b89-4d2cb5e462a9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:24.604651 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 268/550] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:24.609099 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcbc44-d12a-4d90-9b89-4d2cb5e462a9 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:24.755103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:24.760476 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcbc44-d12a-4d90-9b89-4d2cb5e462a9 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:24.792349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533f24b-c2e3-4dee-bbb5-acfee0387146 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:24.825999 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff696cd-5c5b-4c65-81a4-527cdc123085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:24.826826 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff696cd-5c5b-4c65-81a4-527cdc123085 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:24.827109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff696cd-5c5b-4c65-81a4-527cdc123085 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:24.827377 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff696cd-5c5b-4c65-81a4-527cdc123085 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:24.838283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff696cd-5c5b-4c65-81a4-527cdc123085 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:24.839747 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff696cd-5c5b-4c65-81a4-527cdc123085 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:24.859831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0366a5-4517-4439-905c-4f826e1598d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:24.860492 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0366a5-4517-4439-905c-4f826e1598d2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:24.860736 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0366a5-4517-4439-905c-4f826e1598d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:24.861143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0366a5-4517-4439-905c-4f826e1598d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:24.862144 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0366a5-4517-4439-905c-4f826e1598d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:24.862449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0366a5-4517-4439-905c-4f826e1598d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:24.863860 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0366a5-4517-4439-905c-4f826e1598d2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:24.873518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-aff696cd-5c5b-4c65-81a4-527cdc123085 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 12:18:24.873518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:24.873518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:24.873518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:24.873518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:24.873518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:24.873518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:24.873518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:24.873518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:24.873518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:24.873518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:24.873518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:24.873518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:24.873518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:24.873518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:24.873518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:24.874480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:24.874480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:24.874480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:24.874480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:24.874480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:24.874480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:24.874480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:24.874480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:24.874480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:24.874480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:24.874480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:24.874480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:24.874480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:24.874480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:24.874480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:24.874480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:24.874480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:24.874480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:24.875501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:24.875501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:24.875501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:24.875501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:24.875501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:24.875501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:24.875501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:24.875501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:24.875501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 12:18:24.875501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:24.877619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 269/551] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:18:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:24.880186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 283/552] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:18:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:24.885538 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff696cd-5c5b-4c65-81a4-527cdc123085 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:24.887135 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0366a5-4517-4439-905c-4f826e1598d2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:24.973585 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:25.059668 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0366a5-4517-4439-905c-4f826e1598d2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:25.076675 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff696cd-5c5b-4c65-81a4-527cdc123085 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:25.100104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430a7f3-cf21-46c0-9b3c-26e931868de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:25.100901 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430a7f3-cf21-46c0-9b3c-26e931868de4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:25.101179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430a7f3-cf21-46c0-9b3c-26e931868de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:25.101450 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430a7f3-cf21-46c0-9b3c-26e931868de4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:25.121645 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430a7f3-cf21-46c0-9b3c-26e931868de4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:25.123037 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430a7f3-cf21-46c0-9b3c-26e931868de4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:25.146416 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a661dd-9fc0-4793-92ab-35a00cb0e6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:25.147143 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a661dd-9fc0-4793-92ab-35a00cb0e6ec None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:25.147424 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a661dd-9fc0-4793-92ab-35a00cb0e6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:25.147696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a661dd-9fc0-4793-92ab-35a00cb0e6ec None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:25.148536 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a661dd-9fc0-4793-92ab-35a00cb0e6ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:25.148840 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a661dd-9fc0-4793-92ab-35a00cb0e6ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:25.150248 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a661dd-9fc0-4793-92ab-35a00cb0e6ec None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:25.161443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5430a7f3-cf21-46c0-9b3c-26e931868de4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:25.161443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:25.161443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:25.161443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:25.161443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:25.161443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:25.161443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:25.161443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:25.161443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:25.161443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:25.161443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:25.161443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:25.161443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:25.161443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:25.161443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:25.162395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:25.162395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:25.162395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:25.162395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:25.162395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:25.162395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:25.162395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:25.162395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:25.162395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:25.162395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:25.162395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:25.162395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:25.162395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:25.162395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:25.162395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:25.162395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:25.162395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:25.163274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:25.163274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:25.163274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:25.163274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:25.165600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 284/553] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:25.172060 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430a7f3-cf21-46c0-9b3c-26e931868de4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:25.173372 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 270/554] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Jul 19 12:18:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:25.183934 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a661dd-9fc0-4793-92ab-35a00cb0e6ec None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:25.223100 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:25.335038 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:25.344335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430a7f3-cf21-46c0-9b3c-26e931868de4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:25.356493 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a661dd-9fc0-4793-92ab-35a00cb0e6ec None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:25.389615 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2627e7f9-fa7b-4d2d-b8ba-c7028b421240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:25.390912 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627e7f9-fa7b-4d2d-b8ba-c7028b421240 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:25.391367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627e7f9-fa7b-4d2d-b8ba-c7028b421240 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:25.392041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627e7f9-fa7b-4d2d-b8ba-c7028b421240 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:25.393021 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627e7f9-fa7b-4d2d-b8ba-c7028b421240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:25.393468 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627e7f9-fa7b-4d2d-b8ba-c7028b421240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:25.394985 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2627e7f9-fa7b-4d2d-b8ba-c7028b421240 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:25.396137 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae4867-a619-4de1-9527-635c8fe68c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:25.396991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae4867-a619-4de1-9527-635c8fe68c02 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:25.397381 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae4867-a619-4de1-9527-635c8fe68c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:25.397769 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae4867-a619-4de1-9527-635c8fe68c02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:25.410833 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 285/555] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:25.412390 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b5243-34f6-45c3-ae45-5d69af8215c9 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:25.412934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b5243-34f6-45c3-ae45-5d69af8215c9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:25.413335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b5243-34f6-45c3-ae45-5d69af8215c9 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:25.414960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 286/556] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:25.416833 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b5243-34f6-45c3-ae45-5d69af8215c9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:25.489640 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae4867-a619-4de1-9527-635c8fe68c02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:25.491794 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae4867-a619-4de1-9527-635c8fe68c02 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:25.511266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:25.538267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b5243-34f6-45c3-ae45-5d69af8215c9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:25.576697 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead04bd7-5ec9-494f-a794-52f8debc916c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:25.577641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead04bd7-5ec9-494f-a794-52f8debc916c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:25.577947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead04bd7-5ec9-494f-a794-52f8debc916c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:25.578188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead04bd7-5ec9-494f-a794-52f8debc916c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:25.585992 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead04bd7-5ec9-494f-a794-52f8debc916c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:25.587469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead04bd7-5ec9-494f-a794-52f8debc916c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:25.600946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 271/557] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:25.602010 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d498d3-04b7-4a0d-a255-ea04b9fde639 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:25.602293 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d498d3-04b7-4a0d-a255-ea04b9fde639 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:25.602561 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d498d3-04b7-4a0d-a255-ea04b9fde639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:25.612142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ead04bd7-5ec9-494f-a794-52f8debc916c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 12:18:25.612142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:25.612142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:25.612142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:25.612142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:25.612142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:25.612142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:25.612142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:25.612142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:25.612142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:25.612142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:25.612142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:25.612142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:25.612142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:25.612142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:25.612142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:25.613611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:25.613611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:25.613611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:25.613611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:25.613611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:25.613611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:25.613611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:25.613611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:25.613611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:25.613611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:25.613611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:25.613611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:25.613611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:25.613611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:25.613611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:25.613611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:25.613611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:25.613611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:25.614533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:25.614533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:25.614533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:25.614533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:25.614533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:25.614533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:25.614533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:25.614533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:25.614533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 12:18:25.614533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:25.614533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 287/558] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Jul 19 12:18:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:25.614533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e579070-9783-4e8a-a284-4a5a8c164714 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:25.614533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e579070-9783-4e8a-a284-4a5a8c164714 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:25.619560 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e579070-9783-4e8a-a284-4a5a8c164714 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:25.619560 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 288/559] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:25.619560 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e579070-9783-4e8a-a284-4a5a8c164714 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:25.630616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-f7d498d3-04b7-4a0d-a255-ea04b9fde639 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:25.632735 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f7d498d3-04b7-4a0d-a255-ea04b9fde639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:25.649307 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:25.724751 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 272/560] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:25.725629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d498d3-04b7-4a0d-a255-ea04b9fde639 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:25.761064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e579070-9783-4e8a-a284-4a5a8c164714 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:25.790921 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:25.802123 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee380f12-55f4-45e8-8030-0019ebdc0468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:25.803058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee380f12-55f4-45e8-8030-0019ebdc0468 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:25.803339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee380f12-55f4-45e8-8030-0019ebdc0468 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:25.803717 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee380f12-55f4-45e8-8030-0019ebdc0468 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:25.804556 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee380f12-55f4-45e8-8030-0019ebdc0468 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:25.804859 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee380f12-55f4-45e8-8030-0019ebdc0468 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:25.806501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee380f12-55f4-45e8-8030-0019ebdc0468 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:25.836628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 289/561] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Jul 19 12:18:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:25.838232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01453e3-f34d-4d2a-9137-09dcea085006 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:25.838561 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01453e3-f34d-4d2a-9137-09dcea085006 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:25.838859 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01453e3-f34d-4d2a-9137-09dcea085006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:25.856541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d498d3-04b7-4a0d-a255-ea04b9fde639 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:25.858774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d01453e3-f34d-4d2a-9137-09dcea085006 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:25.860092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d01453e3-f34d-4d2a-9137-09dcea085006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:25.896072 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd8408-7b19-47be-8ab9-f437256f196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:25.896879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd8408-7b19-47be-8ab9-f437256f196a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:25.897163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd8408-7b19-47be-8ab9-f437256f196a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:25.897442 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd8408-7b19-47be-8ab9-f437256f196a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:25.909333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd8408-7b19-47be-8ab9-f437256f196a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:25.910837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd8408-7b19-47be-8ab9-f437256f196a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:25.931055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-e6cd8408-7b19-47be-8ab9-f437256f196a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:25.931055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:25.931055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:25.931055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:25.931055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:25.931055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:25.931055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:25.931055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:25.931055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:25.931055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:25.931055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:25.931055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:25.931055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:25.931055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:25.931055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:25.931943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:25.931943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:25.931943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:25.931943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:25.931943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:25.931943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:25.931943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:25.931943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:25.931943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:25.931943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:25.931943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:25.931943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:25.931943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:25.931943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:25.931943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:25.931943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:25.931943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:25.932814 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:25.932814 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:25.932814 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:25.932814 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:25.932814 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 273/562] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:25.933735 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd8408-7b19-47be-8ab9-f437256f196a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:25.955047 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 290/563] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:25.955835 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01453e3-f34d-4d2a-9137-09dcea085006 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:25.959511 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:26.045466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:26.049504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd8408-7b19-47be-8ab9-f437256f196a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:26.065364 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01453e3-f34d-4d2a-9137-09dcea085006 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:26.087622 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d72437-57bd-4757-abf6-d7832a1e6af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:26.088535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d72437-57bd-4757-abf6-d7832a1e6af6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:26.088819 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d72437-57bd-4757-abf6-d7832a1e6af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:26.089209 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d72437-57bd-4757-abf6-d7832a1e6af6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:26.099868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb597f3-2a9b-4114-9af2-fa3d6107c4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:26.100036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d72437-57bd-4757-abf6-d7832a1e6af6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:26.100668 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb597f3-2a9b-4114-9af2-fa3d6107c4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:26.100950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb597f3-2a9b-4114-9af2-fa3d6107c4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:26.101224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb597f3-2a9b-4114-9af2-fa3d6107c4d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:26.108292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-e1d72437-57bd-4757-abf6-d7832a1e6af6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:26.108292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:26.108292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:26.108292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:26.108292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:26.108292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:26.108292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:26.108292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:26.108292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:26.108292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:26.108292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:26.108292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:26.108292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:26.108292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:26.108292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:26.108292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:26.109246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:26.109246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:26.109246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:26.109246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:26.109246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:26.109246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:26.109246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:26.109246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:26.109246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:26.109246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:26.109246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:26.109246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:26.109246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:26.109246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:26.109246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:26.109246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:26.110090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:26.110090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:26.110090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:26.110090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:26.110090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:26.110090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:26.110090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:26.110090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:26.110090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:26.110090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:26.110090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:26.110090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:26.110090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 274/564] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:26.111869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d72437-57bd-4757-abf6-d7832a1e6af6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:26.117199 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb597f3-2a9b-4114-9af2-fa3d6107c4d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:26.118663 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb597f3-2a9b-4114-9af2-fa3d6107c4d3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:26.137366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ffb597f3-2a9b-4114-9af2-fa3d6107c4d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:26.137366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:26.137366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:26.137366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:26.137366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:26.137366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:26.137366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:26.137366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:26.137366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:26.137366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:26.137366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:26.137366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:26.137366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:26.137366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:26.137366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:26.138436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:26.138436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:26.138436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:26.138436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:26.138436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:26.138436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:26.138436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:26.138436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:26.138436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:26.138436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:26.138436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:26.138436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:26.138436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:26.138436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:26.138436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:26.138436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:26.138436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:26.139826 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:26.139826 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:26.139826 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:26.139826 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:26.143524 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 291/565] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:26.144370 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb597f3-2a9b-4114-9af2-fa3d6107c4d3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:26.205520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:26.220913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d72437-57bd-4757-abf6-d7832a1e6af6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:26.253782 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb597f3-2a9b-4114-9af2-fa3d6107c4d3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:26.259568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d8ab7-6bcf-4d91-89d4-1b63b02db35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:26.260238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d8ab7-6bcf-4d91-89d4-1b63b02db35b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:26.260521 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d8ab7-6bcf-4d91-89d4-1b63b02db35b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:26.260799 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d8ab7-6bcf-4d91-89d4-1b63b02db35b None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:26.261897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d8ab7-6bcf-4d91-89d4-1b63b02db35b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:26.261897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d8ab7-6bcf-4d91-89d4-1b63b02db35b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:26.263237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d8ab7-6bcf-4d91-89d4-1b63b02db35b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:26.275277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 275/566] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:26.276077 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d8ab7-6bcf-4d91-89d4-1b63b02db35b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:26.289274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92807dd-6475-4801-b234-bb9f58c5f9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:26.290049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92807dd-6475-4801-b234-bb9f58c5f9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:26.290328 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92807dd-6475-4801-b234-bb9f58c5f9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:26.290602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92807dd-6475-4801-b234-bb9f58c5f9a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:26.298572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:26.301586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92807dd-6475-4801-b234-bb9f58c5f9a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:26.309349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b92807dd-6475-4801-b234-bb9f58c5f9a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:26.309349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:26.309349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:26.309349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:26.309349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:26.309349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:26.309349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:26.309349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:26.309349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:26.309349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:26.309349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:26.309349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:26.309349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:26.309349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:26.309349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:26.309349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:26.310249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:26.310249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:26.310249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:26.310249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:26.310249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:26.310249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:26.310249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:26.310249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:26.310249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:26.310249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:26.310249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:26.310249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:26.310249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:26.310249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:26.310249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:26.310249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:26.311113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:26.311113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:26.311113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:26.311113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:26.311113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:26.311113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:26.311113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:26.311113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:26.311113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:26.311113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:26.311113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:26.311113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:26.311113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 292/567] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:26.311803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92807dd-6475-4801-b234-bb9f58c5f9a2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:26.381017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d8ab7-6bcf-4d91-89d4-1b63b02db35b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:26.413286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92807dd-6475-4801-b234-bb9f58c5f9a2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:26.416765 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611c746-8acf-41cc-b77c-d88fb36c44f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:26.417434 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c746-8acf-41cc-b77c-d88fb36c44f6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:26.417716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c746-8acf-41cc-b77c-d88fb36c44f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:26.417991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c746-8acf-41cc-b77c-d88fb36c44f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:26.418751 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611c746-8acf-41cc-b77c-d88fb36c44f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:26.419062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611c746-8acf-41cc-b77c-d88fb36c44f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:26.420501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611c746-8acf-41cc-b77c-d88fb36c44f6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:26.429150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 276/568] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:18:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:26.430556 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f8858-4e03-49d2-8c65-0193f8a5ba0e None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:26.431025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f8858-4e03-49d2-8c65-0193f8a5ba0e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:26.431299 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f8858-4e03-49d2-8c65-0193f8a5ba0e None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:26.432654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 277/569] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:26.433932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:26.437431 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f8858-4e03-49d2-8c65-0193f8a5ba0e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:26.448604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cee626-6f69-49d0-8aed-62c4cc43ab99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:26.449264 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cee626-6f69-49d0-8aed-62c4cc43ab99 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:26.449550 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cee626-6f69-49d0-8aed-62c4cc43ab99 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:26.449825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cee626-6f69-49d0-8aed-62c4cc43ab99 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:26.450541 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cee626-6f69-49d0-8aed-62c4cc43ab99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:26.450876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cee626-6f69-49d0-8aed-62c4cc43ab99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:26.452245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cee626-6f69-49d0-8aed-62c4cc43ab99 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:26.465086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 293/570] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:26.465908 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cee626-6f69-49d0-8aed-62c4cc43ab99 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:26.522086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:26.545044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f8858-4e03-49d2-8c65-0193f8a5ba0e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:26.573054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cee626-6f69-49d0-8aed-62c4cc43ab99 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:26.579008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb471a-c23d-4b4e-b2c5-8571b3bd4446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:26.580333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb471a-c23d-4b4e-b2c5-8571b3bd4446 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:26.580782 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb471a-c23d-4b4e-b2c5-8571b3bd4446 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:26.581053 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb471a-c23d-4b4e-b2c5-8571b3bd4446 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:26.587848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb471a-c23d-4b4e-b2c5-8571b3bd4446 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:26.589283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb471a-c23d-4b4e-b2c5-8571b3bd4446 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:26.604411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-90cb471a-c23d-4b4e-b2c5-8571b3bd4446 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:26.604411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:26.604411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:26.604411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:26.604411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:26.604411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:26.604411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:26.604411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:26.604411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:26.604411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:26.604411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:26.604411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:26.604411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:26.604411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:26.604411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:26.605330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:26.605330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:26.605330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:26.605330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:26.605330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:26.605330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:26.605330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:26.605330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:26.605330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:26.605330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:26.605330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:26.605330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:26.605330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:26.605330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:26.605330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:26.605330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:26.605330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:26.606193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:26.606193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:26.606193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:26.606193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:26.606193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:26.606193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:26.606193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:26.606193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:26.606193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 278/571] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:26.606655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb471a-c23d-4b4e-b2c5-8571b3bd4446 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:26.608987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769887b-9ccf-4c70-a6bc-0fc7e05e87c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:26.609550 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769887b-9ccf-4c70-a6bc-0fc7e05e87c9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:26.609829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769887b-9ccf-4c70-a6bc-0fc7e05e87c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:26.610112 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769887b-9ccf-4c70-a6bc-0fc7e05e87c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:26.610873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769887b-9ccf-4c70-a6bc-0fc7e05e87c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:26.611263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769887b-9ccf-4c70-a6bc-0fc7e05e87c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:26.612743 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769887b-9ccf-4c70-a6bc-0fc7e05e87c9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:26.620956 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 294/572] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:18:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:26.622294 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b796b9-5f2c-4843-a879-506cb7473144 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:26.622294 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b796b9-5f2c-4843-a879-506cb7473144 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:26.622565 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b796b9-5f2c-4843-a879-506cb7473144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:26.639936 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-19b796b9-5f2c-4843-a879-506cb7473144 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:26.641112 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-19b796b9-5f2c-4843-a879-506cb7473144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:26.670778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:26.707309 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb471a-c23d-4b4e-b2c5-8571b3bd4446 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:26.711843 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 295/573] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:26.712690 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b796b9-5f2c-4843-a879-506cb7473144 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:26.742951 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e6659-0f69-4065-9473-0c88dc7feed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:26.743774 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e6659-0f69-4065-9473-0c88dc7feed6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:26.744128 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e6659-0f69-4065-9473-0c88dc7feed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:26.744471 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e6659-0f69-4065-9473-0c88dc7feed6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:26.754894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e6659-0f69-4065-9473-0c88dc7feed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:26.756366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e6659-0f69-4065-9473-0c88dc7feed6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:26.758085 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:26.775977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-558e6659-0f69-4065-9473-0c88dc7feed6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:26.775977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:26.775977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:26.775977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:26.775977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:26.775977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:26.775977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:26.775977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:26.775977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:26.775977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:26.775977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:26.775977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:26.775977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:26.775977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:26.775977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:26.776909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:26.776909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:26.776909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:26.776909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:26.776909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:26.776909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:26.776909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:26.776909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:26.776909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:26.776909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:26.776909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:26.776909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:26.776909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:26.776909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:26.776909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:26.776909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:26.776909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:26.777764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:26.777764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:26.777764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:26.777764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:26.777764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 279/574] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:26.778244 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e6659-0f69-4065-9473-0c88dc7feed6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:26.812708 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b796b9-5f2c-4843-a879-506cb7473144 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:26.848355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d206283-556e-4c7e-8499-9b97ade15a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:26.849153 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d206283-556e-4c7e-8499-9b97ade15a49 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:26.849434 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d206283-556e-4c7e-8499-9b97ade15a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:26.849708 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d206283-556e-4c7e-8499-9b97ade15a49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:26.856417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d206283-556e-4c7e-8499-9b97ade15a49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:26.857879 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d206283-556e-4c7e-8499-9b97ade15a49 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:26.872224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-0d206283-556e-4c7e-8499-9b97ade15a49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:26.872224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:26.872224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:26.872224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:26.872224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:26.872224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:26.872224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:26.872224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:26.872224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:26.872224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:26.872224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:26.872224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:26.872224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:26.872224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:26.872224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:26.873519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:26.873519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:26.873519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:26.873519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:26.873519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:26.873519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:26.873519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:26.873519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:26.873519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:26.873519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:26.873519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:26.873519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:26.873519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:26.873519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:26.873519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:26.873519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:26.873519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:26.874417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:26.874417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:26.874417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:26.874417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:26.874417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:26.874417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:26.874417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:26.874417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:26.874417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 296/575] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:26.874417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d206283-556e-4c7e-8499-9b97ade15a49 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:26.884817 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e6659-0f69-4065-9473-0c88dc7feed6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:26.904167 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:26.919828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8fb9e-e52e-4419-b6bd-780ee3d28f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:26.920490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8fb9e-e52e-4419-b6bd-780ee3d28f77 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:26.920773 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8fb9e-e52e-4419-b6bd-780ee3d28f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:26.921047 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8fb9e-e52e-4419-b6bd-780ee3d28f77 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:26.921829 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8fb9e-e52e-4419-b6bd-780ee3d28f77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:26.922139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8fb9e-e52e-4419-b6bd-780ee3d28f77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:26.923606 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8fb9e-e52e-4419-b6bd-780ee3d28f77 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:26.935134 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 280/576] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:26.935926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8fb9e-e52e-4419-b6bd-780ee3d28f77 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:26.984949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d206283-556e-4c7e-8499-9b97ade15a49 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:26.995467 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:27.019886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb6bbc-39ce-42ae-838c-1708ae2c38fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:27.020671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb6bbc-39ce-42ae-838c-1708ae2c38fd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:27.020945 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb6bbc-39ce-42ae-838c-1708ae2c38fd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:27.021213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb6bbc-39ce-42ae-838c-1708ae2c38fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:27.031545 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb6bbc-39ce-42ae-838c-1708ae2c38fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:27.032999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb6bbc-39ce-42ae-838c-1708ae2c38fd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:27.041082 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8fb9e-e52e-4419-b6bd-780ee3d28f77 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:27.049707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5dcb6bbc-39ce-42ae-838c-1708ae2c38fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:27.049707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:27.049707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:27.049707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:27.049707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:27.049707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:27.049707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:27.049707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:27.049707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:27.049707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:27.049707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:27.049707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:27.049707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:27.049707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:27.049707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:27.050695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:27.050695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:27.050695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:27.050695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:27.050695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:27.050695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:27.050695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:27.050695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:27.050695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:27.050695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:27.050695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:27.050695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:27.050695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:27.050695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:27.050695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:27.050695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:27.050695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:27.051671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:27.051671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:27.051671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:27.051671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:27.051671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 297/577] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:27.051671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb6bbc-39ce-42ae-838c-1708ae2c38fd None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:27.076852 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de9ff4-519e-4822-838c-9e02878fa2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:27.077651 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de9ff4-519e-4822-838c-9e02878fa2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:27.077939 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de9ff4-519e-4822-838c-9e02878fa2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:27.078209 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de9ff4-519e-4822-838c-9e02878fa2c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:27.088295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de9ff4-519e-4822-838c-9e02878fa2c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:27.096642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-64de9ff4-519e-4822-838c-9e02878fa2c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:27.096642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:27.096642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:27.096642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:27.096642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:27.096642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:27.096642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:27.096642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:27.096642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:27.096642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:27.096642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:27.096642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:27.096642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:27.096642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:27.096642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:27.096642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:27.098566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:27.098566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:27.098566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:27.098566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:27.098566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:27.098566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:27.098566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:27.098566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:27.098566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:27.098566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:27.098566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:27.098566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:27.098566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:27.098566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:27.098566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:27.098566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:27.100481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:27.100481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:27.100481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:27.100481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:27.100481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:27.100481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:27.100481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:27.100481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:27.100481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:27.100481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:27.100481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:27.100481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:27.100481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 281/578] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:27.100481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de9ff4-519e-4822-838c-9e02878fa2c8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:27.138241 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:27.158907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb6bbc-39ce-42ae-838c-1708ae2c38fd None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:27.193337 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd32226-0403-4042-802d-eb9a829389c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:27.193990 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd32226-0403-4042-802d-eb9a829389c4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:27.194263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd32226-0403-4042-802d-eb9a829389c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:27.194535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd32226-0403-4042-802d-eb9a829389c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:27.195276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd32226-0403-4042-802d-eb9a829389c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:27.195577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd32226-0403-4042-802d-eb9a829389c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:27.197045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd32226-0403-4042-802d-eb9a829389c4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:27.199938 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de9ff4-519e-4822-838c-9e02878fa2c8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:27.209269 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 298/579] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:27.210057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd32226-0403-4042-802d-eb9a829389c4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:27.217448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:27.238667 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96093588-6176-47de-9a30-1b7afcf48290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:27.239363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96093588-6176-47de-9a30-1b7afcf48290 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:27.239649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96093588-6176-47de-9a30-1b7afcf48290 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:27.239920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96093588-6176-47de-9a30-1b7afcf48290 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:27.240700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96093588-6176-47de-9a30-1b7afcf48290 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:27.241008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96093588-6176-47de-9a30-1b7afcf48290 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:27.242527 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96093588-6176-47de-9a30-1b7afcf48290 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:27.254629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 282/580] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:27.255402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96093588-6176-47de-9a30-1b7afcf48290 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:27.314699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd32226-0403-4042-802d-eb9a829389c4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:27.348385 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0344560-e816-4791-98f5-b2fd0c3f210d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:27.349026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0344560-e816-4791-98f5-b2fd0c3f210d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:27.349301 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0344560-e816-4791-98f5-b2fd0c3f210d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:27.349567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0344560-e816-4791-98f5-b2fd0c3f210d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:27.350381 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0344560-e816-4791-98f5-b2fd0c3f210d None admin] RBAC: Adding query filter params (role.id=42cae330d9ab456c8212ca146daf9322, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=35cc2e1079d34745a279588028945c3c) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:27.350684 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0344560-e816-4791-98f5-b2fd0c3f210d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:27.352108 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0344560-e816-4791-98f5-b2fd0c3f210d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:27.353411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96093588-6176-47de-9a30-1b7afcf48290 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:27.357916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 299/581] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:18:27 2022] GET /identity/v3/role_assignments?user.id=35cc2e1079d34745a279588028945c3c&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=42cae330d9ab456c8212ca146daf9322 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:27.358907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0344560-e816-4791-98f5-b2fd0c3f210d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:27.372550 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:27.390680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e74ec2-fbc6-4d03-a914-c0a70bca4dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:27.391768 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e74ec2-fbc6-4d03-a914-c0a70bca4dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:27.392764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e74ec2-fbc6-4d03-a914-c0a70bca4dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:27.393232 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e74ec2-fbc6-4d03-a914-c0a70bca4dc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:27.394197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e74ec2-fbc6-4d03-a914-c0a70bca4dc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:27.394696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e74ec2-fbc6-4d03-a914-c0a70bca4dc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:27.396324 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e74ec2-fbc6-4d03-a914-c0a70bca4dc5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:27.414564 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 283/582] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:27.414564 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e74ec2-fbc6-4d03-a914-c0a70bca4dc5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:27.464538 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:27.491163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0344560-e816-4791-98f5-b2fd0c3f210d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:27.529109 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230c0d8-640c-43ef-ab79-2b02b857b072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:27.529702 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230c0d8-640c-43ef-ab79-2b02b857b072 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:27.529979 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230c0d8-640c-43ef-ab79-2b02b857b072 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:27.530248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230c0d8-640c-43ef-ab79-2b02b857b072 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:27.531013 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230c0d8-640c-43ef-ab79-2b02b857b072 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:27.531309 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230c0d8-640c-43ef-ab79-2b02b857b072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:27.532662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230c0d8-640c-43ef-ab79-2b02b857b072 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:27.541628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 300/583] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:18:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:27.544563 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230c0d8-640c-43ef-ab79-2b02b857b072 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:27.549115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e74ec2-fbc6-4d03-a914-c0a70bca4dc5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:27.582642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc5bf0-e9f0-411e-86e5-89b11abef78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:27.583475 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc5bf0-e9f0-411e-86e5-89b11abef78c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:27.583758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc5bf0-e9f0-411e-86e5-89b11abef78c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:27.584024 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc5bf0-e9f0-411e-86e5-89b11abef78c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:27.591699 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc5bf0-e9f0-411e-86e5-89b11abef78c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:27.593123 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc5bf0-e9f0-411e-86e5-89b11abef78c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:27.607815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-decc5bf0-e9f0-411e-86e5-89b11abef78c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 12:18:27.607815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:27.607815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:27.607815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:27.607815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:27.607815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:27.607815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:27.607815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:27.607815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:27.607815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:27.607815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:27.607815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:27.607815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:27.607815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:27.607815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:27.607815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:27.608757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:27.608757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:27.608757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:27.608757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:27.608757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:27.608757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:27.608757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:27.608757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:27.608757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:27.608757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:27.608757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:27.608757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:27.608757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:27.608757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:27.608757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:27.608757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:27.608757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:27.608757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:27.614928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:27.614928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:27.614928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:27.614928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:27.614928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:27.614928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:27.614928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:27.614928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:27.614928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 12:18:27.614928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:27.614928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 284/584] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:27.614928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc5bf0-e9f0-411e-86e5-89b11abef78c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:27.618100 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:27.657617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230c0d8-640c-43ef-ab79-2b02b857b072 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:27.699165 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f002131-2fba-48ff-ab48-b710b5fa9077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:27.700440 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f002131-2fba-48ff-ab48-b710b5fa9077 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:27.701166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f002131-2fba-48ff-ab48-b710b5fa9077 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:27.701166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f002131-2fba-48ff-ab48-b710b5fa9077 None admin] PATH_INFO: `/v3/projects/1ba395a1e22f430084089947e47a622d/users/5d9543657e1e4a6d85632bf57f6ba6eb/roles/42cae330d9ab456c8212ca146daf9322` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:27.716569 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f002131-2fba-48ff-ab48-b710b5fa9077 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba395a1e22f430084089947e47a622d, user_id=5d9543657e1e4a6d85632bf57f6ba6eb, role_id=42cae330d9ab456c8212ca146daf9322)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:27.717080 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:27.718722 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f002131-2fba-48ff-ab48-b710b5fa9077 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:27.726436 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc5bf0-e9f0-411e-86e5-89b11abef78c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:27.735680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 301/585] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:18:27 2022] PUT /identity/v3/projects/1ba395a1e22f430084089947e47a622d/users/5d9543657e1e4a6d85632bf57f6ba6eb/roles/42cae330d9ab456c8212ca146daf9322 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:18:27.737258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f002131-2fba-48ff-ab48-b710b5fa9077 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:27.765119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5e4dd-a9e6-4dbc-b1b4-de7ec223d467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:27.766126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5e4dd-a9e6-4dbc-b1b4-de7ec223d467 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:27.766482 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5e4dd-a9e6-4dbc-b1b4-de7ec223d467 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:27.766856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5e4dd-a9e6-4dbc-b1b4-de7ec223d467 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:27.777072 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5e4dd-a9e6-4dbc-b1b4-de7ec223d467 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:27.778643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5e4dd-a9e6-4dbc-b1b4-de7ec223d467 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:27.795168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-58b5e4dd-a9e6-4dbc-b1b4-de7ec223d467 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 12:18:27.795168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:27.795168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:27.795168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:27.795168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:27.795168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:27.795168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:27.795168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:27.795168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:27.795168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:27.795168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:27.795168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:27.795168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:27.795168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:27.795168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:27.795168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:27.796102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:27.796102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:27.796102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:27.796102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:27.796102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:27.796102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:27.796102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:27.796102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:27.796102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:27.796102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:27.796102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:27.796102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:27.796102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:27.796102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:27.796102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:27.796102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:27.796102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:27.796102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:27.796996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:27.796996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:27.796996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:27.796996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:27.796996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:27.796996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:27.796996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:27.796996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:27.796996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 12:18:27.796996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:27.801799 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 285/586] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:27.802975 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5e4dd-a9e6-4dbc-b1b4-de7ec223d467 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:27.885798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f002131-2fba-48ff-ab48-b710b5fa9077 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:27.906425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:27.932415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05409fe-a261-4c29-a8b8-78b27d436a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:27.933210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05409fe-a261-4c29-a8b8-78b27d436a79 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:27.933484 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05409fe-a261-4c29-a8b8-78b27d436a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:27.933748 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05409fe-a261-4c29-a8b8-78b27d436a79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:27.934331 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5e4dd-a9e6-4dbc-b1b4-de7ec223d467 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:27.946496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05409fe-a261-4c29-a8b8-78b27d436a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:27.948120 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05409fe-a261-4c29-a8b8-78b27d436a79 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:27.967432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f05409fe-a261-4c29-a8b8-78b27d436a79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:27.967432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:27.967432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:27.967432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:27.967432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:27.967432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:27.967432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:27.967432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:27.967432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:27.967432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:27.967432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:27.967432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:27.967432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:27.967432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:27.967432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:27.968567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:27.968567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:27.968567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:27.968567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:27.968567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:27.968567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:27.968567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:27.968567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:27.968567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:27.968567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:27.968567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:27.968567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:27.968567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:27.968567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:27.968567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:27.968567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:27.968567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:27.969660 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:27.969660 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:27.969660 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:27.969660 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:27.971891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 302/587] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:27.972788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05409fe-a261-4c29-a8b8-78b27d436a79 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:27.979758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476a65f-9edf-4300-a188-3c43484a91f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:27.980666 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476a65f-9edf-4300-a188-3c43484a91f0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:27.981128 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476a65f-9edf-4300-a188-3c43484a91f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:27.981555 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476a65f-9edf-4300-a188-3c43484a91f0 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:27.983171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476a65f-9edf-4300-a188-3c43484a91f0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:27.983635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476a65f-9edf-4300-a188-3c43484a91f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:27.985695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476a65f-9edf-4300-a188-3c43484a91f0 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:28.012962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 286/588] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Jul 19 12:18:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:28.014339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476a65f-9edf-4300-a188-3c43484a91f0 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:28.033852 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:28.092420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05409fe-a261-4c29-a8b8-78b27d436a79 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:28.124973 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476a65f-9edf-4300-a188-3c43484a91f0 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:28.132351 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1c95a-b554-4c47-ad86-dd53bda33d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:28.133394 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1c95a-b554-4c47-ad86-dd53bda33d30 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:28.133835 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1c95a-b554-4c47-ad86-dd53bda33d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:28.134257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1c95a-b554-4c47-ad86-dd53bda33d30 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:28.135383 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1c95a-b554-4c47-ad86-dd53bda33d30 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:28.135861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1c95a-b554-4c47-ad86-dd53bda33d30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:28.137545 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1c95a-b554-4c47-ad86-dd53bda33d30 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:28.158728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 303/589] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Jul 19 12:18:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:28.159869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1c95a-b554-4c47-ad86-dd53bda33d30 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:28.162298 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbedd71-8e71-4bf7-a13d-cd2a6bbe8d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:28.163097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbedd71-8e71-4bf7-a13d-cd2a6bbe8d38 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:28.163472 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbedd71-8e71-4bf7-a13d-cd2a6bbe8d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:28.163841 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbedd71-8e71-4bf7-a13d-cd2a6bbe8d38 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:28.165050 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbedd71-8e71-4bf7-a13d-cd2a6bbe8d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:28.165050 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbedd71-8e71-4bf7-a13d-cd2a6bbe8d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:28.166463 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbedd71-8e71-4bf7-a13d-cd2a6bbe8d38 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:28.180800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 287/590] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:28.181723 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbedd71-8e71-4bf7-a13d-cd2a6bbe8d38 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:28.192739 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:28.257420 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:28.276677 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1c95a-b554-4c47-ad86-dd53bda33d30 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:28.292057 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbedd71-8e71-4bf7-a13d-cd2a6bbe8d38 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:28.316784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1954bf8-7687-4ca1-9c8f-aed8330c8f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:28.317906 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1954bf8-7687-4ca1-9c8f-aed8330c8f45 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:28.318391 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1954bf8-7687-4ca1-9c8f-aed8330c8f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:28.318946 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1954bf8-7687-4ca1-9c8f-aed8330c8f45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:28.327585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5405ef-4172-43ee-af41-c40b88f9f85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:28.328401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5405ef-4172-43ee-af41-c40b88f9f85a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:28.328958 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5405ef-4172-43ee-af41-c40b88f9f85a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:28.329070 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5405ef-4172-43ee-af41-c40b88f9f85a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:28.331975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1954bf8-7687-4ca1-9c8f-aed8330c8f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:28.333753 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1954bf8-7687-4ca1-9c8f-aed8330c8f45 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:28.340946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5405ef-4172-43ee-af41-c40b88f9f85a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:28.342536 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5405ef-4172-43ee-af41-c40b88f9f85a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:28.353921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f1954bf8-7687-4ca1-9c8f-aed8330c8f45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:28.353921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:28.353921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:28.353921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:28.353921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:28.353921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:28.353921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:28.353921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:28.353921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:28.353921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:28.353921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:28.353921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:28.353921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:28.353921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:28.353921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:28.354876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:28.354876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:28.354876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:28.354876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:28.354876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:28.354876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:28.354876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:28.354876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:28.354876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:28.354876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:28.354876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:28.354876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:28.354876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:28.354876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:28.354876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:28.354876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:28.354876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:28.355744 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:28.355744 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:28.355744 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:28.355744 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:28.358060 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 304/591] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:28.359188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1954bf8-7687-4ca1-9c8f-aed8330c8f45 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:28.363058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-af5405ef-4172-43ee-af41-c40b88f9f85a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:28.363058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:28.363058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:28.363058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:28.363058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:28.363058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:28.363058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:28.363058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:28.363058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:28.363058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:28.363058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:28.363058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:28.363058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:28.363058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:28.363058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:28.363932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:28.363932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:28.363932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:28.363932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:28.363932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:28.363932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:28.363932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:28.363932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:28.363932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:28.363932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:28.363932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:28.363932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:28.363932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:28.363932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:28.363932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:28.363932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:28.363932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:28.364781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:28.364781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:28.364781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:28.364781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:28.364781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 288/592] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:28.365733 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5405ef-4172-43ee-af41-c40b88f9f85a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:28.448198 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:28.475432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5405ef-4172-43ee-af41-c40b88f9f85a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:28.476155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1954bf8-7687-4ca1-9c8f-aed8330c8f45 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:28.501525 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:28.514393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f793c18-a760-43c1-a29b-3bddbe282475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:28.515179 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f793c18-a760-43c1-a29b-3bddbe282475 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:28.515526 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f793c18-a760-43c1-a29b-3bddbe282475 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:28.515866 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f793c18-a760-43c1-a29b-3bddbe282475 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:28.516658 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f793c18-a760-43c1-a29b-3bddbe282475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:28.517036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f793c18-a760-43c1-a29b-3bddbe282475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:28.519133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73478d1-5b5b-467c-a4e9-9567ef6ea77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:28.519270 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f793c18-a760-43c1-a29b-3bddbe282475 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:28.520211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73478d1-5b5b-467c-a4e9-9567ef6ea77e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:28.520740 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73478d1-5b5b-467c-a4e9-9567ef6ea77e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:28.521192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73478d1-5b5b-467c-a4e9-9567ef6ea77e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:28.529756 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73478d1-5b5b-467c-a4e9-9567ef6ea77e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:28.531406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73478d1-5b5b-467c-a4e9-9567ef6ea77e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:28.532251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 289/593] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:28.533080 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f793c18-a760-43c1-a29b-3bddbe282475 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:28.549890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f73478d1-5b5b-467c-a4e9-9567ef6ea77e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 12:18:28.549890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:28.549890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:28.549890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:28.549890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:28.549890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:28.549890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:28.549890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:28.549890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:28.549890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:28.549890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:28.549890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:28.549890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:28.549890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:28.549890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:28.549890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:28.551082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:28.551082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:28.551082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:28.551082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:28.551082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:28.551082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:28.551082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:28.551082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:28.551082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:28.551082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:28.551082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:28.551082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:28.551082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:28.551082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:28.551082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:28.551082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:28.551082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:28.551082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:28.552263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:28.552263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:28.552263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:28.552263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:28.552263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:28.552263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:28.552263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:28.552263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:28.552263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 12:18:28.552263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:28.554700 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 305/594] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:28.555643 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73478d1-5b5b-467c-a4e9-9567ef6ea77e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:28.637044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f793c18-a760-43c1-a29b-3bddbe282475 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:28.669449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73478d1-5b5b-467c-a4e9-9567ef6ea77e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:28.672684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fe891-531b-40d8-9bcc-096205c081d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:28.672684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fe891-531b-40d8-9bcc-096205c081d8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:28.673098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fe891-531b-40d8-9bcc-096205c081d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:28.673487 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fe891-531b-40d8-9bcc-096205c081d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:28.674292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fe891-531b-40d8-9bcc-096205c081d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:28.674662 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fe891-531b-40d8-9bcc-096205c081d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:28.676108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fe891-531b-40d8-9bcc-096205c081d8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:28.693091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 290/595] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:28.693091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fe891-531b-40d8-9bcc-096205c081d8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:28.714615 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11efdf-6658-43f9-b555-d427821bb8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:28.715958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11efdf-6658-43f9-b555-d427821bb8df None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:28.716416 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11efdf-6658-43f9-b555-d427821bb8df None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:28.716889 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11efdf-6658-43f9-b555-d427821bb8df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:28.725370 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11efdf-6658-43f9-b555-d427821bb8df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:28.727146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11efdf-6658-43f9-b555-d427821bb8df None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:28.729031 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:28.737469 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:28.744521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-0a11efdf-6658-43f9-b555-d427821bb8df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:28.744521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:28.744521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:28.744521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:28.744521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:28.744521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:28.744521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:28.744521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:28.744521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:28.744521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:28.744521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:28.744521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:28.744521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:28.744521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:28.744521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:28.745367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:28.745367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:28.745367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:28.745367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:28.745367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:28.745367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:28.745367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:28.745367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:28.745367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:28.745367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:28.745367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:28.745367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:28.745367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:28.745367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:28.745367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:28.745367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:28.745367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:28.746261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:28.746261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:28.746261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:28.746261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:28.746261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:28.746261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:28.746261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:28.746261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:28.749377 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 306/596] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:28.750513 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11efdf-6658-43f9-b555-d427821bb8df None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:28.793196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fe891-531b-40d8-9bcc-096205c081d8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:28.828645 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307b27e-63a3-4413-9fb9-cc2de5f747dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:28.830106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307b27e-63a3-4413-9fb9-cc2de5f747dd None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:28.830382 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307b27e-63a3-4413-9fb9-cc2de5f747dd None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:28.830657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307b27e-63a3-4413-9fb9-cc2de5f747dd None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:28.831521 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307b27e-63a3-4413-9fb9-cc2de5f747dd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:28.831827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307b27e-63a3-4413-9fb9-cc2de5f747dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:28.833247 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307b27e-63a3-4413-9fb9-cc2de5f747dd None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:28.854909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 291/597] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Jul 19 12:18:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:28.855924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307b27e-63a3-4413-9fb9-cc2de5f747dd None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:28.865026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11efdf-6658-43f9-b555-d427821bb8df None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:28.902291 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aff6c1-1592-40e7-953c-df10f8ec89ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:28.903891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aff6c1-1592-40e7-953c-df10f8ec89ad None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:28.904451 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aff6c1-1592-40e7-953c-df10f8ec89ad None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:28.904969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aff6c1-1592-40e7-953c-df10f8ec89ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:28.913347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aff6c1-1592-40e7-953c-df10f8ec89ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:28.914821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aff6c1-1592-40e7-953c-df10f8ec89ad None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:28.931266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-81aff6c1-1592-40e7-953c-df10f8ec89ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:28.931266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:28.931266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:28.931266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:28.931266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:28.931266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:28.931266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:28.931266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:28.931266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:28.931266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:28.931266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:28.931266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:28.931266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:28.931266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:28.931266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:28.932300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:28.932300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:28.932300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:28.932300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:28.932300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:28.932300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:28.932300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:28.932300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:28.932300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:28.932300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:28.932300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:28.932300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:28.932300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:28.932300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:28.932300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:28.932300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:28.932300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:28.933820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:28.933820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:28.933820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:28.933820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:28.933820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:28.933820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:28.933820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:28.933820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:28.933820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 307/598] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:28.933820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aff6c1-1592-40e7-953c-df10f8ec89ad None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:28.985217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307b27e-63a3-4413-9fb9-cc2de5f747dd None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:28.988131 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:28.999597 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:29.037230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241030a-bf4e-449d-ba01-b4da2a37fa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:29.038245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241030a-bf4e-449d-ba01-b4da2a37fa14 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:29.038926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241030a-bf4e-449d-ba01-b4da2a37fa14 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:29.039235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241030a-bf4e-449d-ba01-b4da2a37fa14 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:29.040045 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241030a-bf4e-449d-ba01-b4da2a37fa14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:29.040357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241030a-bf4e-449d-ba01-b4da2a37fa14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:29.041815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241030a-bf4e-449d-ba01-b4da2a37fa14 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:29.050693 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aff6c1-1592-40e7-953c-df10f8ec89ad None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:29.054267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 292/599] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:29.055154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241030a-bf4e-449d-ba01-b4da2a37fa14 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:29.089964 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc2b1d-c5f9-4309-9cb2-0a54bf320ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:29.091166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc2b1d-c5f9-4309-9cb2-0a54bf320ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:29.091753 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc2b1d-c5f9-4309-9cb2-0a54bf320ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:29.092334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc2b1d-c5f9-4309-9cb2-0a54bf320ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:29.104186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc2b1d-c5f9-4309-9cb2-0a54bf320ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:29.106060 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc2b1d-c5f9-4309-9cb2-0a54bf320ee2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:29.126168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a8dc2b1d-c5f9-4309-9cb2-0a54bf320ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:29.126168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:29.126168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:29.126168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:29.126168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:29.126168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:29.126168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:29.126168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:29.126168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:29.126168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:29.126168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:29.126168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:29.126168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:29.126168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:29.126168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:29.127467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:29.127467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:29.127467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:29.127467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:29.127467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:29.127467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:29.127467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:29.127467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:29.127467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:29.127467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:29.127467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:29.127467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:29.127467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:29.127467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:29.127467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:29.127467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:29.127467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:29.128369 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:29.128369 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:29.128369 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:29.128369 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:29.130727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 308/600] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:29.131740 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc2b1d-c5f9-4309-9cb2-0a54bf320ee2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:29.171191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241030a-bf4e-449d-ba01-b4da2a37fa14 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:29.207179 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c534ff6-1356-442b-94a9-b95d2b9be74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:29.207841 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c534ff6-1356-442b-94a9-b95d2b9be74f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:29.208119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c534ff6-1356-442b-94a9-b95d2b9be74f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:29.208389 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c534ff6-1356-442b-94a9-b95d2b9be74f None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:29.209198 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c534ff6-1356-442b-94a9-b95d2b9be74f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:29.209469 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c534ff6-1356-442b-94a9-b95d2b9be74f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:29.211149 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c534ff6-1356-442b-94a9-b95d2b9be74f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:29.229923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 293/601] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:29.230835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c534ff6-1356-442b-94a9-b95d2b9be74f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:29.244494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc2b1d-c5f9-4309-9cb2-0a54bf320ee2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:29.256693 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:29.257929 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:29.286100 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c4653-450d-4d7a-b7f7-b4b98be3494e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:29.287263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c4653-450d-4d7a-b7f7-b4b98be3494e None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:29.287637 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c4653-450d-4d7a-b7f7-b4b98be3494e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:29.288003 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c4653-450d-4d7a-b7f7-b4b98be3494e None admin] PATH_INFO: `/v3/projects/1ba395a1e22f430084089947e47a622d/users/726c2035855c444b88ec07a7811ea711/roles/42cae330d9ab456c8212ca146daf9322` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:29.303766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c4653-450d-4d7a-b7f7-b4b98be3494e None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba395a1e22f430084089947e47a622d, user_id=726c2035855c444b88ec07a7811ea711, role_id=42cae330d9ab456c8212ca146daf9322)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:29.305449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c4653-450d-4d7a-b7f7-b4b98be3494e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:29.327257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 309/602] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:18:29 2022] PUT /identity/v3/projects/1ba395a1e22f430084089947e47a622d/users/726c2035855c444b88ec07a7811ea711/roles/42cae330d9ab456c8212ca146daf9322 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:18:29.327257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c4653-450d-4d7a-b7f7-b4b98be3494e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:29.393304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c534ff6-1356-442b-94a9-b95d2b9be74f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:29.454242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c4653-450d-4d7a-b7f7-b4b98be3494e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:29.492397 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c3b1c-1e8c-4946-8e3b-ada79fcdf72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:29.493198 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c3b1c-1e8c-4946-8e3b-ada79fcdf72f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:29.493485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c3b1c-1e8c-4946-8e3b-ada79fcdf72f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:29.493759 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c3b1c-1e8c-4946-8e3b-ada79fcdf72f None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:29.494541 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec68b9a-ba78-44ca-ba00-5e32f3ae7b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:29.494661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c3b1c-1e8c-4946-8e3b-ada79fcdf72f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:29.494932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c3b1c-1e8c-4946-8e3b-ada79fcdf72f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:29.495464 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec68b9a-ba78-44ca-ba00-5e32f3ae7b37 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:29.495737 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec68b9a-ba78-44ca-ba00-5e32f3ae7b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:29.496002 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec68b9a-ba78-44ca-ba00-5e32f3ae7b37 None admin] PATH_INFO: `/v3/projects/1ba395a1e22f430084089947e47a622d/users/1af8b237e2df41668bc5409d8fdd3f67/roles/42cae330d9ab456c8212ca146daf9322` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:29.496313 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c3b1c-1e8c-4946-8e3b-ada79fcdf72f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:29.512978 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec68b9a-ba78-44ca-ba00-5e32f3ae7b37 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba395a1e22f430084089947e47a622d, user_id=1af8b237e2df41668bc5409d8fdd3f67, role_id=42cae330d9ab456c8212ca146daf9322)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:29.514303 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec68b9a-ba78-44ca-ba00-5e32f3ae7b37 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:29.519883 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 294/603] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:29.522304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce94df1-5b9d-4c5d-a194-5dcfb67269c3 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:29.522304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce94df1-5b9d-4c5d-a194-5dcfb67269c3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:29.522304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce94df1-5b9d-4c5d-a194-5dcfb67269c3 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:29.523437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 295/604] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:29.528959 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f3c1d-47a2-4dd6-9115-08fd51d05fb9 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:29.529218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f3c1d-47a2-4dd6-9115-08fd51d05fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:29.529505 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f3c1d-47a2-4dd6-9115-08fd51d05fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:29.531339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 310/605] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:18:29 2022] PUT /identity/v3/projects/1ba395a1e22f430084089947e47a622d/users/1af8b237e2df41668bc5409d8fdd3f67/roles/42cae330d9ab456c8212ca146daf9322 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:18:29.532208 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec68b9a-ba78-44ca-ba00-5e32f3ae7b37 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:29.545713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:29.550431 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-dd9f3c1d-47a2-4dd6-9115-08fd51d05fb9 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:29.553224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-dd9f3c1d-47a2-4dd6-9115-08fd51d05fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:29.644617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 296/606] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:18:29.668255 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec68b9a-ba78-44ca-ba00-5e32f3ae7b37 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:29.678970 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f3c1d-47a2-4dd6-9115-08fd51d05fb9 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:29.722933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:29.726174 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609befb2-c5a6-4845-8ed9-186f2476082d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:29.728499 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609befb2-c5a6-4845-8ed9-186f2476082d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:29.729026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609befb2-c5a6-4845-8ed9-186f2476082d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:29.729492 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609befb2-c5a6-4845-8ed9-186f2476082d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:29.738586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609befb2-c5a6-4845-8ed9-186f2476082d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:29.740573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609befb2-c5a6-4845-8ed9-186f2476082d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:29.756405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-609befb2-c5a6-4845-8ed9-186f2476082d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:29.756405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:29.756405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:29.756405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:29.756405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:29.756405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:29.756405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:29.756405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:29.756405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:29.756405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:29.756405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:29.756405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:29.756405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:29.756405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:29.756405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:29.757332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:29.757332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:29.757332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:29.757332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:29.757332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:29.757332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:29.757332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:29.757332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:29.757332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:29.757332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:29.757332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:29.757332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:29.757332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:29.757332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:29.757332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:29.757332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:29.757332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:29.758231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:29.758231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:29.758231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:29.758231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:29.758231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:29.758231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:29.758231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:29.758231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:29.759727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 311/607] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:29.764870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609befb2-c5a6-4845-8ed9-186f2476082d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:29.851759 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f3c1d-47a2-4dd6-9115-08fd51d05fb9 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:29.853658 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:29.887899 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbda55-795a-4e7e-bd0d-19a8cf9444b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:29.888956 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbda55-795a-4e7e-bd0d-19a8cf9444b4 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:29.889310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbda55-795a-4e7e-bd0d-19a8cf9444b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:29.889582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbda55-795a-4e7e-bd0d-19a8cf9444b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:29.894345 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609befb2-c5a6-4845-8ed9-186f2476082d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:29.900892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbda55-795a-4e7e-bd0d-19a8cf9444b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:29.914717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-13dbda55-795a-4e7e-bd0d-19a8cf9444b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:29.914717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:29.914717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:29.914717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:29.914717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:29.914717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:29.914717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:29.914717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:29.914717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:29.914717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:29.914717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:29.914717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:29.914717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:29.914717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:29.914717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:29.914717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:29.915861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:29.915861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:29.915861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:29.915861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:29.915861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:29.915861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:29.915861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:29.915861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:29.915861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:29.915861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:29.915861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:29.915861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:29.915861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:29.915861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:29.915861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:29.915861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:29.916851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:29.916851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:29.916851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:29.916851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:29.916851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:29.916851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:29.916851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:29.916851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:29.916851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:29.916851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:29.916851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:29.916851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:29.916851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 297/608] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:29.918653 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbda55-795a-4e7e-bd0d-19a8cf9444b4 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:29.956167 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c00eb6-1151-433e-ab5e-ac0198338ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:29.957095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c00eb6-1151-433e-ab5e-ac0198338ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:29.957476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c00eb6-1151-433e-ab5e-ac0198338ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:29.957860 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c00eb6-1151-433e-ab5e-ac0198338ae5 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:29.958869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c00eb6-1151-433e-ab5e-ac0198338ae5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:29.959287 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c00eb6-1151-433e-ab5e-ac0198338ae5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:29.960907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c00eb6-1151-433e-ab5e-ac0198338ae5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:29.981720 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 312/609] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:29.993557 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2b362-a779-456d-99db-d9f4dec0f0dd None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:29.993953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2b362-a779-456d-99db-d9f4dec0f0dd None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:29.994231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2b362-a779-456d-99db-d9f4dec0f0dd None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:29.995754 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 313/610] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:29.996287 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2b362-a779-456d-99db-d9f4dec0f0dd None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:30.018208 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:30.061447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbda55-795a-4e7e-bd0d-19a8cf9444b4 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:30.100522 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15599e6-9a8c-4b2d-9819-bcea1eb3f03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:30.101486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15599e6-9a8c-4b2d-9819-bcea1eb3f03b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:30.101864 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15599e6-9a8c-4b2d-9819-bcea1eb3f03b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:30.102292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15599e6-9a8c-4b2d-9819-bcea1eb3f03b None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:30.103335 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15599e6-9a8c-4b2d-9819-bcea1eb3f03b None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:30.104106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15599e6-9a8c-4b2d-9819-bcea1eb3f03b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:30.105851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15599e6-9a8c-4b2d-9819-bcea1eb3f03b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:30.117120 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 298/611] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:18:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:30.119291 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484d1b1-6a7d-4b77-9d24-60e5aa5cc882 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:30.119777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484d1b1-6a7d-4b77-9d24-60e5aa5cc882 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:30.120126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484d1b1-6a7d-4b77-9d24-60e5aa5cc882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:30.126093 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2b362-a779-456d-99db-d9f4dec0f0dd None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:30.140905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c484d1b1-6a7d-4b77-9d24-60e5aa5cc882 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:30.142566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c484d1b1-6a7d-4b77-9d24-60e5aa5cc882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:30.163050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:30.171903 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb67d4e-312e-49bd-a443-fa3b9c6ac51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:30.173715 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb67d4e-312e-49bd-a443-fa3b9c6ac51c None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:30.174176 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb67d4e-312e-49bd-a443-fa3b9c6ac51c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:30.174641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb67d4e-312e-49bd-a443-fa3b9c6ac51c None admin] PATH_INFO: `/v3/projects/1ba395a1e22f430084089947e47a622d/users/977392666b5a4076884416489b935ad6/roles/42cae330d9ab456c8212ca146daf9322` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:30.193587 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb67d4e-312e-49bd-a443-fa3b9c6ac51c None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba395a1e22f430084089947e47a622d, user_id=977392666b5a4076884416489b935ad6, role_id=42cae330d9ab456c8212ca146daf9322)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:30.195641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb67d4e-312e-49bd-a443-fa3b9c6ac51c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:30.212822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 314/612] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:18:29 2022] PUT /identity/v3/projects/1ba395a1e22f430084089947e47a622d/users/977392666b5a4076884416489b935ad6/roles/42cae330d9ab456c8212ca146daf9322 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:18:30.214679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb67d4e-312e-49bd-a443-fa3b9c6ac51c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:30.229586 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 299/613] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:30.254858 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484d1b1-6a7d-4b77-9d24-60e5aa5cc882 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:30.326901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:30.392717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484d1b1-6a7d-4b77-9d24-60e5aa5cc882 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:30.435389 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1182c-6495-4be6-aafe-7cbab5f0412f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:30.436389 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1182c-6495-4be6-aafe-7cbab5f0412f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:30.436685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1182c-6495-4be6-aafe-7cbab5f0412f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:30.437080 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1182c-6495-4be6-aafe-7cbab5f0412f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:30.451232 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1182c-6495-4be6-aafe-7cbab5f0412f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:30.458762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb67d4e-312e-49bd-a443-fa3b9c6ac51c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:30.460443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-59a1182c-6495-4be6-aafe-7cbab5f0412f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:30.460443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:30.460443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:30.460443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:30.460443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:30.460443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:30.460443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:30.460443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:30.460443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:30.460443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:30.460443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:30.460443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:30.460443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:30.460443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:30.460443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:30.460443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:30.461329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:30.461329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:30.461329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:30.461329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:30.461329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:30.461329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:30.461329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:30.461329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:30.461329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:30.461329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:30.461329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:30.461329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:30.461329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:30.461329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:30.461329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:30.461329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:30.462523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:30.462523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:30.462523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:30.462523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:30.462523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:30.462523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:30.462523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:30.462523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:30.462523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:30.462523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:30.462523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:30.462523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:30.462523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 300/614] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:30.470384 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1182c-6495-4be6-aafe-7cbab5f0412f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:30.503379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f99f29-d4d2-43bb-b453-3270c8ec6385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:30.504822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f99f29-d4d2-43bb-b453-3270c8ec6385 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:30.505161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f99f29-d4d2-43bb-b453-3270c8ec6385 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:30.505375 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f99f29-d4d2-43bb-b453-3270c8ec6385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:30.520240 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f99f29-d4d2-43bb-b453-3270c8ec6385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:30.522510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f99f29-d4d2-43bb-b453-3270c8ec6385 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:30.544950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-39f99f29-d4d2-43bb-b453-3270c8ec6385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:30.544950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:30.544950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:30.544950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:30.544950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:30.544950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:30.544950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:30.544950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:30.544950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:30.544950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:30.544950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:30.544950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:30.544950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:30.544950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:30.544950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:30.545862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:30.545862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:30.545862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:30.545862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:30.545862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:30.545862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:30.545862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:30.545862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:30.545862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:30.545862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:30.545862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:30.545862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:30.545862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:30.545862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:30.545862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:30.545862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:30.545862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:30.547157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:30.547157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:30.547157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:30.547157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:30.547157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 315/615] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:30.553998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f99f29-d4d2-43bb-b453-3270c8ec6385 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:30.614885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1182c-6495-4be6-aafe-7cbab5f0412f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:30.616395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:30.646698 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:30.671441 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234599cc-bbfb-4278-a75a-f8c24a8b4351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:30.672277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234599cc-bbfb-4278-a75a-f8c24a8b4351 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:30.672652 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234599cc-bbfb-4278-a75a-f8c24a8b4351 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:30.673021 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234599cc-bbfb-4278-a75a-f8c24a8b4351 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:30.674148 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234599cc-bbfb-4278-a75a-f8c24a8b4351 None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:30.674572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234599cc-bbfb-4278-a75a-f8c24a8b4351 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:30.677314 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234599cc-bbfb-4278-a75a-f8c24a8b4351 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:30.703806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 301/616] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:18:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:30.710659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234599cc-bbfb-4278-a75a-f8c24a8b4351 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:30.757486 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f99f29-d4d2-43bb-b453-3270c8ec6385 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:30.797097 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090b96b-8574-4c28-bd6d-1196c1b2271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:30.797907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090b96b-8574-4c28-bd6d-1196c1b2271c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:30.798278 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090b96b-8574-4c28-bd6d-1196c1b2271c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:30.798715 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090b96b-8574-4c28-bd6d-1196c1b2271c None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:30.799573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090b96b-8574-4c28-bd6d-1196c1b2271c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:30.799969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090b96b-8574-4c28-bd6d-1196c1b2271c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:30.801837 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090b96b-8574-4c28-bd6d-1196c1b2271c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:30.821544 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 316/617] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:30.827710 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090b96b-8574-4c28-bd6d-1196c1b2271c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:30.933278 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:30.945392 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090b96b-8574-4c28-bd6d-1196c1b2271c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:30.983081 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8a813-ee93-4e47-ba47-9e83e6294b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:30.984540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8a813-ee93-4e47-ba47-9e83e6294b12 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:30.984970 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8a813-ee93-4e47-ba47-9e83e6294b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:30.985391 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8a813-ee93-4e47-ba47-9e83e6294b12 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:30.988773 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234599cc-bbfb-4278-a75a-f8c24a8b4351 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:30.994056 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8a813-ee93-4e47-ba47-9e83e6294b12 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:30.996593 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8a813-ee93-4e47-ba47-9e83e6294b12 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:31.012707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-07a8a813-ee93-4e47-ba47-9e83e6294b12 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 12:18:31.012707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:31.012707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:31.012707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:31.012707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:31.012707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:31.012707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:31.012707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:31.012707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:31.012707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:31.012707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:31.012707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:31.012707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:31.012707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:31.012707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:31.012707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:31.014039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:31.014039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:31.014039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:31.014039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:31.014039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:31.014039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:31.014039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:31.014039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:31.014039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:31.014039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:31.014039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:31.014039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:31.014039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:31.014039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:31.014039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:31.014039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:31.014039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:31.014039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:31.015005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:31.015005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:31.015005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:31.015005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:31.015005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:31.015005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:31.015005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:31.015005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:31.015005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 12:18:31.015005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:31.018288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 317/618] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:18:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:31.024667 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8a813-ee93-4e47-ba47-9e83e6294b12 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:31.107544 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c280792-e351-4de8-a8f1-d95631bf131e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:31.108357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c280792-e351-4de8-a8f1-d95631bf131e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:31.108639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c280792-e351-4de8-a8f1-d95631bf131e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:31.108911 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c280792-e351-4de8-a8f1-d95631bf131e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:31.130675 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c280792-e351-4de8-a8f1-d95631bf131e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:31.136935 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c280792-e351-4de8-a8f1-d95631bf131e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:31.143328 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8a813-ee93-4e47-ba47-9e83e6294b12 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:31.183964 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8824696-9a69-4ba4-a183-c423433d8355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:31.185084 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8824696-9a69-4ba4-a183-c423433d8355 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:31.185597 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8824696-9a69-4ba4-a183-c423433d8355 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:31.186118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8824696-9a69-4ba4-a183-c423433d8355 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:31.187186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8824696-9a69-4ba4-a183-c423433d8355 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:31.187661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-1c280792-e351-4de8-a8f1-d95631bf131e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:31.187661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:31.187661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:31.187661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:31.187661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:31.187661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:31.187661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:31.187661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:31.187661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:31.187661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:31.187661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:31.187661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:31.187661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:31.187661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:31.187661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:31.188711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:31.188711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:31.188711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:31.188711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:31.188711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:31.188711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:31.188711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:31.188711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:31.188711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:31.188711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:31.188711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:31.188711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:31.188711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:31.188711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:31.188711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:31.188711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:31.188711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:31.190151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:31.190151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:31.190151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:31.190151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:31.190375 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 302/619] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 479 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:31.190919 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8824696-9a69-4ba4-a183-c423433d8355 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:31.196774 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c280792-e351-4de8-a8f1-d95631bf131e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:31.197389 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8824696-9a69-4ba4-a183-c423433d8355 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:31.217072 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 318/620] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Jul 19 12:18:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:31.222891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8824696-9a69-4ba4-a183-c423433d8355 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:31.259252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:31.275798 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:31.333358 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8824696-9a69-4ba4-a183-c423433d8355 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:31.370931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905ff89-e38a-4988-a0e2-76755fe0e846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:31.372151 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905ff89-e38a-4988-a0e2-76755fe0e846 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:31.372638 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905ff89-e38a-4988-a0e2-76755fe0e846 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:31.373114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905ff89-e38a-4988-a0e2-76755fe0e846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:31.385904 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905ff89-e38a-4988-a0e2-76755fe0e846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:31.387789 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905ff89-e38a-4988-a0e2-76755fe0e846 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:31.390883 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c280792-e351-4de8-a8f1-d95631bf131e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:31.407189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6905ff89-e38a-4988-a0e2-76755fe0e846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:31.407189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:31.407189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:31.407189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:31.407189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:31.407189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:31.407189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:31.407189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:31.407189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:31.407189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:31.407189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:31.407189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:31.407189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:31.407189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:31.407189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:31.408867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:31.408867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:31.408867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:31.408867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:31.408867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:31.408867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:31.408867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:31.408867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:31.408867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:31.408867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:31.408867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:31.408867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:31.408867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:31.408867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:31.408867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:31.408867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:31.408867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:31.409771 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:31.409771 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:31.409771 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:31.409771 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:31.412162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 319/621] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:31.417934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905ff89-e38a-4988-a0e2-76755fe0e846 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:31.459454 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76059414-b80f-4903-8838-4c74387d74c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:31.460125 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76059414-b80f-4903-8838-4c74387d74c3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:31.460403 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76059414-b80f-4903-8838-4c74387d74c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:31.460676 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76059414-b80f-4903-8838-4c74387d74c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:31.461985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76059414-b80f-4903-8838-4c74387d74c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:31.461985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76059414-b80f-4903-8838-4c74387d74c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:31.463060 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76059414-b80f-4903-8838-4c74387d74c3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:31.489187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 303/622] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:31.506243 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76059414-b80f-4903-8838-4c74387d74c3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:31.515093 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:31.539017 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905ff89-e38a-4988-a0e2-76755fe0e846 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:31.579139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee02748-3857-4610-af19-6d47a91705c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:31.580252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee02748-3857-4610-af19-6d47a91705c5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:31.580834 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee02748-3857-4610-af19-6d47a91705c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:31.581380 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee02748-3857-4610-af19-6d47a91705c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:31.582431 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee02748-3857-4610-af19-6d47a91705c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:31.582973 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee02748-3857-4610-af19-6d47a91705c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:31.584665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee02748-3857-4610-af19-6d47a91705c5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:31.598664 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 320/623] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:31.604688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee02748-3857-4610-af19-6d47a91705c5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:31.633489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:31.637051 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76059414-b80f-4903-8838-4c74387d74c3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:31.674692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284fc54-e367-4629-8dc4-44714888069f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:31.675638 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284fc54-e367-4629-8dc4-44714888069f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:31.675839 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284fc54-e367-4629-8dc4-44714888069f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:31.676075 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284fc54-e367-4629-8dc4-44714888069f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:31.683785 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284fc54-e367-4629-8dc4-44714888069f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:31.685390 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284fc54-e367-4629-8dc4-44714888069f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:31.700508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-8284fc54-e367-4629-8dc4-44714888069f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 12:18:31.700508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:31.700508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:31.700508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:31.700508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:31.700508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:31.700508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:31.700508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:31.700508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:31.700508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:31.700508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:31.700508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:31.700508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:31.700508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:31.700508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:31.700508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:31.701559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:31.701559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:31.701559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:31.701559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:31.701559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:31.701559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:31.701559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:31.701559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:31.701559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:31.701559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:31.701559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:31.701559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:31.701559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:31.701559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:31.701559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:31.701559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:31.701559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:31.701559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:31.702559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:31.702559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:31.702559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:31.702559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:31.702559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:31.702559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:31.702559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:31.702559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:31.702559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 12:18:31.702559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:31.702559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 304/624] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Jul 19 12:18:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:31.707613 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284fc54-e367-4629-8dc4-44714888069f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:31.788878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee02748-3857-4610-af19-6d47a91705c5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:31.808508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284fc54-e367-4629-8dc4-44714888069f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:31.843710 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa23932-9ae4-4316-a722-c5bf5d340adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:31.844380 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa23932-9ae4-4316-a722-c5bf5d340adc None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:31.844660 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa23932-9ae4-4316-a722-c5bf5d340adc None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:31.844934 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa23932-9ae4-4316-a722-c5bf5d340adc None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:31.846462 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa23932-9ae4-4316-a722-c5bf5d340adc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:31.846811 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa23932-9ae4-4316-a722-c5bf5d340adc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:31.848232 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa23932-9ae4-4316-a722-c5bf5d340adc None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:31.859685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:31.868326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 305/625] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Jul 19 12:18:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:31.874231 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa23932-9ae4-4316-a722-c5bf5d340adc None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:31.897479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:31.902746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbca815-c301-440d-b10d-286df75ae81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:31.903741 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbca815-c301-440d-b10d-286df75ae81b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:31.904020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbca815-c301-440d-b10d-286df75ae81b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:31.904288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbca815-c301-440d-b10d-286df75ae81b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:31.924935 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbca815-c301-440d-b10d-286df75ae81b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:31.926433 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbca815-c301-440d-b10d-286df75ae81b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:31.945910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-cbbca815-c301-440d-b10d-286df75ae81b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:31.945910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:31.945910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:31.945910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:31.945910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:31.945910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:31.945910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:31.945910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:31.945910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:31.945910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:31.945910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:31.945910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:31.945910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:31.945910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:31.945910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:31.946878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:31.946878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:31.946878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:31.946878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:31.946878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:31.946878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:31.946878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:31.946878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:31.946878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:31.946878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:31.946878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:31.946878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:31.946878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:31.946878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:31.946878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:31.946878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:31.946878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:31.947777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:31.947777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:31.947777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:31.947777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:31.947777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:31.947777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:31.947777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:31.947777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:31.951467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 321/626] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:31.960330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbca815-c301-440d-b10d-286df75ae81b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:32.011909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa23932-9ae4-4316-a722-c5bf5d340adc None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:32.070096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b537e9-00df-4bbd-b588-9eabff2061e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:32.071083 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b537e9-00df-4bbd-b588-9eabff2061e1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:32.071551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b537e9-00df-4bbd-b588-9eabff2061e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:32.072022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b537e9-00df-4bbd-b588-9eabff2061e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:32.106921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbca815-c301-440d-b10d-286df75ae81b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:32.143674 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b537e9-00df-4bbd-b588-9eabff2061e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:32.145279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b537e9-00df-4bbd-b588-9eabff2061e1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:32.146193 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7ef73-cca5-4d05-958d-a3647faba318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:32.146871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7ef73-cca5-4d05-958d-a3647faba318 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:32.147154 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7ef73-cca5-4d05-958d-a3647faba318 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:32.147424 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7ef73-cca5-4d05-958d-a3647faba318 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:32.148200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7ef73-cca5-4d05-958d-a3647faba318 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:32.148563 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7ef73-cca5-4d05-958d-a3647faba318 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:32.149984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7ef73-cca5-4d05-958d-a3647faba318 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:32.167621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 322/627] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:32.167621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a9010-a19d-449f-9b97-5f4151b2f017 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:32.167621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a9010-a19d-449f-9b97-5f4151b2f017 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:32.167621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a9010-a19d-449f-9b97-5f4151b2f017 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:32.167621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 323/628] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:32.167621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5b6d2-c9f1-4d9f-8fcc-04f29b7430e1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:32.168130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5b6d2-c9f1-4d9f-8fcc-04f29b7430e1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:32.168130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5b6d2-c9f1-4d9f-8fcc-04f29b7430e1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:32.169304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:32.169415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 324/629] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:32.170188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5b6d2-c9f1-4d9f-8fcc-04f29b7430e1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:32.217954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:32.267954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 306/630] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 12:18:32.269596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17e871-d581-4ea4-b09c-c27fb8166203 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:32.269882 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17e871-d581-4ea4-b09c-c27fb8166203 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:32.270162 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17e871-d581-4ea4-b09c-c27fb8166203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:32.284721 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5b6d2-c9f1-4d9f-8fcc-04f29b7430e1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:32.288130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-da17e871-d581-4ea4-b09c-c27fb8166203 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:32.289328 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-da17e871-d581-4ea4-b09c-c27fb8166203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:32.323913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79d299-1cb4-4767-977a-389bdcae0ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:32.323913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79d299-1cb4-4767-977a-389bdcae0ba5 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:32.323913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79d299-1cb4-4767-977a-389bdcae0ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:32.324285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79d299-1cb4-4767-977a-389bdcae0ba5 None admin] PATH_INFO: `/v3/projects/1ba395a1e22f430084089947e47a622d/users/35cc2e1079d34745a279588028945c3c/roles/42cae330d9ab456c8212ca146daf9322` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:32.341053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79d299-1cb4-4767-977a-389bdcae0ba5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba395a1e22f430084089947e47a622d, user_id=35cc2e1079d34745a279588028945c3c, role_id=42cae330d9ab456c8212ca146daf9322)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:32.342714 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79d299-1cb4-4767-977a-389bdcae0ba5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:32.355997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 325/631] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:18:32 2022] PUT /identity/v3/projects/1ba395a1e22f430084089947e47a622d/users/35cc2e1079d34745a279588028945c3c/roles/42cae330d9ab456c8212ca146daf9322 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:18:32.357534 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7bbc5-f88f-4a5f-8d36-80bf8180b8d8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:32.357984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7bbc5-f88f-4a5f-8d36-80bf8180b8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:32.358420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7bbc5-f88f-4a5f-8d36-80bf8180b8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:32.374699 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 307/632] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:32.375818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17e871-d581-4ea4-b09c-c27fb8166203 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:32.378697 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-59d7bbc5-f88f-4a5f-8d36-80bf8180b8d8 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:32.380120 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-59d7bbc5-f88f-4a5f-8d36-80bf8180b8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:32.445679 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:32.476610 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 326/633] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:32.482780 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7bbc5-f88f-4a5f-8d36-80bf8180b8d8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:32.527338 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:32.531275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17e871-d581-4ea4-b09c-c27fb8166203 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:32.584395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234f683-2b94-4878-9e85-07803d40e622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:32.585116 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234f683-2b94-4878-9e85-07803d40e622 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:32.585393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234f683-2b94-4878-9e85-07803d40e622 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:32.585661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234f683-2b94-4878-9e85-07803d40e622 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:32.600304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234f683-2b94-4878-9e85-07803d40e622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:32.601759 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234f683-2b94-4878-9e85-07803d40e622 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:32.623087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7bbc5-f88f-4a5f-8d36-80bf8180b8d8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:32.626655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-5234f683-2b94-4878-9e85-07803d40e622 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:32.626655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:32.626655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:32.626655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:32.626655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:32.626655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:32.626655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:32.626655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:32.626655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:32.626655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:32.626655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:32.626655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:32.626655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:32.626655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:32.626655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:32.627724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:32.627724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:32.627724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:32.627724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:32.627724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:32.627724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:32.627724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:32.627724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:32.627724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:32.627724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:32.627724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:32.627724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:32.627724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:32.627724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:32.627724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:32.627724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:32.627724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:32.628598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:32.628598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:32.628598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:32.628598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:32.628973 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 308/634] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:32.629938 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234f683-2b94-4878-9e85-07803d40e622 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:32.666704 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb6c03-a86a-4f01-a9f2-0136bc472693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:32.667532 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6c03-a86a-4f01-a9f2-0136bc472693 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:32.667966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6c03-a86a-4f01-a9f2-0136bc472693 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:32.668244 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6c03-a86a-4f01-a9f2-0136bc472693 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:32.679271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb6c03-a86a-4f01-a9f2-0136bc472693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:32.687136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a4eb6c03-a86a-4f01-a9f2-0136bc472693 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:32.687136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:32.687136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:32.687136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:32.687136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:32.687136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:32.687136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:32.687136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:32.687136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:32.687136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:32.687136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:32.687136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:32.687136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:32.687136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:32.687136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:32.687136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:32.688318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:32.688318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:32.688318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:32.688318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:32.688318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:32.688318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:32.688318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:32.688318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:32.688318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:32.688318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:32.688318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:32.688318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:32.688318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:32.688318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:32.688318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:32.688318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:32.691699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:32.691699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:32.691699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:32.691699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:32.691699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:32.691699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:32.691699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:32.691699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:32.691699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:32.691699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:32.691699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:32.691699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:32.693485 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 327/635] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:32.694320 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb6c03-a86a-4f01-a9f2-0136bc472693 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:32.756881 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:32.761682 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234f683-2b94-4878-9e85-07803d40e622 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:32.787668 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:32.800537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab6f5f-f8a3-4d14-ae8f-b1d227b6b5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:32.801316 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab6f5f-f8a3-4d14-ae8f-b1d227b6b5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:32.801592 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab6f5f-f8a3-4d14-ae8f-b1d227b6b5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:32.801864 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab6f5f-f8a3-4d14-ae8f-b1d227b6b5e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:32.808148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb6c03-a86a-4f01-a9f2-0136bc472693 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:32.812614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab6f5f-f8a3-4d14-ae8f-b1d227b6b5e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:32.820647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-64ab6f5f-f8a3-4d14-ae8f-b1d227b6b5e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:32.820647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:32.820647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:32.820647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:32.820647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:32.820647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:32.820647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:32.820647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:32.820647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:32.820647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:32.820647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:32.820647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:32.820647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:32.820647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:32.820647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:32.820647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:32.821587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:32.821587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:32.821587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:32.821587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:32.821587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:32.821587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:32.821587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:32.821587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:32.821587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:32.821587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:32.821587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:32.821587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:32.821587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:32.821587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:32.821587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:32.821587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:32.822400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:32.822400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:32.822400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:32.822400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:32.822400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:32.822400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:32.822400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:32.822400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:32.822400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:32.822400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:32.822400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:32.822400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:32.822400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 309/636] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:32.823837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffae969-4313-4f1f-af1d-c8e29811e8eb None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:32.823837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffae969-4313-4f1f-af1d-c8e29811e8eb None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:32.823837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffae969-4313-4f1f-af1d-c8e29811e8eb None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:32.825018 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 310/637] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:32.829541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffae969-4313-4f1f-af1d-c8e29811e8eb None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:32.850296 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaada703-15a9-4105-8aae-1db7cf903773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:32.850713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaada703-15a9-4105-8aae-1db7cf903773 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:32.851021 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaada703-15a9-4105-8aae-1db7cf903773 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:32.851294 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaada703-15a9-4105-8aae-1db7cf903773 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:32.852017 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaada703-15a9-4105-8aae-1db7cf903773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:32.852457 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaada703-15a9-4105-8aae-1db7cf903773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:32.853903 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaada703-15a9-4105-8aae-1db7cf903773 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:32.873032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 328/638] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:32.873032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaada703-15a9-4105-8aae-1db7cf903773 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:32.939841 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffae969-4313-4f1f-af1d-c8e29811e8eb None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:32.977202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d7659-0af4-4004-ab89-6c4040ce857c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:32.977874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d7659-0af4-4004-ab89-6c4040ce857c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:32.978156 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d7659-0af4-4004-ab89-6c4040ce857c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:32.978435 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d7659-0af4-4004-ab89-6c4040ce857c None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:32.979212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d7659-0af4-4004-ab89-6c4040ce857c None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:32.979518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d7659-0af4-4004-ab89-6c4040ce857c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:32.980878 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d7659-0af4-4004-ab89-6c4040ce857c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:32.981537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaada703-15a9-4105-8aae-1db7cf903773 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:32.993226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 311/639] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:18:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:32.993226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91636f0b-e38c-4bcc-a668-f792262e1786 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:32.993226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91636f0b-e38c-4bcc-a668-f792262e1786 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:32.993226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91636f0b-e38c-4bcc-a668-f792262e1786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:33.008503 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-91636f0b-e38c-4bcc-a668-f792262e1786 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:33.009705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-91636f0b-e38c-4bcc-a668-f792262e1786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:33.024194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952e031-7e40-43bf-9f29-d6bf930508ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:33.024854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952e031-7e40-43bf-9f29-d6bf930508ba None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:33.025129 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952e031-7e40-43bf-9f29-d6bf930508ba None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:33.025403 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952e031-7e40-43bf-9f29-d6bf930508ba None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:33.026136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952e031-7e40-43bf-9f29-d6bf930508ba None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:33.026412 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:33.026529 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952e031-7e40-43bf-9f29-d6bf930508ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:33.027869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952e031-7e40-43bf-9f29-d6bf930508ba None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:33.041104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 329/640] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:18:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:33.041104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952e031-7e40-43bf-9f29-d6bf930508ba None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:33.045600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:33.090144 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 312/641] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:33.091423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91636f0b-e38c-4bcc-a668-f792262e1786 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:33.165160 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952e031-7e40-43bf-9f29-d6bf930508ba None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:33.202046 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c11005-c479-4da7-a8a4-766fc7d18c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:33.202640 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91636f0b-e38c-4bcc-a668-f792262e1786 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:33.203092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c11005-c479-4da7-a8a4-766fc7d18c0e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:33.203188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c11005-c479-4da7-a8a4-766fc7d18c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:33.203429 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c11005-c479-4da7-a8a4-766fc7d18c0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:33.210944 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c11005-c479-4da7-a8a4-766fc7d18c0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:33.212367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c11005-c479-4da7-a8a4-766fc7d18c0e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:33.226886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f5c11005-c479-4da7-a8a4-766fc7d18c0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:33.226886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:33.226886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:33.226886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:33.226886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:33.226886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:33.226886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:33.226886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:33.226886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:33.226886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:33.226886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:33.226886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:33.226886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:33.226886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:33.226886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:33.227947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:33.227947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:33.227947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:33.227947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:33.227947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:33.227947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:33.227947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:33.227947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:33.227947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:33.227947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:33.227947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:33.227947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:33.227947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:33.227947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:33.227947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:33.227947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:33.227947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:33.233856 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:33.233856 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:33.233856 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:33.233856 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:33.233856 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:33.233856 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:33.233856 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:33.233856 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:33.233856 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 330/642] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:33.233856 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c11005-c479-4da7-a8a4-766fc7d18c0e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:33.247110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ef956-5077-464e-9c4d-bc91c35cd917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:33.247908 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ef956-5077-464e-9c4d-bc91c35cd917 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:33.248189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ef956-5077-464e-9c4d-bc91c35cd917 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:33.248470 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ef956-5077-464e-9c4d-bc91c35cd917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:33.259540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ef956-5077-464e-9c4d-bc91c35cd917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:33.260977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ef956-5077-464e-9c4d-bc91c35cd917 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:33.279126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-984ef956-5077-464e-9c4d-bc91c35cd917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:33.279126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:33.279126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:33.279126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:33.279126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:33.279126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:33.279126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:33.279126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:33.279126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:33.279126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:33.279126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:33.279126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:33.279126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:33.279126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:33.279126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:33.280095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:33.280095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:33.280095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:33.280095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:33.280095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:33.280095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:33.280095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:33.280095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:33.280095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:33.280095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:33.280095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:33.280095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:33.280095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:33.280095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:33.280095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:33.280095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:33.280095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:33.286585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:33.286585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:33.286585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:33.286585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:33.286585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 313/643] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:33.286585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ef956-5077-464e-9c4d-bc91c35cd917 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:33.286585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:33.304906 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:33.349086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c11005-c479-4da7-a8a4-766fc7d18c0e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:33.386301 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ef956-5077-464e-9c4d-bc91c35cd917 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:33.386778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3878999-f713-458a-ae24-4200cfe9f313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:33.387593 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3878999-f713-458a-ae24-4200cfe9f313 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:33.388009 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3878999-f713-458a-ae24-4200cfe9f313 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:33.388286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3878999-f713-458a-ae24-4200cfe9f313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:33.400213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3878999-f713-458a-ae24-4200cfe9f313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:33.401941 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3878999-f713-458a-ae24-4200cfe9f313 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:33.420420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a3878999-f713-458a-ae24-4200cfe9f313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:33.420420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:33.420420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:33.420420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:33.420420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:33.420420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:33.420420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:33.420420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:33.420420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:33.420420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:33.420420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:33.420420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:33.420420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:33.420420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:33.420420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:33.421299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:33.421299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:33.421299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:33.421299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:33.421299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:33.421299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:33.421299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:33.421299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:33.421299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:33.421299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:33.421299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:33.421299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:33.421299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:33.421299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:33.421299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:33.421299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:33.421299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:33.422279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:33.422279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:33.422279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:33.422279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:33.422279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 331/644] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:33.422279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3878999-f713-458a-ae24-4200cfe9f313 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:33.424546 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02321990-01bc-47ec-a435-2e67bca4fb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:33.425514 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02321990-01bc-47ec-a435-2e67bca4fb2a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:33.425792 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02321990-01bc-47ec-a435-2e67bca4fb2a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:33.426059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02321990-01bc-47ec-a435-2e67bca4fb2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:33.436992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02321990-01bc-47ec-a435-2e67bca4fb2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:33.445432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-02321990-01bc-47ec-a435-2e67bca4fb2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:33.445432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:33.445432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:33.445432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:33.445432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:33.445432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:33.445432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:33.445432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:33.445432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:33.445432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:33.445432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:33.445432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:33.445432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:33.445432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:33.445432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:33.445432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:33.446357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:33.446357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:33.446357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:33.446357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:33.446357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:33.446357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:33.446357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:33.446357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:33.446357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:33.446357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:33.446357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:33.446357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:33.446357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:33.446357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:33.446357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:33.446357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:33.447233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:33.447233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:33.447233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:33.447233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:33.447233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:33.447233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:33.447233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:33.447233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:33.447233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:33.447233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:33.447233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:33.447233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:33.447233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 314/645] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:33.448346 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02321990-01bc-47ec-a435-2e67bca4fb2a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:33.516798 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:33.546253 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3878999-f713-458a-ae24-4200cfe9f313 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:33.563210 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02321990-01bc-47ec-a435-2e67bca4fb2a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:33.563942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:33.583725 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad3b6b-4531-4937-b5f9-155653c3fc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:33.584379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad3b6b-4531-4937-b5f9-155653c3fc53 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:33.584655 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad3b6b-4531-4937-b5f9-155653c3fc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:33.584924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad3b6b-4531-4937-b5f9-155653c3fc53 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:33.585691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad3b6b-4531-4937-b5f9-155653c3fc53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:33.585992 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad3b6b-4531-4937-b5f9-155653c3fc53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:33.587438 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad3b6b-4531-4937-b5f9-155653c3fc53 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:33.604291 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 332/646] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:33.604453 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32da47f-7a22-4b09-8f04-5beb4f816aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:33.604574 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad3b6b-4531-4937-b5f9-155653c3fc53 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:33.604649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32da47f-7a22-4b09-8f04-5beb4f816aac None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:33.604649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32da47f-7a22-4b09-8f04-5beb4f816aac None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:33.604649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32da47f-7a22-4b09-8f04-5beb4f816aac None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:33.604649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32da47f-7a22-4b09-8f04-5beb4f816aac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:33.604649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32da47f-7a22-4b09-8f04-5beb4f816aac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:33.604649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32da47f-7a22-4b09-8f04-5beb4f816aac None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:33.619440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 315/647] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:33.620659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32da47f-7a22-4b09-8f04-5beb4f816aac None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:33.715864 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad3b6b-4531-4937-b5f9-155653c3fc53 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:33.741093 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32da47f-7a22-4b09-8f04-5beb4f816aac None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:33.752843 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f2839-4c08-42d7-9a38-5c0b3103f226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:33.753505 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f2839-4c08-42d7-9a38-5c0b3103f226 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:33.754064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f2839-4c08-42d7-9a38-5c0b3103f226 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:33.754064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f2839-4c08-42d7-9a38-5c0b3103f226 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:33.754814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f2839-4c08-42d7-9a38-5c0b3103f226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:33.755115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f2839-4c08-42d7-9a38-5c0b3103f226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:33.756459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f2839-4c08-42d7-9a38-5c0b3103f226 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:33.767785 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:33.768642 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 333/648] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:33.769345 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f2839-4c08-42d7-9a38-5c0b3103f226 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:33.781894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bc35e-da09-46e5-a0a6-93f2e9ee9a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:33.783382 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bc35e-da09-46e5-a0a6-93f2e9ee9a38 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:33.783937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bc35e-da09-46e5-a0a6-93f2e9ee9a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:33.784279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bc35e-da09-46e5-a0a6-93f2e9ee9a38 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:33.785018 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bc35e-da09-46e5-a0a6-93f2e9ee9a38 None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:33.785500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bc35e-da09-46e5-a0a6-93f2e9ee9a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:33.786821 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bc35e-da09-46e5-a0a6-93f2e9ee9a38 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:33.800793 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 316/649] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:18:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:33.801743 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bc35e-da09-46e5-a0a6-93f2e9ee9a38 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:33.807801 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:33.875613 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f2839-4c08-42d7-9a38-5c0b3103f226 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:33.910297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bc35e-da09-46e5-a0a6-93f2e9ee9a38 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:33.915340 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2446be-bda0-4c82-b1b2-2e787644fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:33.916201 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2446be-bda0-4c82-b1b2-2e787644fff1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:33.916686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2446be-bda0-4c82-b1b2-2e787644fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:33.917253 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2446be-bda0-4c82-b1b2-2e787644fff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:33.918153 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2446be-bda0-4c82-b1b2-2e787644fff1 None admin] RBAC: Adding query filter params (role.id=42cae330d9ab456c8212ca146daf9322, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=5d9543657e1e4a6d85632bf57f6ba6eb) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:33.918463 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2446be-bda0-4c82-b1b2-2e787644fff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:33.920019 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2446be-bda0-4c82-b1b2-2e787644fff1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:33.934767 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 334/650] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:18:33 2022] GET /identity/v3/role_assignments?user.id=5d9543657e1e4a6d85632bf57f6ba6eb&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=42cae330d9ab456c8212ca146daf9322 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:33.934767 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2446be-bda0-4c82-b1b2-2e787644fff1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:33.956690 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa9ace-14cb-48e9-9d4b-70d1b5f16391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:33.957538 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa9ace-14cb-48e9-9d4b-70d1b5f16391 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:33.957882 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa9ace-14cb-48e9-9d4b-70d1b5f16391 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:33.958396 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa9ace-14cb-48e9-9d4b-70d1b5f16391 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:33.967719 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa9ace-14cb-48e9-9d4b-70d1b5f16391 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:33.969434 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa9ace-14cb-48e9-9d4b-70d1b5f16391 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:33.986283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-71aa9ace-14cb-48e9-9d4b-70d1b5f16391 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 12:18:33.986283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:33.986283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:33.986283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:33.986283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:33.986283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:33.986283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:33.986283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:33.986283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:33.986283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:33.986283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:33.986283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:33.986283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:33.986283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:33.986283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:33.986283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:33.987654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:33.987654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:33.987654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:33.987654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:33.987654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:33.987654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:33.987654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:33.987654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:33.987654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:33.987654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:33.987654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:33.987654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:33.987654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:33.987654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:33.987654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:33.987654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:33.987654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:33.987654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:33.988582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:33.988582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:33.988582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:33.988582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:33.988582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:33.988582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:33.988582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:33.988582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:33.988582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 12:18:33.988582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:33.992875 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 317/651] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:33.993936 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa9ace-14cb-48e9-9d4b-70d1b5f16391 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:34.057294 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:34.065820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:34.071085 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2446be-bda0-4c82-b1b2-2e787644fff1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:34.118981 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84a67f-5a23-48c0-bb7a-cd6d4c2de0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:34.119790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84a67f-5a23-48c0-bb7a-cd6d4c2de0cf None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:34.120072 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84a67f-5a23-48c0-bb7a-cd6d4c2de0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:34.120341 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84a67f-5a23-48c0-bb7a-cd6d4c2de0cf None admin] PATH_INFO: `/v3/users/glance` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:34.132051 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84a67f-5a23-48c0-bb7a-cd6d4c2de0cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:34.133695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84a67f-5a23-48c0-bb7a-cd6d4c2de0cf None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:34.143336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa9ace-14cb-48e9-9d4b-70d1b5f16391 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:34.153289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-fe84a67f-5a23-48c0-bb7a-cd6d4c2de0cf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 12:18:34.153289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:34.153289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:34.153289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:34.153289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:34.153289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:34.153289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:34.153289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:34.153289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:34.153289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:34.153289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:34.153289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:34.153289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:34.153289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:34.153289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:34.153289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:34.154242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:34.154242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:34.154242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:34.154242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:34.154242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:34.154242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:34.154242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:34.154242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:34.154242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:34.154242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:34.154242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:34.154242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:34.154242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:34.154242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:34.154242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:34.154242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:34.154242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:34.154242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:34.156854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:34.156854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:34.156854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:34.156854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:34.156854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:34.156854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:34.156854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:34.156854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:34.156854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 12:18:34.156854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:34.156854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 335/652] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:34.156854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84a67f-5a23-48c0-bb7a-cd6d4c2de0cf None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:34.194785 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a6a5f-4294-4bc0-aced-929da30b823b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:34.194785 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a6a5f-4294-4bc0-aced-929da30b823b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:34.194785 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a6a5f-4294-4bc0-aced-929da30b823b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:34.194785 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a6a5f-4294-4bc0-aced-929da30b823b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:34.204227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a6a5f-4294-4bc0-aced-929da30b823b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:34.205703 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a6a5f-4294-4bc0-aced-929da30b823b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:34.224519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-fd2a6a5f-4294-4bc0-aced-929da30b823b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:34.224519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:34.224519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:34.224519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:34.224519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:34.224519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:34.224519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:34.224519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:34.224519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:34.224519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:34.224519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:34.224519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:34.224519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:34.224519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:34.224519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:34.225500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:34.225500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:34.225500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:34.225500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:34.225500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:34.225500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:34.225500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:34.225500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:34.225500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:34.225500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:34.225500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:34.225500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:34.225500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:34.225500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:34.225500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:34.225500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:34.225500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:34.226823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:34.226823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:34.226823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:34.226823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:34.226823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 318/653] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:34.226823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a6a5f-4294-4bc0-aced-929da30b823b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:34.296798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84a67f-5a23-48c0-bb7a-cd6d4c2de0cf None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:34.331188 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:34.337191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a6a5f-4294-4bc0-aced-929da30b823b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:34.344505 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc614e-0e83-4501-9a7d-4fa2514e40da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:34.345292 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc614e-0e83-4501-9a7d-4fa2514e40da None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:34.345774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc614e-0e83-4501-9a7d-4fa2514e40da None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:34.346061 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc614e-0e83-4501-9a7d-4fa2514e40da None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:34.347517 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc614e-0e83-4501-9a7d-4fa2514e40da None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:34.347824 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc614e-0e83-4501-9a7d-4fa2514e40da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:34.349735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc614e-0e83-4501-9a7d-4fa2514e40da None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:34.375527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 336/654] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Jul 19 12:18:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:34.377406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc614e-0e83-4501-9a7d-4fa2514e40da None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:34.385068 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751880e-61fa-4d82-babc-c05c9e21a8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:34.385748 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751880e-61fa-4d82-babc-c05c9e21a8fd None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:34.386027 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751880e-61fa-4d82-babc-c05c9e21a8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:34.386744 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751880e-61fa-4d82-babc-c05c9e21a8fd None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:34.387607 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751880e-61fa-4d82-babc-c05c9e21a8fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:34.387912 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751880e-61fa-4d82-babc-c05c9e21a8fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:34.389947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751880e-61fa-4d82-babc-c05c9e21a8fd None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:34.398599 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:34.415800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 319/655] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Jul 19 12:18:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:34.416715 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751880e-61fa-4d82-babc-c05c9e21a8fd None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:34.488685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc614e-0e83-4501-9a7d-4fa2514e40da None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:34.523624 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751880e-61fa-4d82-babc-c05c9e21a8fd None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:34.525156 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029e7dc-b087-4255-a210-5538293bea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:34.525822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029e7dc-b087-4255-a210-5538293bea58 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:34.526099 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029e7dc-b087-4255-a210-5538293bea58 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:34.526369 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029e7dc-b087-4255-a210-5538293bea58 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:34.527106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029e7dc-b087-4255-a210-5538293bea58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:34.527410 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029e7dc-b087-4255-a210-5538293bea58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:34.528770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029e7dc-b087-4255-a210-5538293bea58 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:34.541670 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 337/656] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:34.542501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029e7dc-b087-4255-a210-5538293bea58 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:34.561757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e195c-496e-4500-99a8-db05c5e539f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:34.562706 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e195c-496e-4500-99a8-db05c5e539f0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:34.563016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e195c-496e-4500-99a8-db05c5e539f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:34.563287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e195c-496e-4500-99a8-db05c5e539f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:34.590594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:34.627977 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:34.637242 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e195c-496e-4500-99a8-db05c5e539f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:34.639424 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e195c-496e-4500-99a8-db05c5e539f0 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:34.651483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029e7dc-b087-4255-a210-5538293bea58 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:34.693158 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2b987-62b8-4232-bf6d-48ad76e6f8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:34.693814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2b987-62b8-4232-bf6d-48ad76e6f8eb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:34.694101 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2b987-62b8-4232-bf6d-48ad76e6f8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:34.694378 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2b987-62b8-4232-bf6d-48ad76e6f8eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:34.747949 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 320/657] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:34.749295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ac0d7-c9aa-460b-a3da-136f378eb47d None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:34.749587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ac0d7-c9aa-460b-a3da-136f378eb47d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:34.749863 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ac0d7-c9aa-460b-a3da-136f378eb47d None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:34.751308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 321/658] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:34.756728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ac0d7-c9aa-460b-a3da-136f378eb47d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:34.774763 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2b987-62b8-4232-bf6d-48ad76e6f8eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:34.776569 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2b987-62b8-4232-bf6d-48ad76e6f8eb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:34.812898 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:34.859410 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:34.865544 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ac0d7-c9aa-460b-a3da-136f378eb47d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:34.887718 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 338/659] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:34.887718 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2b987-62b8-4232-bf6d-48ad76e6f8eb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:34.906558 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa8fa0-271e-4100-85cb-69abc02bf952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:34.907384 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa8fa0-271e-4100-85cb-69abc02bf952 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:34.908310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa8fa0-271e-4100-85cb-69abc02bf952 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:34.908460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa8fa0-271e-4100-85cb-69abc02bf952 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:34.917217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa8fa0-271e-4100-85cb-69abc02bf952 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:34.918920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa8fa0-271e-4100-85cb-69abc02bf952 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:34.933953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-38fa8fa0-271e-4100-85cb-69abc02bf952 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 12:18:34.933953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:34.933953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:34.933953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:34.933953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:34.933953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:34.933953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:34.933953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:34.933953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:34.933953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:34.933953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:34.933953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:34.933953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:34.933953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:34.933953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:34.933953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:34.934914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:34.934914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:34.934914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:34.934914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:34.934914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:34.934914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:34.934914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:34.934914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:34.934914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:34.934914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:34.934914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:34.934914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:34.934914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:34.934914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:34.934914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:34.934914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:34.934914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:34.934914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:34.935850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:34.935850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:34.935850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:34.935850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:34.935850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:34.935850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:34.935850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:34.935850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:34.935850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 12:18:34.935850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:34.935850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 322/660] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:34.936453 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768c7bf-ece8-4778-9972-f0d98b79f053 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:34.936997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768c7bf-ece8-4778-9972-f0d98b79f053 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:34.936997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768c7bf-ece8-4778-9972-f0d98b79f053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:34.956265 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a768c7bf-ece8-4778-9972-f0d98b79f053 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:34.957460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a768c7bf-ece8-4778-9972-f0d98b79f053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:34.996018 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2b987-62b8-4232-bf6d-48ad76e6f8eb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:35.027989 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 323/661] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:35.032562 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d623f66-cde1-4ae6-8629-c1269124de21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:35.033643 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d623f66-cde1-4ae6-8629-c1269124de21 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:35.033929 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d623f66-cde1-4ae6-8629-c1269124de21 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:35.034204 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d623f66-cde1-4ae6-8629-c1269124de21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:35.039608 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768c7bf-ece8-4778-9972-f0d98b79f053 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:35.049444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d623f66-cde1-4ae6-8629-c1269124de21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:35.049444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d623f66-cde1-4ae6-8629-c1269124de21 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:35.067939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8d623f66-cde1-4ae6-8629-c1269124de21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:35.067939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:35.067939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:35.067939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:35.067939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:35.067939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:35.067939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:35.067939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:35.067939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:35.067939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:35.067939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:35.067939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:35.067939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:35.067939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:35.067939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:35.068868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:35.068868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:35.068868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:35.068868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:35.068868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:35.068868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:35.068868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:35.068868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:35.068868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:35.068868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:35.068868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:35.068868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:35.068868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:35.068868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:35.068868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:35.068868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:35.068868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:35.069751 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:35.069751 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:35.069751 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:35.069751 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:35.073671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 339/662] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:35.074512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d623f66-cde1-4ae6-8629-c1269124de21 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:35.090393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:35.108823 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:35.149473 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768c7bf-ece8-4778-9972-f0d98b79f053 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:35.185948 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d623f66-cde1-4ae6-8629-c1269124de21 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:35.187711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea615e04-d3b3-4886-92b6-7dd8589df034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:35.189141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea615e04-d3b3-4886-92b6-7dd8589df034 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:35.189141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea615e04-d3b3-4886-92b6-7dd8589df034 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:35.189141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea615e04-d3b3-4886-92b6-7dd8589df034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:35.200411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea615e04-d3b3-4886-92b6-7dd8589df034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:35.201852 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea615e04-d3b3-4886-92b6-7dd8589df034 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:35.221062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-ea615e04-d3b3-4886-92b6-7dd8589df034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:35.221062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:35.221062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:35.221062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:35.221062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:35.221062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:35.221062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:35.221062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:35.221062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:35.221062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:35.221062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:35.221062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:35.221062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:35.221062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:35.221062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:35.222388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:35.222388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:35.222388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:35.222388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:35.222388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:35.222388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:35.222388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:35.222388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:35.222388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:35.222388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:35.222388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:35.222388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:35.222388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:35.222388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:35.222388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:35.222388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:35.222388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:35.223354 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:35.223354 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:35.223354 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:35.223354 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:35.223354 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 324/663] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:35.223354 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea615e04-d3b3-4886-92b6-7dd8589df034 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:35.228739 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089863a-7d29-4bea-bcfd-a6487dd7d4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:35.229417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089863a-7d29-4bea-bcfd-a6487dd7d4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:35.229696 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089863a-7d29-4bea-bcfd-a6487dd7d4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:35.229969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089863a-7d29-4bea-bcfd-a6487dd7d4d3 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:35.230829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089863a-7d29-4bea-bcfd-a6487dd7d4d3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:35.231139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089863a-7d29-4bea-bcfd-a6487dd7d4d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:35.232562 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089863a-7d29-4bea-bcfd-a6487dd7d4d3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:35.250568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 340/664] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Jul 19 12:18:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:35.252394 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089863a-7d29-4bea-bcfd-a6487dd7d4d3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:35.329603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:35.336117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea615e04-d3b3-4886-92b6-7dd8589df034 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:35.346989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:35.359957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089863a-7d29-4bea-bcfd-a6487dd7d4d3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:35.371851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87439d8-24fa-44f6-baf5-003d52b2d8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:35.372656 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87439d8-24fa-44f6-baf5-003d52b2d8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:35.372994 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87439d8-24fa-44f6-baf5-003d52b2d8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:35.373275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87439d8-24fa-44f6-baf5-003d52b2d8c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:35.384240 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87439d8-24fa-44f6-baf5-003d52b2d8c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:35.392262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-f87439d8-24fa-44f6-baf5-003d52b2d8c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:35.392262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:35.392262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:35.392262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:35.392262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:35.392262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:35.392262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:35.392262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:35.392262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:35.392262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:35.392262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:35.392262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:35.392262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:35.392262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:35.392262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:35.392262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:35.393170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:35.393170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:35.393170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:35.393170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:35.393170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:35.393170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:35.393170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:35.393170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:35.393170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:35.393170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:35.393170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:35.393170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:35.393170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:35.393170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:35.393170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:35.393170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:35.394008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:35.394008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:35.394008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:35.394008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:35.394008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:35.394008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:35.394008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:35.394008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:35.394008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:35.394008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:35.394008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:35.394008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:35.394008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 325/665] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:35.394725 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87439d8-24fa-44f6-baf5-003d52b2d8c0 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:35.403121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c299fea-44e8-4085-a815-3be9473ad4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:35.403793 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c299fea-44e8-4085-a815-3be9473ad4af None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:35.404072 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c299fea-44e8-4085-a815-3be9473ad4af None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:35.404354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c299fea-44e8-4085-a815-3be9473ad4af None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:35.405062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c299fea-44e8-4085-a815-3be9473ad4af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:35.405368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c299fea-44e8-4085-a815-3be9473ad4af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:35.406758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c299fea-44e8-4085-a815-3be9473ad4af None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:35.419151 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 341/666] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:35.419889 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c299fea-44e8-4085-a815-3be9473ad4af None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:35.506588 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87439d8-24fa-44f6-baf5-003d52b2d8c0 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:35.524265 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c299fea-44e8-4085-a815-3be9473ad4af None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:35.549524 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3114da-25ba-4f2e-93da-5f5df7dd2cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:35.550486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3114da-25ba-4f2e-93da-5f5df7dd2cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:35.551016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3114da-25ba-4f2e-93da-5f5df7dd2cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:35.551299 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3114da-25ba-4f2e-93da-5f5df7dd2cf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:35.552016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3114da-25ba-4f2e-93da-5f5df7dd2cf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:35.552319 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3114da-25ba-4f2e-93da-5f5df7dd2cf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:35.553681 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3114da-25ba-4f2e-93da-5f5df7dd2cf9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:35.561589 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811a45f-5b6b-48b3-a7e0-a11fb8eef732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:35.562243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811a45f-5b6b-48b3-a7e0-a11fb8eef732 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:35.562764 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811a45f-5b6b-48b3-a7e0-a11fb8eef732 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:35.562874 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811a45f-5b6b-48b3-a7e0-a11fb8eef732 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:35.570800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 326/667] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:35.572024 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3114da-25ba-4f2e-93da-5f5df7dd2cf9 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:35.583292 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:35.590987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:35.639457 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811a45f-5b6b-48b3-a7e0-a11fb8eef732 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:35.640892 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811a45f-5b6b-48b3-a7e0-a11fb8eef732 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:35.681248 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3114da-25ba-4f2e-93da-5f5df7dd2cf9 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:35.723119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11239351-562b-49f9-a1f3-0d1cc48818b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:35.723796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11239351-562b-49f9-a1f3-0d1cc48818b3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:35.724079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11239351-562b-49f9-a1f3-0d1cc48818b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:35.724360 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11239351-562b-49f9-a1f3-0d1cc48818b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:35.725106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11239351-562b-49f9-a1f3-0d1cc48818b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:35.725413 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11239351-562b-49f9-a1f3-0d1cc48818b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:35.726794 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11239351-562b-49f9-a1f3-0d1cc48818b3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:35.736494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 327/668] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:18:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:35.737368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11239351-562b-49f9-a1f3-0d1cc48818b3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:35.757980 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 342/669] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:35.763320 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811a45f-5b6b-48b3-a7e0-a11fb8eef732 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:35.816782 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:35.819034 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:35.842513 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11239351-562b-49f9-a1f3-0d1cc48818b3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:35.874988 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811a45f-5b6b-48b3-a7e0-a11fb8eef732 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:35.878886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72135ef3-6169-4317-9309-34e7d440435c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:35.879689 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72135ef3-6169-4317-9309-34e7d440435c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:35.879991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72135ef3-6169-4317-9309-34e7d440435c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:35.880241 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72135ef3-6169-4317-9309-34e7d440435c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:35.888394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72135ef3-6169-4317-9309-34e7d440435c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:35.890082 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72135ef3-6169-4317-9309-34e7d440435c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:35.904812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-72135ef3-6169-4317-9309-34e7d440435c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:35.904812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:35.904812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:35.904812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:35.904812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:35.904812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:35.904812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:35.904812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:35.904812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:35.904812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:35.904812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:35.904812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:35.904812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:35.904812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:35.904812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:35.905700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:35.905700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:35.905700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:35.905700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:35.905700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:35.905700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:35.905700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:35.905700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:35.905700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:35.905700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:35.905700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:35.905700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:35.905700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:35.905700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:35.905700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:35.905700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:35.905700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:35.906569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:35.906569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:35.906569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:35.906569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:35.906569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:35.906569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:35.906569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:35.906569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:35.906569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 328/670] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:35.907965 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72135ef3-6169-4317-9309-34e7d440435c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:35.916282 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4b937-6de1-416c-9ea7-e89d287ecb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:35.917071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4b937-6de1-416c-9ea7-e89d287ecb31 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:35.917347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4b937-6de1-416c-9ea7-e89d287ecb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:35.917619 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4b937-6de1-416c-9ea7-e89d287ecb31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:35.924607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4b937-6de1-416c-9ea7-e89d287ecb31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:35.926028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4b937-6de1-416c-9ea7-e89d287ecb31 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:35.940871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-0dc4b937-6de1-416c-9ea7-e89d287ecb31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:35.940871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:35.940871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:35.940871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:35.940871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:35.940871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:35.940871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:35.940871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:35.940871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:35.940871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:35.940871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:35.940871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:35.940871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:35.940871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:35.940871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:35.941790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:35.941790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:35.941790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:35.941790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:35.941790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:35.941790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:35.941790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:35.941790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:35.941790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:35.941790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:35.941790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:35.941790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:35.941790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:35.941790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:35.941790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:35.941790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:35.941790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:35.942656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:35.942656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:35.942656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:35.942656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:35.942656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:35.942656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:35.942656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:35.942656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:35.942656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 343/671] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:35.943971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4b937-6de1-416c-9ea7-e89d287ecb31 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:36.016295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72135ef3-6169-4317-9309-34e7d440435c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:36.045070 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4b937-6de1-416c-9ea7-e89d287ecb31 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:36.052323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e466f5d-6f07-4094-945a-cfefff4a0d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:36.053125 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e466f5d-6f07-4094-945a-cfefff4a0d2c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:36.053409 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e466f5d-6f07-4094-945a-cfefff4a0d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:36.053680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e466f5d-6f07-4094-945a-cfefff4a0d2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:36.054409 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:36.062569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:36.068087 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e466f5d-6f07-4094-945a-cfefff4a0d2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:36.069546 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e466f5d-6f07-4094-945a-cfefff4a0d2c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:36.082215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2bc09-dfde-4cea-8d2f-1aabfa4631ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:36.083034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2bc09-dfde-4cea-8d2f-1aabfa4631ea None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:36.083312 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2bc09-dfde-4cea-8d2f-1aabfa4631ea None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:36.083582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2bc09-dfde-4cea-8d2f-1aabfa4631ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:36.089173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-7e466f5d-6f07-4094-945a-cfefff4a0d2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:36.089173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:36.089173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:36.089173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:36.089173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:36.089173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:36.089173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:36.089173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:36.089173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:36.089173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:36.089173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:36.089173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:36.089173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:36.089173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:36.089173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:36.090040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:36.090040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:36.090040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:36.090040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:36.090040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:36.090040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:36.090040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:36.090040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:36.090040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:36.090040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:36.090040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:36.090040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:36.090040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:36.090040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:36.090040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:36.090040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:36.090040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:36.091318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:36.091318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:36.091318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:36.091318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:36.091318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 329/672] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:36.091318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e466f5d-6f07-4094-945a-cfefff4a0d2c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:36.099116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2bc09-dfde-4cea-8d2f-1aabfa4631ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:36.100545 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2bc09-dfde-4cea-8d2f-1aabfa4631ea None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:36.117842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-63b2bc09-dfde-4cea-8d2f-1aabfa4631ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:36.117842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:36.117842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:36.117842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:36.117842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:36.117842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:36.117842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:36.117842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:36.117842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:36.117842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:36.117842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:36.117842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:36.117842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:36.117842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:36.117842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:36.118841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:36.118841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:36.118841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:36.118841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:36.118841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:36.118841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:36.118841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:36.118841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:36.118841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:36.118841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:36.118841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:36.118841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:36.118841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:36.118841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:36.118841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:36.118841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:36.118841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:36.119728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:36.119728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:36.119728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:36.119728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:36.119728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 344/673] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:36.119995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2bc09-dfde-4cea-8d2f-1aabfa4631ea None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:36.194303 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e466f5d-6f07-4094-945a-cfefff4a0d2c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:36.225279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2bc09-dfde-4cea-8d2f-1aabfa4631ea None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:36.228406 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511b6aa-b2dd-4dc1-9e2e-a1030d894b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:36.229058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511b6aa-b2dd-4dc1-9e2e-a1030d894b87 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:36.229333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511b6aa-b2dd-4dc1-9e2e-a1030d894b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:36.229603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511b6aa-b2dd-4dc1-9e2e-a1030d894b87 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:36.230374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511b6aa-b2dd-4dc1-9e2e-a1030d894b87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:36.230681 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511b6aa-b2dd-4dc1-9e2e-a1030d894b87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:36.232130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511b6aa-b2dd-4dc1-9e2e-a1030d894b87 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:36.243600 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 330/674] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:36.244220 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511b6aa-b2dd-4dc1-9e2e-a1030d894b87 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:36.264456 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d4bd9-3288-453b-b951-1ce701b47863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:36.265119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d4bd9-3288-453b-b951-1ce701b47863 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:36.265384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d4bd9-3288-453b-b951-1ce701b47863 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:36.265656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d4bd9-3288-453b-b951-1ce701b47863 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:36.266433 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d4bd9-3288-453b-b951-1ce701b47863 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:36.266757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d4bd9-3288-453b-b951-1ce701b47863 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:36.269221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d4bd9-3288-453b-b951-1ce701b47863 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:36.281432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 345/675] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:36.283140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63748f75-47ce-4aae-8726-8050a184cb89 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:36.283140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63748f75-47ce-4aae-8726-8050a184cb89 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:36.283621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63748f75-47ce-4aae-8726-8050a184cb89 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:36.284978 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 346/676] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:36.285766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63748f75-47ce-4aae-8726-8050a184cb89 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:36.299829 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:36.309057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:36.351348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511b6aa-b2dd-4dc1-9e2e-a1030d894b87 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:36.386166 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd981ae-e037-4fdf-874a-e3ea28beff21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:36.386970 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd981ae-e037-4fdf-874a-e3ea28beff21 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:36.387260 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd981ae-e037-4fdf-874a-e3ea28beff21 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:36.387537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd981ae-e037-4fdf-874a-e3ea28beff21 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:36.388257 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd981ae-e037-4fdf-874a-e3ea28beff21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:36.388564 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd981ae-e037-4fdf-874a-e3ea28beff21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:36.390184 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd981ae-e037-4fdf-874a-e3ea28beff21 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:36.390286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63748f75-47ce-4aae-8726-8050a184cb89 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:36.402387 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 331/677] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:36.403219 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd981ae-e037-4fdf-874a-e3ea28beff21 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:36.425710 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42849b9f-2afb-4141-9ccb-0eb298eeadfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:36.426368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849b9f-2afb-4141-9ccb-0eb298eeadfe None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:36.426646 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849b9f-2afb-4141-9ccb-0eb298eeadfe None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:36.426950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849b9f-2afb-4141-9ccb-0eb298eeadfe None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:36.427655 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42849b9f-2afb-4141-9ccb-0eb298eeadfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:36.427957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42849b9f-2afb-4141-9ccb-0eb298eeadfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:36.429303 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42849b9f-2afb-4141-9ccb-0eb298eeadfe None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:36.440485 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 347/678] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:36.441268 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42849b9f-2afb-4141-9ccb-0eb298eeadfe None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:36.505937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd981ae-e037-4fdf-874a-e3ea28beff21 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:36.516682 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:36.521614 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:36.540287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357eed8-10de-459c-a714-fea81fa542f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:36.540950 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357eed8-10de-459c-a714-fea81fa542f9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:36.541231 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357eed8-10de-459c-a714-fea81fa542f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:36.541356 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42849b9f-2afb-4141-9ccb-0eb298eeadfe None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:36.541514 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357eed8-10de-459c-a714-fea81fa542f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:36.542324 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357eed8-10de-459c-a714-fea81fa542f9 None admin] RBAC: Adding query filter params (role.id=42cae330d9ab456c8212ca146daf9322, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=726c2035855c444b88ec07a7811ea711) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:36.542639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357eed8-10de-459c-a714-fea81fa542f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:36.544095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357eed8-10de-459c-a714-fea81fa542f9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:36.550557 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 332/679] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:18:36 2022] GET /identity/v3/role_assignments?user.id=726c2035855c444b88ec07a7811ea711&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=42cae330d9ab456c8212ca146daf9322 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:36.551726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ee1ab-63cc-46a2-aab9-844e934c2709 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:36.552016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ee1ab-63cc-46a2-aab9-844e934c2709 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:36.552292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ee1ab-63cc-46a2-aab9-844e934c2709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:36.570201 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-cb6ee1ab-63cc-46a2-aab9-844e934c2709 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:36.571481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cb6ee1ab-63cc-46a2-aab9-844e934c2709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:36.588074 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9db80-7f2c-4e22-a95e-3656c225223e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:36.588833 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9db80-7f2c-4e22-a95e-3656c225223e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:36.589190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9db80-7f2c-4e22-a95e-3656c225223e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:36.589535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9db80-7f2c-4e22-a95e-3656c225223e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:36.590454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9db80-7f2c-4e22-a95e-3656c225223e None admin] RBAC: Adding query filter params (role.id=42cae330d9ab456c8212ca146daf9322, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=1af8b237e2df41668bc5409d8fdd3f67) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:36.590789 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9db80-7f2c-4e22-a95e-3656c225223e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:36.592246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9db80-7f2c-4e22-a95e-3656c225223e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:36.607385 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 348/680] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:18:36 2022] GET /identity/v3/role_assignments?user.id=1af8b237e2df41668bc5409d8fdd3f67&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=42cae330d9ab456c8212ca146daf9322 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:36.609028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9db80-7f2c-4e22-a95e-3656c225223e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:36.658811 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 333/681] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:36.658811 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ee1ab-63cc-46a2-aab9-844e934c2709 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:36.780989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9db80-7f2c-4e22-a95e-3656c225223e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:36.795631 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ee1ab-63cc-46a2-aab9-844e934c2709 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:36.797997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:36.826521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b51c87-08fd-4cff-90c2-6016fb24e324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:36.827359 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b51c87-08fd-4cff-90c2-6016fb24e324 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:36.827640 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b51c87-08fd-4cff-90c2-6016fb24e324 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:36.827915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b51c87-08fd-4cff-90c2-6016fb24e324 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:36.836818 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b51c87-08fd-4cff-90c2-6016fb24e324 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:36.838085 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b51c87-08fd-4cff-90c2-6016fb24e324 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:36.839244 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f01ee-2e66-4321-b412-9b061d8ae292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:36.840541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f01ee-2e66-4321-b412-9b061d8ae292 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:36.841625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f01ee-2e66-4321-b412-9b061d8ae292 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:36.842112 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f01ee-2e66-4321-b412-9b061d8ae292 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:36.850141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f01ee-2e66-4321-b412-9b061d8ae292 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:36.851876 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f01ee-2e66-4321-b412-9b061d8ae292 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:36.854794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-34b51c87-08fd-4cff-90c2-6016fb24e324 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 12:18:36.854794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:36.854794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:36.854794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:36.854794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:36.854794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:36.854794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:36.854794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:36.854794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:36.854794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:36.854794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:36.854794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:36.854794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:36.854794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:36.854794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:36.854794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:36.855747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:36.855747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:36.855747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:36.855747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:36.855747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:36.855747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:36.855747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:36.855747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:36.855747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:36.855747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:36.855747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:36.855747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:36.855747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:36.855747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:36.855747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:36.855747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:36.855747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:36.855747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:36.856666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:36.856666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:36.856666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:36.856666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:36.856666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:36.856666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:36.856666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:36.856666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:36.856666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 12:18:36.856666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:36.856666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 349/682] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:18:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:36.857264 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b51c87-08fd-4cff-90c2-6016fb24e324 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:36.861971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:36.871108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-d75f01ee-2e66-4321-b412-9b061d8ae292 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:36.871108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:36.871108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:36.871108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:36.871108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:36.871108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:36.871108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:36.871108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:36.871108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:36.871108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:36.871108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:36.871108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:36.871108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:36.871108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:36.871108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:36.872287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:36.872287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:36.872287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:36.872287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:36.872287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:36.872287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:36.872287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:36.872287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:36.872287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:36.872287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:36.872287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:36.872287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:36.872287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:36.872287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:36.872287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:36.872287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:36.872287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:36.873437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:36.873437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:36.873437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:36.873437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:36.873437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:36.873437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:36.873437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:36.873437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:36.875665 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 334/683] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:36.877018 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f01ee-2e66-4321-b412-9b061d8ae292 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:36.989207 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f01ee-2e66-4321-b412-9b061d8ae292 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:36.994187 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b51c87-08fd-4cff-90c2-6016fb24e324 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:37.026643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060999a-ab53-4ba1-b456-3572a391ed13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:37.027364 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060999a-ab53-4ba1-b456-3572a391ed13 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:37.027648 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060999a-ab53-4ba1-b456-3572a391ed13 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:37.027920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060999a-ab53-4ba1-b456-3572a391ed13 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:37.028757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060999a-ab53-4ba1-b456-3572a391ed13 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:37.029168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060999a-ab53-4ba1-b456-3572a391ed13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:37.030728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060999a-ab53-4ba1-b456-3572a391ed13 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:37.039215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9855fa0-5016-4ac8-afa7-e5281e21d81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:37.040031 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9855fa0-5016-4ac8-afa7-e5281e21d81f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:37.040313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9855fa0-5016-4ac8-afa7-e5281e21d81f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:37.040849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9855fa0-5016-4ac8-afa7-e5281e21d81f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:37.055042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9855fa0-5016-4ac8-afa7-e5281e21d81f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:37.057325 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 335/684] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Jul 19 12:18:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:37.058521 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060999a-ab53-4ba1-b456-3572a391ed13 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:37.062868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a9855fa0-5016-4ac8-afa7-e5281e21d81f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:18:37.062868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:37.062868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:37.062868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:37.062868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:37.062868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:37.062868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:37.062868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:37.062868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:37.062868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:37.062868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:37.062868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:37.062868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:37.062868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:37.062868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:37.062868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:37.063776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:37.063776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:37.063776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:37.063776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:37.063776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:37.063776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:37.063776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:37.063776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:37.063776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:37.063776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:37.063776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:37.063776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:37.063776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:37.063776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:37.063776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:37.063776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:37.064942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:37.064942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:37.064942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:37.064942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:37.064942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:37.064942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:37.064942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:37.064942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:37.064942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:37.064942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:37.064942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:18:37.064942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:37.064942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 350/685] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:18:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:37.065652 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9855fa0-5016-4ac8-afa7-e5281e21d81f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:37.090490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:37.152053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:37.194779 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060999a-ab53-4ba1-b456-3572a391ed13 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:37.209503 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9855fa0-5016-4ac8-afa7-e5281e21d81f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:37.240410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbdde7-48f6-4bd0-ab25-18eb57c475eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:37.241426 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbdde7-48f6-4bd0-ab25-18eb57c475eb None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:37.241786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbdde7-48f6-4bd0-ab25-18eb57c475eb None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:37.242139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbdde7-48f6-4bd0-ab25-18eb57c475eb None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:37.243489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbdde7-48f6-4bd0-ab25-18eb57c475eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:37.244015 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbdde7-48f6-4bd0-ab25-18eb57c475eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:37.245768 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbdde7-48f6-4bd0-ab25-18eb57c475eb None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:37.248170 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec5c1f-d032-445f-b89b-d117600be123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:37.248893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec5c1f-d032-445f-b89b-d117600be123 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:37.249260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec5c1f-d032-445f-b89b-d117600be123 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:37.249614 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec5c1f-d032-445f-b89b-d117600be123 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:37.260793 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 336/686] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:37.261802 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbdde7-48f6-4bd0-ab25-18eb57c475eb None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:37.322015 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec5c1f-d032-445f-b89b-d117600be123 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:37.323626 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec5c1f-d032-445f-b89b-d117600be123 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:37.369186 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:37.395171 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:37.396749 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbdde7-48f6-4bd0-ab25-18eb57c475eb None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:37.446294 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 351/687] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:37.446294 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec5c1f-d032-445f-b89b-d117600be123 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:37.450003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d9077-0817-4e29-a807-3f6f914ac8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:37.450928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d9077-0817-4e29-a807-3f6f914ac8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:37.451375 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d9077-0817-4e29-a807-3f6f914ac8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:37.451798 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d9077-0817-4e29-a807-3f6f914ac8d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:37.452698 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d9077-0817-4e29-a807-3f6f914ac8d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:37.453592 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d9077-0817-4e29-a807-3f6f914ac8d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:37.455228 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d9077-0817-4e29-a807-3f6f914ac8d2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:37.467527 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 337/688] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:37.468925 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d9077-0817-4e29-a807-3f6f914ac8d2 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:37.560077 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec5c1f-d032-445f-b89b-d117600be123 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:37.600355 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d9077-0817-4e29-a807-3f6f914ac8d2 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:37.608654 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d3a34-cb22-4d2d-8426-1b560d5146e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:37.609493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d3a34-cb22-4d2d-8426-1b560d5146e9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:37.610363 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d3a34-cb22-4d2d-8426-1b560d5146e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:37.610942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d3a34-cb22-4d2d-8426-1b560d5146e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:37.612546 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d3a34-cb22-4d2d-8426-1b560d5146e9 None admin] RBAC: Adding query filter params (role.id=42cae330d9ab456c8212ca146daf9322, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=977392666b5a4076884416489b935ad6) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:37.613298 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d3a34-cb22-4d2d-8426-1b560d5146e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:37.615188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d3a34-cb22-4d2d-8426-1b560d5146e9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:37.623872 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 352/689] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:18:37 2022] GET /identity/v3/role_assignments?user.id=977392666b5a4076884416489b935ad6&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=42cae330d9ab456c8212ca146daf9322 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:37.625177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d3a34-cb22-4d2d-8426-1b560d5146e9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:37.642469 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff927d-3a77-4053-bbef-8af34f6dad80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:37.643394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff927d-3a77-4053-bbef-8af34f6dad80 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:37.643679 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff927d-3a77-4053-bbef-8af34f6dad80 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:37.643951 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff927d-3a77-4053-bbef-8af34f6dad80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:37.656484 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff927d-3a77-4053-bbef-8af34f6dad80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:37.658978 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff927d-3a77-4053-bbef-8af34f6dad80 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:37.662627 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:37.670205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:37.701732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-18ff927d-3a77-4053-bbef-8af34f6dad80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:37.701732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:37.701732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:37.701732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:37.701732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:37.701732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:37.701732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:37.701732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:37.701732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:37.701732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:37.701732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:37.701732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:37.701732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:37.701732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:37.701732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:37.702728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:37.702728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:37.702728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:37.702728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:37.702728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:37.702728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:37.702728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:37.702728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:37.702728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:37.702728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:37.702728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:37.702728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:37.702728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:37.702728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:37.702728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:37.702728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:37.702728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:37.704130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:37.704130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:37.704130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:37.704130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:37.712889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 338/690] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:37.716755 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff927d-3a77-4053-bbef-8af34f6dad80 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:37.812435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d3a34-cb22-4d2d-8426-1b560d5146e9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:37.852992 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53de5be-a7a4-4789-bf60-1bff005e6fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:37.853820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53de5be-a7a4-4789-bf60-1bff005e6fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:37.854099 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53de5be-a7a4-4789-bf60-1bff005e6fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:37.854375 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53de5be-a7a4-4789-bf60-1bff005e6fa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:37.874534 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53de5be-a7a4-4789-bf60-1bff005e6fa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:37.876206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53de5be-a7a4-4789-bf60-1bff005e6fa4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:37.879065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff927d-3a77-4053-bbef-8af34f6dad80 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:37.902054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b53de5be-a7a4-4789-bf60-1bff005e6fa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:37.902054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:37.902054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:37.902054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:37.902054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:37.902054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:37.902054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:37.902054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:37.902054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:37.902054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:37.902054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:37.902054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:37.902054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:37.902054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:37.902054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:37.903045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:37.903045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:37.903045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:37.903045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:37.903045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:37.903045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:37.903045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:37.903045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:37.903045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:37.903045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:37.903045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:37.903045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:37.903045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:37.903045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:37.903045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:37.903045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:37.903045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:37.903937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:37.903937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:37.903937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:37.903937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:37.903937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 353/691] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:37.911275 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53de5be-a7a4-4789-bf60-1bff005e6fa4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:37.926094 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dcf75-1f75-4628-b4f3-5eab11a567b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:37.926851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dcf75-1f75-4628-b4f3-5eab11a567b8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:37.927146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dcf75-1f75-4628-b4f3-5eab11a567b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:37.927807 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dcf75-1f75-4628-b4f3-5eab11a567b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:37.928553 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724dcf75-1f75-4628-b4f3-5eab11a567b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:37.929171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724dcf75-1f75-4628-b4f3-5eab11a567b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:37.930874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724dcf75-1f75-4628-b4f3-5eab11a567b8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:37.946629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 339/692] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:37.952466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dcf75-1f75-4628-b4f3-5eab11a567b8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:38.022991 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:38.028870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:38.046411 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53de5be-a7a4-4789-bf60-1bff005e6fa4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:38.084118 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dcf75-1f75-4628-b4f3-5eab11a567b8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:38.095404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5ac6d-52f5-4790-97fb-c79ae869af45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:38.096142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5ac6d-52f5-4790-97fb-c79ae869af45 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:38.096528 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5ac6d-52f5-4790-97fb-c79ae869af45 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:38.096863 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5ac6d-52f5-4790-97fb-c79ae869af45 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:38.097596 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5ac6d-52f5-4790-97fb-c79ae869af45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:38.097903 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5ac6d-52f5-4790-97fb-c79ae869af45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:38.099417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5ac6d-52f5-4790-97fb-c79ae869af45 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:38.120395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f3e16-b47b-41f8-82ea-6eb400666c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:38.120713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 354/693] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:38.126709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f3e16-b47b-41f8-82ea-6eb400666c37 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:38.126709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f3e16-b47b-41f8-82ea-6eb400666c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:38.126709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f3e16-b47b-41f8-82ea-6eb400666c37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:38.128049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5ac6d-52f5-4790-97fb-c79ae869af45 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:38.133685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f3e16-b47b-41f8-82ea-6eb400666c37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:38.135273 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f3e16-b47b-41f8-82ea-6eb400666c37 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:38.152218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-a66f3e16-b47b-41f8-82ea-6eb400666c37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:38.152218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:38.152218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:38.152218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:38.152218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:38.152218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:38.152218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:38.152218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:38.152218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:38.152218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:38.152218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:38.152218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:38.152218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:38.152218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:38.152218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:38.153113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:38.153113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:38.153113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:38.153113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:38.153113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:38.153113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:38.153113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:38.153113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:38.153113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:38.153113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:38.153113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:38.153113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:38.153113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:38.153113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:38.153113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:38.153113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:38.153113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:38.153991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:38.153991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:38.153991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:38.153991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:38.153991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:38.153991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:38.153991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:38.153991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:38.153991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 340/694] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:38.163573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f3e16-b47b-41f8-82ea-6eb400666c37 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:38.332909 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5ac6d-52f5-4790-97fb-c79ae869af45 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:38.350166 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f3e16-b47b-41f8-82ea-6eb400666c37 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:38.380897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:38.397268 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fecf7c-446b-495d-8cf0-fcf68ee2483e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:38.398173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fecf7c-446b-495d-8cf0-fcf68ee2483e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:38.398552 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fecf7c-446b-495d-8cf0-fcf68ee2483e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:38.398955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fecf7c-446b-495d-8cf0-fcf68ee2483e None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:38.399850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fecf7c-446b-495d-8cf0-fcf68ee2483e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:38.400280 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fecf7c-446b-495d-8cf0-fcf68ee2483e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:38.401934 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fecf7c-446b-495d-8cf0-fcf68ee2483e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:38.415465 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba667c23-0aa6-49e5-bc17-d3a47de3a213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:38.416512 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 341/695] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:38.417067 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba667c23-0aa6-49e5-bc17-d3a47de3a213 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:38.417355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba667c23-0aa6-49e5-bc17-d3a47de3a213 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:38.417628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba667c23-0aa6-49e5-bc17-d3a47de3a213 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:38.423868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fecf7c-446b-495d-8cf0-fcf68ee2483e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:38.426458 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba667c23-0aa6-49e5-bc17-d3a47de3a213 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:38.428073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba667c23-0aa6-49e5-bc17-d3a47de3a213 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:38.435515 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:38.460665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ba667c23-0aa6-49e5-bc17-d3a47de3a213 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 12:18:38.460665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:38.460665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:38.460665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:38.460665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:38.460665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:38.460665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:38.460665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:38.460665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:38.460665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:38.460665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:38.460665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:38.460665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:38.460665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:38.460665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:38.460665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:38.461672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:38.461672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:38.461672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:38.461672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:38.461672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:38.461672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:38.461672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:38.461672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:38.461672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:38.461672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:38.461672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:38.461672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:38.461672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:38.461672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:38.461672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:38.461672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:38.461672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:38.461672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:38.462600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:38.462600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:38.462600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:38.462600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:38.462600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:38.462600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:38.462600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:38.462600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:38.462600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 12:18:38.462600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:38.462600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 355/696] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Jul 19 12:18:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:38.471625 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba667c23-0aa6-49e5-bc17-d3a47de3a213 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:38.539328 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fecf7c-446b-495d-8cf0-fcf68ee2483e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:38.579381 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552dfce6-9e17-44c2-86d0-22bdf9840f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:38.580941 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dfce6-9e17-44c2-86d0-22bdf9840f11 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:38.581431 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dfce6-9e17-44c2-86d0-22bdf9840f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:38.581910 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dfce6-9e17-44c2-86d0-22bdf9840f11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:38.583027 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552dfce6-9e17-44c2-86d0-22bdf9840f11 None admin] RBAC: Adding query filter params (role.id=42cae330d9ab456c8212ca146daf9322, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=35cc2e1079d34745a279588028945c3c) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:38.583534 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552dfce6-9e17-44c2-86d0-22bdf9840f11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:38.585157 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552dfce6-9e17-44c2-86d0-22bdf9840f11 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:38.591867 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 342/697] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:18:38 2022] GET /identity/v3/role_assignments?user.id=35cc2e1079d34745a279588028945c3c&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=42cae330d9ab456c8212ca146daf9322 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:38.649142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba667c23-0aa6-49e5-bc17-d3a47de3a213 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:38.701510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f116e-457f-41e8-86c3-d63b56e935ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:38.702501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f116e-457f-41e8-86c3-d63b56e935ae None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:38.703021 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f116e-457f-41e8-86c3-d63b56e935ae None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:38.703488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f116e-457f-41e8-86c3-d63b56e935ae None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:38.705095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f116e-457f-41e8-86c3-d63b56e935ae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:38.705679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f116e-457f-41e8-86c3-d63b56e935ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:38.707600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f116e-457f-41e8-86c3-d63b56e935ae None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:38.740381 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 356/698] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Jul 19 12:18:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:38.746310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552dfce6-9e17-44c2-86d0-22bdf9840f11 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:38.792816 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:38.856654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552dfce6-9e17-44c2-86d0-22bdf9840f11 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:38.893807 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4de1d-dc29-4174-ab7f-3e3d0407cd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:38.894878 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4de1d-dc29-4174-ab7f-3e3d0407cd19 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:38.895359 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4de1d-dc29-4174-ab7f-3e3d0407cd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:38.895827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4de1d-dc29-4174-ab7f-3e3d0407cd19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:38.946421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b994bf-aacc-4755-a3a2-945ab64d126f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:38.947077 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b994bf-aacc-4755-a3a2-945ab64d126f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:38.947576 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b994bf-aacc-4755-a3a2-945ab64d126f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:38.949127 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 357/699] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:18:38.954200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd79b8-1e4e-49ca-83a9-9a6eb705482c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:38.954544 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd79b8-1e4e-49ca-83a9-9a6eb705482c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:38.954848 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd79b8-1e4e-49ca-83a9-9a6eb705482c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:38.971654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4de1d-dc29-4174-ab7f-3e3d0407cd19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:38.973412 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4de1d-dc29-4174-ab7f-3e3d0407cd19 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:38.974521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0ccd79b8-1e4e-49ca-83a9-9a6eb705482c None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:38.976444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0ccd79b8-1e4e-49ca-83a9-9a6eb705482c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:39.019000 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:39.044138 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:39.070757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 358/700] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:18:39.070757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f33de-e545-4358-b13f-eb2f91b10747 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:39.070757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f33de-e545-4358-b13f-eb2f91b10747 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:39.070757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f33de-e545-4358-b13f-eb2f91b10747 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:39.070757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 359/701] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:39.075390 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7f426-030a-42b7-9440-3fc129088958 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:39.075774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7f426-030a-42b7-9440-3fc129088958 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:39.075955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7f426-030a-42b7-9440-3fc129088958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:39.096397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-71b7f426-030a-42b7-9440-3fc129088958 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:39.097693 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-71b7f426-030a-42b7-9440-3fc129088958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:39.106436 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 343/702] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:39.107677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4de1d-dc29-4174-ab7f-3e3d0407cd19 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:39.182243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 360/703] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:18:39.183535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7f426-030a-42b7-9440-3fc129088958 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:39.239612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4de1d-dc29-4174-ab7f-3e3d0407cd19 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:39.279217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085eefb7-e181-4dab-9c57-b9fe3de4ba7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:39.280087 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085eefb7-e181-4dab-9c57-b9fe3de4ba7d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:39.280373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085eefb7-e181-4dab-9c57-b9fe3de4ba7d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:39.280654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085eefb7-e181-4dab-9c57-b9fe3de4ba7d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:39.281631 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085eefb7-e181-4dab-9c57-b9fe3de4ba7d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:39.282900 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085eefb7-e181-4dab-9c57-b9fe3de4ba7d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:39.294295 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7f426-030a-42b7-9440-3fc129088958 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:39.299625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-085eefb7-e181-4dab-9c57-b9fe3de4ba7d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 12:18:39.299625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:39.299625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:18:39.299625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:18:39.299625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:18:39.299625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:18:39.299625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:18:39.299625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:39.299625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 12:18:39.299625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:39.299625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:18:39.299625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:39.299625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:39.299625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:39.299625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:39.299625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:39.300671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:39.300671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:39.300671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:39.300671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:39.300671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:39.300671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:39.300671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:39.300671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:18:39.300671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:18:39.300671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:18:39.300671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:18:39.300671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:39.300671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:39.300671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:39.300671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:39.300671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:39.301507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:39.301507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:39.301507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:39.301507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:39.301507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:39.301507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:39.301507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:39.301507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:39.301507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:39.301507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:39.301507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:39.301507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:18:39.301507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:39.301507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 12:18:39.301507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:39.301507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 344/704] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Jul 19 12:18:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:39.302357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085eefb7-e181-4dab-9c57-b9fe3de4ba7d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:39.306494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:39.318855 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:39.337702 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b19308-0d1c-4dd0-8ab2-0dbd767a7baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:39.338710 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b19308-0d1c-4dd0-8ab2-0dbd767a7baf None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:39.339161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b19308-0d1c-4dd0-8ab2-0dbd767a7baf None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:39.339582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b19308-0d1c-4dd0-8ab2-0dbd767a7baf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:39.350341 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b19308-0d1c-4dd0-8ab2-0dbd767a7baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:39.352022 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b19308-0d1c-4dd0-8ab2-0dbd767a7baf None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:39.371053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f5b19308-0d1c-4dd0-8ab2-0dbd767a7baf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:39.371053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:39.371053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:39.371053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:39.371053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:39.371053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:39.371053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:39.371053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:39.371053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:39.371053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:39.371053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:39.371053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:39.371053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:39.371053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:39.371053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:39.372133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:39.372133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:39.372133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:39.372133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:39.372133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:39.372133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:39.372133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:39.372133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:39.372133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:39.372133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:39.372133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:39.372133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:39.372133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:39.372133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:39.372133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:39.372133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:39.372133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:39.373050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:39.373050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:39.373050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:39.373050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:39.375168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 361/705] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:39.376158 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b19308-0d1c-4dd0-8ab2-0dbd767a7baf None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:39.421777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085eefb7-e181-4dab-9c57-b9fe3de4ba7d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:39.460363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f962be-22f5-4f87-a27e-7afdb51a722c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:39.462187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f962be-22f5-4f87-a27e-7afdb51a722c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:39.464045 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f962be-22f5-4f87-a27e-7afdb51a722c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:39.466692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f962be-22f5-4f87-a27e-7afdb51a722c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:39.481583 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f962be-22f5-4f87-a27e-7afdb51a722c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:39.483205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f962be-22f5-4f87-a27e-7afdb51a722c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:39.487044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b19308-0d1c-4dd0-8ab2-0dbd767a7baf None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:39.501957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-47f962be-22f5-4f87-a27e-7afdb51a722c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:39.501957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:39.501957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:39.501957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:39.501957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:39.501957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:39.501957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:39.501957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:39.501957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:39.501957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:39.501957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:39.501957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:39.501957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:39.501957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:39.501957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:39.502933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:39.502933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:39.502933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:39.502933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:39.502933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:39.502933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:39.502933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:39.502933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:39.502933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:39.502933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:39.502933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:39.502933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:39.502933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:39.502933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:39.502933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:39.502933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:39.502933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:39.503811 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:39.503811 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:39.503811 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:39.503811 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:39.503811 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 345/706] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:39.504517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f962be-22f5-4f87-a27e-7afdb51a722c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:39.527805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29d96a-2cc0-49c9-9eff-4282441c7fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:39.528881 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29d96a-2cc0-49c9-9eff-4282441c7fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:39.529405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29d96a-2cc0-49c9-9eff-4282441c7fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:39.529916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29d96a-2cc0-49c9-9eff-4282441c7fc0 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:39.530885 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29d96a-2cc0-49c9-9eff-4282441c7fc0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:39.531450 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29d96a-2cc0-49c9-9eff-4282441c7fc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:39.534116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29d96a-2cc0-49c9-9eff-4282441c7fc0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:39.539725 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 362/707] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Jul 19 12:18:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:39.540775 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29d96a-2cc0-49c9-9eff-4282441c7fc0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:39.573911 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:39.578878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:39.625661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f962be-22f5-4f87-a27e-7afdb51a722c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:39.662019 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954b53f-6a56-4f41-9760-cac0ec2111d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:39.662767 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954b53f-6a56-4f41-9760-cac0ec2111d6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:39.663075 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954b53f-6a56-4f41-9760-cac0ec2111d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:39.663391 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954b53f-6a56-4f41-9760-cac0ec2111d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:39.664071 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954b53f-6a56-4f41-9760-cac0ec2111d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:39.664378 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954b53f-6a56-4f41-9760-cac0ec2111d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:39.665742 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954b53f-6a56-4f41-9760-cac0ec2111d6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:39.676690 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29d96a-2cc0-49c9-9eff-4282441c7fc0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:39.678539 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 346/708] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:39.679681 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954b53f-6a56-4f41-9760-cac0ec2111d6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:39.727953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d73a66-580c-40a5-8e45-f0e830268b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:39.729063 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d73a66-580c-40a5-8e45-f0e830268b01 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:39.729564 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d73a66-580c-40a5-8e45-f0e830268b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:39.730070 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d73a66-580c-40a5-8e45-f0e830268b01 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:39.731188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d73a66-580c-40a5-8e45-f0e830268b01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:39.731701 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d73a66-580c-40a5-8e45-f0e830268b01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:39.733386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d73a66-580c-40a5-8e45-f0e830268b01 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:39.746592 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 363/709] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:39.747935 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d73a66-580c-40a5-8e45-f0e830268b01 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:39.797123 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954b53f-6a56-4f41-9760-cac0ec2111d6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:39.815162 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:39.835336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e58a2e-bcf3-4210-a3ae-d45add9f9580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:39.835897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e58a2e-bcf3-4210-a3ae-d45add9f9580 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:39.836182 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e58a2e-bcf3-4210-a3ae-d45add9f9580 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:39.836459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e58a2e-bcf3-4210-a3ae-d45add9f9580 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:39.837174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e58a2e-bcf3-4210-a3ae-d45add9f9580 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:39.837482 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e58a2e-bcf3-4210-a3ae-d45add9f9580 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:39.838915 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e58a2e-bcf3-4210-a3ae-d45add9f9580 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:39.845622 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 347/710] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Jul 19 12:18:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:39.846657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e58a2e-bcf3-4210-a3ae-d45add9f9580 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:39.855013 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:39.864627 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d73a66-580c-40a5-8e45-f0e830268b01 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:39.905409 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ac447-fdb3-4d9f-96ea-6f706b82b212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:39.906606 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ac447-fdb3-4d9f-96ea-6f706b82b212 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:39.907133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ac447-fdb3-4d9f-96ea-6f706b82b212 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:39.908268 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ac447-fdb3-4d9f-96ea-6f706b82b212 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:39.916483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ac447-fdb3-4d9f-96ea-6f706b82b212 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:39.918342 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ac447-fdb3-4d9f-96ea-6f706b82b212 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:39.934331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6a4ac447-fdb3-4d9f-96ea-6f706b82b212 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:39.934331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:39.934331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:39.934331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:39.934331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:39.934331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:39.934331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:39.934331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:39.934331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:39.934331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:39.934331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:39.934331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:39.934331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:39.934331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:39.934331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:39.935539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:39.935539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:39.935539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:39.935539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:39.935539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:39.935539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:39.935539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:39.935539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:39.935539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:39.935539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:39.935539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:39.935539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:39.935539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:39.935539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:39.935539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:39.935539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:39.935539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:39.936461 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:39.936461 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:39.936461 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:39.936461 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:39.936461 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:39.936461 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:39.936461 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:39.936461 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:39.942878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 364/711] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:39.946050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ac447-fdb3-4d9f-96ea-6f706b82b212 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:39.960141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e58a2e-bcf3-4210-a3ae-d45add9f9580 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:39.998259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf4c15-637e-4434-ad0a-0b3b74799a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:39.998916 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf4c15-637e-4434-ad0a-0b3b74799a17 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:39.999202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf4c15-637e-4434-ad0a-0b3b74799a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:39.999481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf4c15-637e-4434-ad0a-0b3b74799a17 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:40.000502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf4c15-637e-4434-ad0a-0b3b74799a17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:40.002173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf4c15-637e-4434-ad0a-0b3b74799a17 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:40.025174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 348/712] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 19 12:18:39 2022] POST /identity/v3/users => generated 254 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:18:40.068186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ac447-fdb3-4d9f-96ea-6f706b82b212 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:40.111723 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426277ea-a588-47af-9522-e4001d64e238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:40.113030 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426277ea-a588-47af-9522-e4001d64e238 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:40.113522 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426277ea-a588-47af-9522-e4001d64e238 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:40.114034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426277ea-a588-47af-9522-e4001d64e238 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:40.115163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426277ea-a588-47af-9522-e4001d64e238 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:40.115692 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426277ea-a588-47af-9522-e4001d64e238 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:40.117445 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426277ea-a588-47af-9522-e4001d64e238 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:40.134665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 365/713] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:40.139518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf4c15-637e-4434-ad0a-0b3b74799a17 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:40.184211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:40.189598 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe38c7-cdbc-406b-835e-51ddca77567b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:40.190028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe38c7-cdbc-406b-835e-51ddca77567b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:40.190311 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe38c7-cdbc-406b-835e-51ddca77567b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:40.192120 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 366/714] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:18:40.199930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabcdf7-b1ee-45a3-a48c-5c2dcf5139b0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:40.200360 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabcdf7-b1ee-45a3-a48c-5c2dcf5139b0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:40.200753 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabcdf7-b1ee-45a3-a48c-5c2dcf5139b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:40.219473 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cbabcdf7-b1ee-45a3-a48c-5c2dcf5139b0 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:40.221115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cbabcdf7-b1ee-45a3-a48c-5c2dcf5139b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:40.231911 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:40.300641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf4c15-637e-4434-ad0a-0b3b74799a17 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:40.303076 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 367/715] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 12:18:40.333159 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabcdf7-b1ee-45a3-a48c-5c2dcf5139b0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:40.342035 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a48493-284a-48df-95b9-246de3788525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:40.342697 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a48493-284a-48df-95b9-246de3788525 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:40.343028 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a48493-284a-48df-95b9-246de3788525 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:40.343297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a48493-284a-48df-95b9-246de3788525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:40.344133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a48493-284a-48df-95b9-246de3788525 None admin] RBAC: Adding query filter params (role.id=386cb814e8464fda8832b13c75eabdaf, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=5d9543657e1e4a6d85632bf57f6ba6eb) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:40.344437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a48493-284a-48df-95b9-246de3788525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:40.346994 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a48493-284a-48df-95b9-246de3788525 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:40.353390 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 349/716] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:18:40 2022] GET /identity/v3/role_assignments?user.id=5d9543657e1e4a6d85632bf57f6ba6eb&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=386cb814e8464fda8832b13c75eabdaf => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:40.462059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabcdf7-b1ee-45a3-a48c-5c2dcf5139b0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:40.503149 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094077c-c9d5-4b4c-aa48-1f01bd4fbc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:40.503963 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094077c-c9d5-4b4c-aa48-1f01bd4fbc9d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:40.504244 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094077c-c9d5-4b4c-aa48-1f01bd4fbc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:40.504517 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094077c-c9d5-4b4c-aa48-1f01bd4fbc9d None admin] PATH_INFO: `/v3/services/network` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:40.505180 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094077c-c9d5-4b4c-aa48-1f01bd4fbc9d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:40.506576 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094077c-c9d5-4b4c-aa48-1f01bd4fbc9d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:40.521954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-2094077c-c9d5-4b4c-aa48-1f01bd4fbc9d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 12:18:40.521954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:40.521954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:18:40.521954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:18:40.521954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:18:40.521954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:18:40.521954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:18:40.521954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:40.521954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 12:18:40.521954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:40.521954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:18:40.521954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:40.521954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:40.521954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:40.521954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:40.521954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:40.521954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:40.523049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:40.523049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:40.523049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:40.523049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:40.523049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:40.523049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:40.523049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:18:40.523049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:18:40.523049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:18:40.523049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:18:40.523049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:40.523049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:40.523049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:40.523049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:40.523049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:40.523049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:40.523880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:40.523880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:40.523880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:40.523880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:40.523880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:40.523880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:40.523880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:40.523880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:40.523880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:40.523880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:40.523880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:18:40.523880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:40.523880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 12:18:40.523880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:40.528224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 368/717] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:40 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:40.529617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a48493-284a-48df-95b9-246de3788525 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:40.635162 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:40.637997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a48493-284a-48df-95b9-246de3788525 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:40.674319 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2708f-dc33-4c37-a222-7ad3d99b9587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:40.675036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2708f-dc33-4c37-a222-7ad3d99b9587 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:40.675324 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2708f-dc33-4c37-a222-7ad3d99b9587 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:40.675601 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2708f-dc33-4c37-a222-7ad3d99b9587 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:40.676318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2708f-dc33-4c37-a222-7ad3d99b9587 None admin] RBAC: Adding query filter params (name=network) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:40.676623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2708f-dc33-4c37-a222-7ad3d99b9587 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:40.677992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2708f-dc33-4c37-a222-7ad3d99b9587 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:40.692530 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 350/718] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 19 12:18:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:40.694831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094077c-c9d5-4b4c-aa48-1f01bd4fbc9d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:40.708860 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:40.833124 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094077c-c9d5-4b4c-aa48-1f01bd4fbc9d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:40.896090 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b826b7-b9ca-422d-8454-4dced5130c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:40.896792 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b826b7-b9ca-422d-8454-4dced5130c76 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:40.897067 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b826b7-b9ca-422d-8454-4dced5130c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:40.897334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b826b7-b9ca-422d-8454-4dced5130c76 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:40.898042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b826b7-b9ca-422d-8454-4dced5130c76 None admin] RBAC: Adding query filter params (type=network) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:40.898349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b826b7-b9ca-422d-8454-4dced5130c76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:40.899737 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b826b7-b9ca-422d-8454-4dced5130c76 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:40.906099 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 369/719] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 19 12:18:40 2022] GET /identity/v3/services?type=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:41.279766 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9739f-ebf8-4ed1-a529-a8525a832bec None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:41.280144 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9739f-ebf8-4ed1-a529-a8525a832bec None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:41.280327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9739f-ebf8-4ed1-a529-a8525a832bec None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:41.282070 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 351/720] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:41.287975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675d6aa-3ca1-4ba4-9ae5-9860966e235c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:41.288264 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675d6aa-3ca1-4ba4-9ae5-9860966e235c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:41.288546 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675d6aa-3ca1-4ba4-9ae5-9860966e235c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:41.311119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b675d6aa-3ca1-4ba4-9ae5-9860966e235c None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:41.312335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b675d6aa-3ca1-4ba4-9ae5-9860966e235c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:41.405271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 370/721] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:41.452585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9739f-ebf8-4ed1-a529-a8525a832bec None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:41.561255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9739f-ebf8-4ed1-a529-a8525a832bec None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:41.598340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20c3c6-3ba1-4aa9-b12f-3dad9c1acd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:41.599179 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20c3c6-3ba1-4aa9-b12f-3dad9c1acd26 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:41.599463 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20c3c6-3ba1-4aa9-b12f-3dad9c1acd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:41.599739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20c3c6-3ba1-4aa9-b12f-3dad9c1acd26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:41.611687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20c3c6-3ba1-4aa9-b12f-3dad9c1acd26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:41.619632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-ee20c3c6-3ba1-4aa9-b12f-3dad9c1acd26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:18:41.619632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:41.619632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:41.619632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:41.619632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:41.619632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:41.619632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:41.619632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:41.619632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:41.619632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:41.619632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:41.619632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:41.619632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:41.619632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:41.619632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:41.619632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:41.620614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:41.620614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:41.620614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:41.620614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:41.620614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:41.620614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:41.620614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:41.620614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:41.620614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:41.620614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:41.620614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:41.620614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:41.620614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:41.620614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:41.620614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:41.620614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:41.621459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:41.621459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:41.621459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:41.621459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:41.621459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:41.621459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:41.621459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:41.621459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:41.621459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:41.621459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:41.621459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:18:41.621459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:41.621459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 352/722] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:18:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:41.627301 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675d6aa-3ca1-4ba4-9ae5-9860966e235c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:41.629038 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:41.790483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675d6aa-3ca1-4ba4-9ae5-9860966e235c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:41.839654 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d8790-0472-4c39-81c2-36e19622c923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:41.840681 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d8790-0472-4c39-81c2-36e19622c923 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:41.841190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d8790-0472-4c39-81c2-36e19622c923 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:41.841663 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d8790-0472-4c39-81c2-36e19622c923 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:41.842609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d8790-0472-4c39-81c2-36e19622c923 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:41.843147 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d8790-0472-4c39-81c2-36e19622c923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:41.844703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d8790-0472-4c39-81c2-36e19622c923 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:41.858265 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 371/723] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:41.864707 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20c3c6-3ba1-4aa9-b12f-3dad9c1acd26 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:41.903197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:42.035898 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20c3c6-3ba1-4aa9-b12f-3dad9c1acd26 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:42.087689 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68069cae-ab1e-4b37-89c8-d2adb0dbe595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:42.088540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68069cae-ab1e-4b37-89c8-d2adb0dbe595 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:42.088824 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68069cae-ab1e-4b37-89c8-d2adb0dbe595 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:42.089094 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68069cae-ab1e-4b37-89c8-d2adb0dbe595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:42.108753 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68069cae-ab1e-4b37-89c8-d2adb0dbe595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:42.110139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68069cae-ab1e-4b37-89c8-d2adb0dbe595 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:42.134103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-68069cae-ab1e-4b37-89c8-d2adb0dbe595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:42.134103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:42.134103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:42.134103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:42.134103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:42.134103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:42.134103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:42.134103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:42.134103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:42.134103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:42.134103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:42.134103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:42.134103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:42.134103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:42.134103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:42.135064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:42.135064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:42.135064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:42.135064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:42.135064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:42.135064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:42.135064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:42.135064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:42.135064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:42.135064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:42.135064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:42.135064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:42.135064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:42.135064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:42.135064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:42.135064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:42.135064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:42.136025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:42.136025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:42.136025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:42.136025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:42.136025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 353/724] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:42.142499 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d8790-0472-4c39-81c2-36e19622c923 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:42.236665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:42.264331 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213774f-61d4-469b-8695-6131ce7f4502 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:42.264634 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213774f-61d4-469b-8695-6131ce7f4502 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:42.264880 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213774f-61d4-469b-8695-6131ce7f4502 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:42.266238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 354/725] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:18:42.271315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85180-6da9-47b5-a41f-8d9fa09bc829 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:42.271602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85180-6da9-47b5-a41f-8d9fa09bc829 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:42.271882 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85180-6da9-47b5-a41f-8d9fa09bc829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:42.286152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d8790-0472-4c39-81c2-36e19622c923 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:42.307752 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a5c85180-6da9-47b5-a41f-8d9fa09bc829 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:42.308955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a5c85180-6da9-47b5-a41f-8d9fa09bc829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:42.333109 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a792a-e383-41cf-a414-6bfadf4d885b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:42.333773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a792a-e383-41cf-a414-6bfadf4d885b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:42.334047 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a792a-e383-41cf-a414-6bfadf4d885b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:42.334315 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a792a-e383-41cf-a414-6bfadf4d885b None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:42.335053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a792a-e383-41cf-a414-6bfadf4d885b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:42.335355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a792a-e383-41cf-a414-6bfadf4d885b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:42.336759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a792a-e383-41cf-a414-6bfadf4d885b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:42.357029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 372/726] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:42.363825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a792a-e383-41cf-a414-6bfadf4d885b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:42.380723 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 355/727] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:42.407787 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c85180-6da9-47b5-a41f-8d9fa09bc829 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:42.435115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:42.505832 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a792a-e383-41cf-a414-6bfadf4d885b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:42.521427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c85180-6da9-47b5-a41f-8d9fa09bc829 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:42.534118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:42.545168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13192022-099a-461f-8f8e-193995354093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:42.545966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13192022-099a-461f-8f8e-193995354093 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:42.546241 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13192022-099a-461f-8f8e-193995354093 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:42.546512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13192022-099a-461f-8f8e-193995354093 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:42.558314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13192022-099a-461f-8f8e-193995354093 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:42.559815 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13192022-099a-461f-8f8e-193995354093 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:42.587148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-13192022-099a-461f-8f8e-193995354093 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 12:18:42.587148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:42.587148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:42.587148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:42.587148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:42.587148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:42.587148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:42.587148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:42.587148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:42.587148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:42.587148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:42.587148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:42.587148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:42.587148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:42.587148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:42.587148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:42.588128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:42.588128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:42.588128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:42.588128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:42.588128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:42.588128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:42.588128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:42.588128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:42.588128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:42.588128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:42.588128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:42.588128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:42.588128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:42.588128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:42.588128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:42.588128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:42.588128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:42.588128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:42.589045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:42.589045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:42.589045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:42.589045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:42.589045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:42.589045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:42.589045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:42.589045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:42.589045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 12:18:42.589045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:42.596328 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 373/728] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:18:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:42.597839 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc1717-a686-4470-8121-94103e12893e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:42.598509 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc1717-a686-4470-8121-94103e12893e None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:42.598809 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc1717-a686-4470-8121-94103e12893e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:42.599080 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc1717-a686-4470-8121-94103e12893e None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:42.599818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc1717-a686-4470-8121-94103e12893e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:42.601171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc1717-a686-4470-8121-94103e12893e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:42.603788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13192022-099a-461f-8f8e-193995354093 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:42.632908 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 356/729] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 19 12:18:42 2022] POST /identity/v3/services => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:18:42.752423 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13192022-099a-461f-8f8e-193995354093 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:42.828822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbdebc-1e9c-4885-ad17-cc33671a332d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:42.829549 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbdebc-1e9c-4885-ad17-cc33671a332d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:42.829828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbdebc-1e9c-4885-ad17-cc33671a332d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:42.830153 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbdebc-1e9c-4885-ad17-cc33671a332d None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:42.831064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbdebc-1e9c-4885-ad17-cc33671a332d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:42.831374 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbdebc-1e9c-4885-ad17-cc33671a332d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:42.832816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbdebc-1e9c-4885-ad17-cc33671a332d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:42.865316 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 374/730] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Jul 19 12:18:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:42.871393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc1717-a686-4470-8121-94103e12893e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:42.947579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:42.986981 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc1717-a686-4470-8121-94103e12893e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:42.998011 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511ade4-8a45-411b-83a9-5d77a485eb69 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:42.998293 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511ade4-8a45-411b-83a9-5d77a485eb69 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:42.998579 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511ade4-8a45-411b-83a9-5d77a485eb69 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:43.000347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 375/731] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:18:43.006505 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb939eb-be92-459d-9fbd-687a48197e88 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:43.006807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb939eb-be92-459d-9fbd-687a48197e88 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:43.007088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb939eb-be92-459d-9fbd-687a48197e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:43.027372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ddb939eb-be92-459d-9fbd-687a48197e88 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:43.028574 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ddb939eb-be92-459d-9fbd-687a48197e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:43.028939 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930d17b-b779-4d4b-92c8-506efba4493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:43.029610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930d17b-b779-4d4b-92c8-506efba4493e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:43.029889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930d17b-b779-4d4b-92c8-506efba4493e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:43.030160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930d17b-b779-4d4b-92c8-506efba4493e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:43.071107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:43.102304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930d17b-b779-4d4b-92c8-506efba4493e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:43.103775 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930d17b-b779-4d4b-92c8-506efba4493e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:43.148654 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 376/732] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:43.181871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:43.182801 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb939eb-be92-459d-9fbd-687a48197e88 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:43.247071 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 357/733] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:42 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 12:18:43.249662 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930d17b-b779-4d4b-92c8-506efba4493e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:43.334367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb939eb-be92-459d-9fbd-687a48197e88 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:43.355571 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930d17b-b779-4d4b-92c8-506efba4493e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:43.385170 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0f10c-660f-4c7e-91f2-ccec2e57bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:43.386125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0f10c-660f-4c7e-91f2-ccec2e57bf3e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:43.386544 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0f10c-660f-4c7e-91f2-ccec2e57bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:43.386846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0f10c-660f-4c7e-91f2-ccec2e57bf3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:43.394442 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ad8e0-3190-4cba-8360-680c22f360b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:43.395478 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ad8e0-3190-4cba-8360-680c22f360b1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:43.395973 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ad8e0-3190-4cba-8360-680c22f360b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:43.396411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ad8e0-3190-4cba-8360-680c22f360b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:43.400713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0f10c-660f-4c7e-91f2-ccec2e57bf3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:43.407777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ad8e0-3190-4cba-8360-680c22f360b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:43.409481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ad8e0-3190-4cba-8360-680c22f360b1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:43.410008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f1a0f10c-660f-4c7e-91f2-ccec2e57bf3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:18:43.410008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:43.410008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:43.410008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:43.410008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:43.410008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:43.410008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:43.410008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:43.410008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:43.410008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:43.410008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:43.410008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:43.410008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:43.410008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:43.410008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:43.410008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:43.411155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:43.411155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:43.411155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:43.411155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:43.411155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:43.411155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:43.411155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:43.411155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:43.411155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:43.411155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:43.411155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:43.411155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:43.411155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:43.411155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:43.411155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:43.411155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:43.412053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:43.412053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:43.412053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:43.412053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:43.412053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:43.412053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:43.412053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:43.412053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:43.412053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:43.412053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:43.412053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:18:43.412053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:43.414880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 377/734] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:18:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:43.416446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15d551-9493-462c-a64e-e2b2a7a39c4b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:43.417948 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15d551-9493-462c-a64e-e2b2a7a39c4b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:43.418227 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15d551-9493-462c-a64e-e2b2a7a39c4b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:43.419954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 378/735] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:43.420514 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15d551-9493-462c-a64e-e2b2a7a39c4b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:43.437110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-874ad8e0-3190-4cba-8360-680c22f360b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:43.437110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:43.437110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:43.437110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:43.437110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:43.437110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:43.437110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:43.437110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:43.437110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:43.437110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:43.437110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:43.437110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:43.437110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:43.437110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:43.437110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:43.438003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:43.438003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:43.438003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:43.438003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:43.438003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:43.438003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:43.438003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:43.438003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:43.438003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:43.438003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:43.438003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:43.438003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:43.438003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:43.438003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:43.438003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:43.438003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:43.438003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:43.439444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:43.439444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:43.439444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:43.439444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:43.446182 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 358/736] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:43.448008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc8eae-475f-40c2-949f-d43d782219fd None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:43.448494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc8eae-475f-40c2-949f-d43d782219fd None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:43.449055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc8eae-475f-40c2-949f-d43d782219fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:43.450333 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:43.470572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-43fc8eae-475f-40c2-949f-d43d782219fd None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:43.472123 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-43fc8eae-475f-40c2-949f-d43d782219fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:43.487928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:43.533537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15d551-9493-462c-a64e-e2b2a7a39c4b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:43.546878 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 359/737] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:43.548786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc8eae-475f-40c2-949f-d43d782219fd None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:43.571538 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a8d28-2d74-4dc7-9128-3b7b4a94eaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:43.572304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a8d28-2d74-4dc7-9128-3b7b4a94eaed None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:43.572576 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a8d28-2d74-4dc7-9128-3b7b4a94eaed None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:43.572875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a8d28-2d74-4dc7-9128-3b7b4a94eaed None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:43.574186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a8d28-2d74-4dc7-9128-3b7b4a94eaed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:43.574718 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a8d28-2d74-4dc7-9128-3b7b4a94eaed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:43.577778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a8d28-2d74-4dc7-9128-3b7b4a94eaed None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:43.590184 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 379/738] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:43.596744 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a8d28-2d74-4dc7-9128-3b7b4a94eaed None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:43.658441 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc8eae-475f-40c2-949f-d43d782219fd None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:43.706423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0706f1-d4d7-4156-b179-890b63c547e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:43.707837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0706f1-d4d7-4156-b179-890b63c547e4 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:43.708589 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0706f1-d4d7-4156-b179-890b63c547e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:43.709075 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0706f1-d4d7-4156-b179-890b63c547e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:43.709652 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:43.710746 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0706f1-d4d7-4156-b179-890b63c547e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:43.711746 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0706f1-d4d7-4156-b179-890b63c547e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:43.713703 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0706f1-d4d7-4156-b179-890b63c547e4 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:43.722704 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a8d28-2d74-4dc7-9128-3b7b4a94eaed None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:43.733472 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 360/739] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:43.733472 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0706f1-d4d7-4156-b179-890b63c547e4 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:43.744672 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:43.763160 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82219bd2-800a-4921-9494-a6bbbd28c8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:43.764206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82219bd2-800a-4921-9494-a6bbbd28c8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:43.764491 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82219bd2-800a-4921-9494-a6bbbd28c8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:43.764764 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82219bd2-800a-4921-9494-a6bbbd28c8d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:43.776166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82219bd2-800a-4921-9494-a6bbbd28c8d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:43.784062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-82219bd2-800a-4921-9494-a6bbbd28c8d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:43.784062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:43.784062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:43.784062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:43.784062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:43.784062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:43.784062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:43.784062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:43.784062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:43.784062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:43.784062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:43.784062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:43.784062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:43.784062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:43.784062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:43.784062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:43.785114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:43.785114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:43.785114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:43.785114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:43.785114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:43.785114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:43.785114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:43.785114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:43.785114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:43.785114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:43.785114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:43.785114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:43.785114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:43.785114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:43.785114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:43.785114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:43.785960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:43.785960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:43.785960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:43.785960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:43.785960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:43.785960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:43.785960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:43.785960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:43.785960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:43.785960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:43.785960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:43.785960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:43.785960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 380/740] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:43.788053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e643b-738a-4e40-bd7b-17b7209a8d91 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:43.788336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e643b-738a-4e40-bd7b-17b7209a8d91 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:43.788610 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e643b-738a-4e40-bd7b-17b7209a8d91 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:43.790927 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 381/741] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:43.795468 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e643b-738a-4e40-bd7b-17b7209a8d91 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:43.846946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0706f1-d4d7-4156-b179-890b63c547e4 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:43.881876 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6687630-3127-4d4d-8dcb-935c6de7e311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:43.882777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6687630-3127-4d4d-8dcb-935c6de7e311 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:43.883066 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6687630-3127-4d4d-8dcb-935c6de7e311 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:43.883341 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6687630-3127-4d4d-8dcb-935c6de7e311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:43.894272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6687630-3127-4d4d-8dcb-935c6de7e311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:43.895747 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6687630-3127-4d4d-8dcb-935c6de7e311 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:43.906839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e643b-738a-4e40-bd7b-17b7209a8d91 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:43.912835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-e6687630-3127-4d4d-8dcb-935c6de7e311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:43.912835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:43.912835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:43.912835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:43.912835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:43.912835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:43.912835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:43.912835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:43.912835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:43.912835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:43.912835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:43.912835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:43.912835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:43.912835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:43.912835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:43.913685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:43.913685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:43.913685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:43.913685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:43.913685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:43.913685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:43.913685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:43.913685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:43.913685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:43.913685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:43.913685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:43.913685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:43.913685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:43.913685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:43.913685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:43.913685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:43.913685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:43.914562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:43.914562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:43.914562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:43.914562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:43.914562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 361/742] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:43.914868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6687630-3127-4d4d-8dcb-935c6de7e311 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:43.947687 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94267e8a-9924-40b2-ac2d-8e626fa247bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:43.948483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94267e8a-9924-40b2-ac2d-8e626fa247bd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:43.948767 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94267e8a-9924-40b2-ac2d-8e626fa247bd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:43.949042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94267e8a-9924-40b2-ac2d-8e626fa247bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:43.956440 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94267e8a-9924-40b2-ac2d-8e626fa247bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:43.957882 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94267e8a-9924-40b2-ac2d-8e626fa247bd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:43.972488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-94267e8a-9924-40b2-ac2d-8e626fa247bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:43.972488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:43.972488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:43.972488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:43.972488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:43.972488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:43.972488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:43.972488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:43.972488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:43.972488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:43.972488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:43.972488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:43.972488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:43.972488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:43.972488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:43.973361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:43.973361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:43.973361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:43.973361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:43.973361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:43.973361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:43.973361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:43.973361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:43.973361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:43.973361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:43.973361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:43.973361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:43.973361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:43.973361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:43.973361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:43.973361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:43.973361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:43.974229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:43.974229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:43.974229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:43.974229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:43.974229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:43.974229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:43.974229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:43.974229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:43.974229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 382/743] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:43.975158 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394f597-8025-4bc7-8edb-30e9cba527ad None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:43.975256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394f597-8025-4bc7-8edb-30e9cba527ad None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:43.975494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394f597-8025-4bc7-8edb-30e9cba527ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:43.985332 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:43.996581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a394f597-8025-4bc7-8edb-30e9cba527ad None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:43.998517 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a394f597-8025-4bc7-8edb-30e9cba527ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:44.001448 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:44.031184 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6687630-3127-4d4d-8dcb-935c6de7e311 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:44.066524 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cfa4f-2167-46e0-9470-80dee968c07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:44.067262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cfa4f-2167-46e0-9470-80dee968c07b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:44.067547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cfa4f-2167-46e0-9470-80dee968c07b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:44.067825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cfa4f-2167-46e0-9470-80dee968c07b None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:44.068608 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cfa4f-2167-46e0-9470-80dee968c07b None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:44.068919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cfa4f-2167-46e0-9470-80dee968c07b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:44.070437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cfa4f-2167-46e0-9470-80dee968c07b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:44.082759 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 362/744] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:18:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:44.082759 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cfa4f-2167-46e0-9470-80dee968c07b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:44.083137 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 383/745] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:43 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 12:18:44.084072 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394f597-8025-4bc7-8edb-30e9cba527ad None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:44.192726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cfa4f-2167-46e0-9470-80dee968c07b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:44.195816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394f597-8025-4bc7-8edb-30e9cba527ad None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:44.216412 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:44.229615 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceada5c-f86a-499a-91e0-50e4654abbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:44.230281 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceada5c-f86a-499a-91e0-50e4654abbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:44.230563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceada5c-f86a-499a-91e0-50e4654abbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:44.230877 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceada5c-f86a-499a-91e0-50e4654abbe4 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:44.231597 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceada5c-f86a-499a-91e0-50e4654abbe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:44.231902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceada5c-f86a-499a-91e0-50e4654abbe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:44.233261 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceada5c-f86a-499a-91e0-50e4654abbe4 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:44.237514 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72daa9-7823-47d8-9acd-a9702de370e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:44.238385 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72daa9-7823-47d8-9acd-a9702de370e5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:44.238912 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72daa9-7823-47d8-9acd-a9702de370e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:44.239369 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72daa9-7823-47d8-9acd-a9702de370e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:44.240387 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72daa9-7823-47d8-9acd-a9702de370e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:44.241321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72daa9-7823-47d8-9acd-a9702de370e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:44.243379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72daa9-7823-47d8-9acd-a9702de370e5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:44.245601 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 363/746] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:44.246394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceada5c-f86a-499a-91e0-50e4654abbe4 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:44.257474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:44.266113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 384/747] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:44.266875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72daa9-7823-47d8-9acd-a9702de370e5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:44.352025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceada5c-f86a-499a-91e0-50e4654abbe4 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:44.372647 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72daa9-7823-47d8-9acd-a9702de370e5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:44.388496 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47576b-ded2-4732-b80b-823ac5339d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:44.389659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47576b-ded2-4732-b80b-823ac5339d75 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:44.390069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47576b-ded2-4732-b80b-823ac5339d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:44.390348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47576b-ded2-4732-b80b-823ac5339d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:44.401333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47576b-ded2-4732-b80b-823ac5339d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:44.402970 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47576b-ded2-4732-b80b-823ac5339d75 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:44.406519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb3637-04e3-4619-a294-7d36d9ef2126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:44.407209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb3637-04e3-4619-a294-7d36d9ef2126 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:44.408367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb3637-04e3-4619-a294-7d36d9ef2126 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:44.408777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb3637-04e3-4619-a294-7d36d9ef2126 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:44.409498 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb3637-04e3-4619-a294-7d36d9ef2126 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:44.410900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb3637-04e3-4619-a294-7d36d9ef2126 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:44.423717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-bf47576b-ded2-4732-b80b-823ac5339d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:44.423717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:44.423717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:44.423717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:44.423717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:44.423717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:44.423717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:44.423717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:44.423717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:44.423717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:44.423717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:44.423717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:44.423717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:44.423717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:44.423717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:44.424903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:44.424903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:44.424903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:44.424903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:44.424903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:44.424903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:44.424903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:44.424903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:44.424903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:44.424903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:44.424903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:44.424903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:44.424903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:44.424903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:44.424903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:44.424903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:44.424903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:44.426036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:44.426036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:44.426036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:44.426036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:44.432588 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 364/748] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:44.433841 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47576b-ded2-4732-b80b-823ac5339d75 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:44.434928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 385/749] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 19 12:18:44 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:18:44.435974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb3637-04e3-4619-a294-7d36d9ef2126 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:44.478509 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:44.512262 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:44.566111 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47576b-ded2-4732-b80b-823ac5339d75 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:44.572587 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb3637-04e3-4619-a294-7d36d9ef2126 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:44.607488 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266f26c-9ff5-44f5-aa04-6ea923fc4e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:44.608665 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266f26c-9ff5-44f5-aa04-6ea923fc4e25 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:44.609137 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266f26c-9ff5-44f5-aa04-6ea923fc4e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:44.609595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266f26c-9ff5-44f5-aa04-6ea923fc4e25 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:44.613669 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7224f-1191-41c7-9825-9bc59caa0e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:44.614419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7224f-1191-41c7-9825-9bc59caa0e6b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:44.614706 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7224f-1191-41c7-9825-9bc59caa0e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:44.615011 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7224f-1191-41c7-9825-9bc59caa0e6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:44.615842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7224f-1191-41c7-9825-9bc59caa0e6b None admin] RBAC: Adding query filter params (role.id=386cb814e8464fda8832b13c75eabdaf, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=35cc2e1079d34745a279588028945c3c) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:44.616157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7224f-1191-41c7-9825-9bc59caa0e6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:44.617582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7224f-1191-41c7-9825-9bc59caa0e6b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:44.621688 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266f26c-9ff5-44f5-aa04-6ea923fc4e25 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:44.623691 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266f26c-9ff5-44f5-aa04-6ea923fc4e25 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:44.624258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 386/750] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:18:44 2022] GET /identity/v3/role_assignments?user.id=35cc2e1079d34745a279588028945c3c&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=386cb814e8464fda8832b13c75eabdaf => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:44.627591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7224f-1191-41c7-9825-9bc59caa0e6b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:44.643997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-3266f26c-9ff5-44f5-aa04-6ea923fc4e25 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 12:18:44.643997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:44.643997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:44.643997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:44.643997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:44.643997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:44.643997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:44.643997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:44.643997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:44.643997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:44.643997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:44.643997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:44.643997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:44.643997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:44.643997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:44.643997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:44.645191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:44.645191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:44.645191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:44.645191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:44.645191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:44.645191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:44.645191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:44.645191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:44.645191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:44.645191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:44.645191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:44.645191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:44.645191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:44.645191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:44.645191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:44.645191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:44.645191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:44.645191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:44.646267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:44.646267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:44.646267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:44.646267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:44.646267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:44.646267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:44.646267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:44.646267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:44.646267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 12:18:44.646267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:44.646267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 365/751] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Jul 19 12:18:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:44.655308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266f26c-9ff5-44f5-aa04-6ea923fc4e25 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:44.759353 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7224f-1191-41c7-9825-9bc59caa0e6b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:44.765900 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:44.773921 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266f26c-9ff5-44f5-aa04-6ea923fc4e25 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:44.786690 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:44.804424 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36ecb6-9e37-4914-bc43-998ed78acfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:44.805490 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36ecb6-9e37-4914-bc43-998ed78acfa7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:44.805923 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36ecb6-9e37-4914-bc43-998ed78acfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:44.806350 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36ecb6-9e37-4914-bc43-998ed78acfa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:44.807287 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36ecb6-9e37-4914-bc43-998ed78acfa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:44.807849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36ecb6-9e37-4914-bc43-998ed78acfa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:44.809545 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36ecb6-9e37-4914-bc43-998ed78acfa7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:44.817398 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd368cdf-0c43-46f9-b8e3-9d50c4a8defb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:44.818119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd368cdf-0c43-46f9-b8e3-9d50c4a8defb None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:44.818970 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd368cdf-0c43-46f9-b8e3-9d50c4a8defb None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:44.818970 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd368cdf-0c43-46f9-b8e3-9d50c4a8defb None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:44.819646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd368cdf-0c43-46f9-b8e3-9d50c4a8defb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:44.819957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd368cdf-0c43-46f9-b8e3-9d50c4a8defb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:44.821546 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd368cdf-0c43-46f9-b8e3-9d50c4a8defb None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:44.830864 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 387/752] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:44.846696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 366/753] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Jul 19 12:18:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:44.847792 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36ecb6-9e37-4914-bc43-998ed78acfa7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:44.854436 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd368cdf-0c43-46f9-b8e3-9d50c4a8defb None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:44.963974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36ecb6-9e37-4914-bc43-998ed78acfa7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:44.982810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd368cdf-0c43-46f9-b8e3-9d50c4a8defb None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:45.004043 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa141ac6-c28b-4726-86bf-64e05cac4053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:45.005144 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa141ac6-c28b-4726-86bf-64e05cac4053 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:45.005575 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa141ac6-c28b-4726-86bf-64e05cac4053 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:45.006031 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa141ac6-c28b-4726-86bf-64e05cac4053 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:45.014599 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa141ac6-c28b-4726-86bf-64e05cac4053 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:45.016469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa141ac6-c28b-4726-86bf-64e05cac4053 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:45.021816 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c23970-4b02-4901-87db-313a0c860307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:45.022630 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c23970-4b02-4901-87db-313a0c860307 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:45.022965 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c23970-4b02-4901-87db-313a0c860307 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:45.023241 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c23970-4b02-4901-87db-313a0c860307 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:45.034404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-aa141ac6-c28b-4726-86bf-64e05cac4053 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 12:18:45.034404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:45.034404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:45.034404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:45.034404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:45.034404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:45.034404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:45.034404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:45.034404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:45.034404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:45.034404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:45.034404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:45.034404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:45.034404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:45.034404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:45.034404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:45.035605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:45.035605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:45.035605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:45.035605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:45.035605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:45.035605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:45.035605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:45.035605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:45.035605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:45.035605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:45.035605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:45.035605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:45.035605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:45.035605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:45.035605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:45.035605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:45.035605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:45.035605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:45.036749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:45.036749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:45.036749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:45.036749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:45.036749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:45.036749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:45.036749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:45.036749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:45.036749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 12:18:45.036749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:45.037280 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c23970-4b02-4901-87db-313a0c860307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:45.037280 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c23970-4b02-4901-87db-313a0c860307 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:45.039255 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 388/754] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 19 12:18:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:45.045001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa141ac6-c28b-4726-86bf-64e05cac4053 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:45.055317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-d4c23970-4b02-4901-87db-313a0c860307 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:45.055317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:45.055317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:45.055317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:45.055317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:45.055317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:45.055317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:45.055317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:45.055317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:45.055317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:45.055317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:45.055317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:45.055317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:45.055317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:45.055317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:45.056410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:45.056410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:45.056410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:45.056410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:45.056410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:45.056410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:45.056410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:45.056410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:45.056410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:45.056410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:45.056410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:45.056410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:45.056410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:45.056410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:45.056410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:45.056410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:45.056410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:45.057535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:45.057535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:45.057535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:45.057535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:45.057535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 367/755] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:45.067818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c23970-4b02-4901-87db-313a0c860307 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:45.071827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:45.117468 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:45.218820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa141ac6-c28b-4726-86bf-64e05cac4053 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:45.222988 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c23970-4b02-4901-87db-313a0c860307 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:45.260161 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9986824-2a6a-4942-baa5-cb3d22084fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:45.261073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9986824-2a6a-4942-baa5-cb3d22084fdf None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:45.261614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9986824-2a6a-4942-baa5-cb3d22084fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:45.262040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9986824-2a6a-4942-baa5-cb3d22084fdf None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:45.262954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9986824-2a6a-4942-baa5-cb3d22084fdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:45.263410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9986824-2a6a-4942-baa5-cb3d22084fdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:45.265189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9986824-2a6a-4942-baa5-cb3d22084fdf None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:45.265470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd75bc-6ab3-4810-9084-bb7b58ed9cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:45.266150 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd75bc-6ab3-4810-9084-bb7b58ed9cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:45.266491 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd75bc-6ab3-4810-9084-bb7b58ed9cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:45.267305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd75bc-6ab3-4810-9084-bb7b58ed9cb0 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:45.268494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd75bc-6ab3-4810-9084-bb7b58ed9cb0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:45.268804 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd75bc-6ab3-4810-9084-bb7b58ed9cb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:45.270834 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd75bc-6ab3-4810-9084-bb7b58ed9cb0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:45.279979 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 368/756] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:45.285966 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303afc8-80c5-4687-ada7-fe16ba906196 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:45.286475 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303afc8-80c5-4687-ada7-fe16ba906196 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:45.287017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303afc8-80c5-4687-ada7-fe16ba906196 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:45.288787 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 369/757] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:45.289683 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303afc8-80c5-4687-ada7-fe16ba906196 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:45.303008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 389/758] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Jul 19 12:18:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:45.303008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cc7ac-f4fc-4d69-ba0d-3d52d0674afe None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:45.303008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cc7ac-f4fc-4d69-ba0d-3d52d0674afe None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:45.303008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cc7ac-f4fc-4d69-ba0d-3d52d0674afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:45.321080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-962cc7ac-f4fc-4d69-ba0d-3d52d0674afe None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:45.322904 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-962cc7ac-f4fc-4d69-ba0d-3d52d0674afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:45.368468 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:45.414835 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 390/759] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:18:45.416048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cc7ac-f4fc-4d69-ba0d-3d52d0674afe None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:45.419088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303afc8-80c5-4687-ada7-fe16ba906196 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:45.461594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12378b41-e14c-471e-a152-076252019488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:45.462406 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12378b41-e14c-471e-a152-076252019488 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:45.462691 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12378b41-e14c-471e-a152-076252019488 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:45.462996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12378b41-e14c-471e-a152-076252019488 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:45.464880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:45.471593 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12378b41-e14c-471e-a152-076252019488 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:45.472999 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12378b41-e14c-471e-a152-076252019488 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:45.489425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-12378b41-e14c-471e-a152-076252019488 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:45.489425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:45.489425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:45.489425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:45.489425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:45.489425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:45.489425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:45.489425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:45.489425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:45.489425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:45.489425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:45.489425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:45.489425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:45.489425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:45.489425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:45.490363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:45.490363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:45.490363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:45.490363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:45.490363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:45.490363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:45.490363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:45.490363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:45.490363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:45.490363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:45.490363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:45.490363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:45.490363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:45.490363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:45.490363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:45.490363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:45.490363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:45.491727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:45.491727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:45.491727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:45.491727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:45.491727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:45.491727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:45.491727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:45.491727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:45.491727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 370/760] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:45.492220 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12378b41-e14c-471e-a152-076252019488 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:45.550688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cc7ac-f4fc-4d69-ba0d-3d52d0674afe None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:45.590782 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49028409-0f70-4366-a647-806873d4b418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:45.591888 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49028409-0f70-4366-a647-806873d4b418 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:45.592471 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49028409-0f70-4366-a647-806873d4b418 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:45.592963 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49028409-0f70-4366-a647-806873d4b418 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:45.602058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12378b41-e14c-471e-a152-076252019488 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:45.626186 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:45.639113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df41d4-bf38-4585-af53-667d9a12082a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:45.640038 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df41d4-bf38-4585-af53-667d9a12082a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:45.640327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df41d4-bf38-4585-af53-667d9a12082a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:45.640602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df41d4-bf38-4585-af53-667d9a12082a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:45.641267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df41d4-bf38-4585-af53-667d9a12082a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:45.643308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df41d4-bf38-4585-af53-667d9a12082a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:45.656059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-39df41d4-bf38-4585-af53-667d9a12082a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 12:18:45.656059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:45.656059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:18:45.656059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:18:45.656059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:18:45.656059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:18:45.656059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:18:45.656059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:45.656059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 12:18:45.656059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:45.656059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:18:45.656059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:45.656059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:45.656059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:45.656059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:45.656059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:45.656987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:45.656987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:45.656987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:45.656987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:45.656987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:45.656987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:45.656987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:45.656987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:18:45.656987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:18:45.656987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:18:45.656987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:18:45.656987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:45.656987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:45.656987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:45.656987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:45.656987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:45.663758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:45.663758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:45.663758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:45.663758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:45.663758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:45.663758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:45.663758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:45.663758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:45.663758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:45.663758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:45.663758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:45.663758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:18:45.663758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:45.663758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 12:18:45.663758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:45.663758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 371/761] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Jul 19 12:18:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:45.664562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df41d4-bf38-4585-af53-667d9a12082a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:45.681284 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49028409-0f70-4366-a647-806873d4b418 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:45.683107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49028409-0f70-4366-a647-806873d4b418 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:45.713430 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:45.790205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df41d4-bf38-4585-af53-667d9a12082a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:45.802556 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 391/762] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 12:18:45.804072 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49028409-0f70-4366-a647-806873d4b418 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:45.836477 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc114f-2987-4b84-b428-90dce4133930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:45.837601 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc114f-2987-4b84-b428-90dce4133930 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:45.837986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc114f-2987-4b84-b428-90dce4133930 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:45.838356 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc114f-2987-4b84-b428-90dce4133930 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:45.839611 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc114f-2987-4b84-b428-90dce4133930 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:45.840080 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc114f-2987-4b84-b428-90dce4133930 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:45.842581 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc114f-2987-4b84-b428-90dce4133930 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:45.866566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 372/763] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:45.866566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc114f-2987-4b84-b428-90dce4133930 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:45.925429 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:45.939538 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49028409-0f70-4366-a647-806873d4b418 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:45.977660 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:45.983220 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc114f-2987-4b84-b428-90dce4133930 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:45.992767 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f35ea7-789c-412d-b6b7-d76cd4b683f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:45.993432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f35ea7-789c-412d-b6b7-d76cd4b683f9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:45.993707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f35ea7-789c-412d-b6b7-d76cd4b683f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:45.993982 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f35ea7-789c-412d-b6b7-d76cd4b683f9 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:45.994680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f35ea7-789c-412d-b6b7-d76cd4b683f9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:45.995031 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f35ea7-789c-412d-b6b7-d76cd4b683f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:45.997220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f35ea7-789c-412d-b6b7-d76cd4b683f9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:46.006814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 392/764] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Jul 19 12:18:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:46.007853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f35ea7-789c-412d-b6b7-d76cd4b683f9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:46.027944 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c0dfe-e47f-40c8-b8be-8261ce145519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:46.029178 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c0dfe-e47f-40c8-b8be-8261ce145519 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:46.029675 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c0dfe-e47f-40c8-b8be-8261ce145519 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:46.030205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c0dfe-e47f-40c8-b8be-8261ce145519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:46.041689 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c0dfe-e47f-40c8-b8be-8261ce145519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:46.043574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c0dfe-e47f-40c8-b8be-8261ce145519 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:46.063279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-f11c0dfe-e47f-40c8-b8be-8261ce145519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:46.063279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:46.063279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:46.063279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:46.063279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:46.063279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:46.063279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:46.063279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:46.063279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:46.063279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:46.063279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:46.063279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:46.063279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:46.063279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:46.063279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:46.064871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:46.064871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:46.064871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:46.064871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:46.064871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:46.064871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:46.064871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:46.064871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:46.064871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:46.064871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:46.064871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:46.064871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:46.064871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:46.064871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:46.064871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:46.064871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:46.064871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:46.065734 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:46.065734 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:46.065734 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:46.065734 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:46.072470 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 373/765] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:46.072470 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c0dfe-e47f-40c8-b8be-8261ce145519 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:46.127916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f35ea7-789c-412d-b6b7-d76cd4b683f9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:46.167868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a350541-3090-48ae-9cb5-72b97e8046f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:46.169286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a350541-3090-48ae-9cb5-72b97e8046f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:46.170150 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a350541-3090-48ae-9cb5-72b97e8046f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:46.170799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a350541-3090-48ae-9cb5-72b97e8046f5 None admin] PATH_INFO: `/v3/projects/1ba395a1e22f430084089947e47a622d/users/5d9543657e1e4a6d85632bf57f6ba6eb/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:46.173919 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a350541-3090-48ae-9cb5-72b97e8046f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba395a1e22f430084089947e47a622d, user_id=5d9543657e1e4a6d85632bf57f6ba6eb, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:46.175615 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a350541-3090-48ae-9cb5-72b97e8046f5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:46.187652 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:46.191999 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c0dfe-e47f-40c8-b8be-8261ce145519 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:46.198710 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 393/766] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:18:46 2022] PUT /identity/v3/projects/1ba395a1e22f430084089947e47a622d/users/5d9543657e1e4a6d85632bf57f6ba6eb/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:18:46.198710 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a350541-3090-48ae-9cb5-72b97e8046f5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:46.270557 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677378ac-37f7-472a-b033-b0888288edc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:46.271266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677378ac-37f7-472a-b033-b0888288edc6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:46.271545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677378ac-37f7-472a-b033-b0888288edc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:46.271814 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677378ac-37f7-472a-b033-b0888288edc6 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:46.272529 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677378ac-37f7-472a-b033-b0888288edc6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:46.272829 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677378ac-37f7-472a-b033-b0888288edc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:46.274196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677378ac-37f7-472a-b033-b0888288edc6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:46.295926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 374/767] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Jul 19 12:18:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:46.301281 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677378ac-37f7-472a-b033-b0888288edc6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:46.315691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:46.374169 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a350541-3090-48ae-9cb5-72b97e8046f5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:46.422193 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf707d0-0e28-48d3-92de-668191af3469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:46.423597 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf707d0-0e28-48d3-92de-668191af3469 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:46.425584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf707d0-0e28-48d3-92de-668191af3469 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:46.426106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf707d0-0e28-48d3-92de-668191af3469 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:46.427939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf707d0-0e28-48d3-92de-668191af3469 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:46.429191 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf707d0-0e28-48d3-92de-668191af3469 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:46.430868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf707d0-0e28-48d3-92de-668191af3469 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:46.454894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 394/768] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:46.458963 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf707d0-0e28-48d3-92de-668191af3469 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:46.502335 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677378ac-37f7-472a-b033-b0888288edc6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:46.567530 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230bb89-5090-4aed-825e-894aec19a154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:46.568565 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230bb89-5090-4aed-825e-894aec19a154 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:46.569163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230bb89-5090-4aed-825e-894aec19a154 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:46.570851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230bb89-5090-4aed-825e-894aec19a154 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:46.571801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230bb89-5090-4aed-825e-894aec19a154 None admin] RBAC: Adding query filter params (interface=public, service_id=b4193b910daf48f5ada98ae73017a0bd, region_id=RegionOne) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:46.573008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230bb89-5090-4aed-825e-894aec19a154 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:46.574585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230bb89-5090-4aed-825e-894aec19a154 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:46.591848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 375/769] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Jul 19 12:18:46 2022] GET /identity/v3/endpoints?service_id=b4193b910daf48f5ada98ae73017a0bd&interface=public®ion_id=RegionOne => generated 194 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:46.599076 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230bb89-5090-4aed-825e-894aec19a154 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:46.633401 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf707d0-0e28-48d3-92de-668191af3469 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:46.655935 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:46.661968 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:46.696480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3cf99-cdef-4bea-81a6-4f7dc38792ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:46.697651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3cf99-cdef-4bea-81a6-4f7dc38792ad None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:46.698164 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3cf99-cdef-4bea-81a6-4f7dc38792ad None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:46.698640 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3cf99-cdef-4bea-81a6-4f7dc38792ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:46.708098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3cf99-cdef-4bea-81a6-4f7dc38792ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:46.710353 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3cf99-cdef-4bea-81a6-4f7dc38792ad None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:46.728384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-63f3cf99-cdef-4bea-81a6-4f7dc38792ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:46.728384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:46.728384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:46.728384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:46.728384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:46.728384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:46.728384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:46.728384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:46.728384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:46.728384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:46.728384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:46.728384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:46.728384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:46.728384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:46.728384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:46.729323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:46.729323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:46.729323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:46.729323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:46.729323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:46.729323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:46.729323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:46.729323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:46.729323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:46.729323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:46.729323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:46.729323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:46.729323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:46.729323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:46.729323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:46.729323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:46.729323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:46.730239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:46.730239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:46.730239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:46.730239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:46.730239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:46.730239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:46.730239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:46.730239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:46.733056 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 395/770] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:46.741469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3cf99-cdef-4bea-81a6-4f7dc38792ad None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:46.806758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230bb89-5090-4aed-825e-894aec19a154 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:46.843579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92505d2-d90f-4873-82e1-19abc6ceee36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:46.844176 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92505d2-d90f-4873-82e1-19abc6ceee36 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:46.844458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92505d2-d90f-4873-82e1-19abc6ceee36 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:46.844731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92505d2-d90f-4873-82e1-19abc6ceee36 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:46.845774 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92505d2-d90f-4873-82e1-19abc6ceee36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:46.847212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92505d2-d90f-4873-82e1-19abc6ceee36 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:46.852715 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 376/771] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Jul 19 12:18:46 2022] GET /identity/v3/services => generated 772 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:46.853967 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a33612-d04a-4d71-b14a-2cef4dd52e01 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:46.854253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a33612-d04a-4d71-b14a-2cef4dd52e01 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:46.854531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a33612-d04a-4d71-b14a-2cef4dd52e01 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:46.866810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 377/772] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:46.866810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18304cbd-6a14-4ed3-ae74-a04579a8e5ec None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:46.866810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18304cbd-6a14-4ed3-ae74-a04579a8e5ec None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:46.866810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18304cbd-6a14-4ed3-ae74-a04579a8e5ec None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:46.867178 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 378/773] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:46 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:46.869453 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941e096-ea4a-4f9b-864b-fdb940cb72ae None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:46.869963 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941e096-ea4a-4f9b-864b-fdb940cb72ae None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:46.870462 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941e096-ea4a-4f9b-864b-fdb940cb72ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:46.885109 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3cf99-cdef-4bea-81a6-4f7dc38792ad None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:46.894771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9941e096-ea4a-4f9b-864b-fdb940cb72ae None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:46.896019 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9941e096-ea4a-4f9b-864b-fdb940cb72ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:46.934457 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42889ca6-f20c-4cc0-a9eb-8b8bfb67f0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:46.935696 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42889ca6-f20c-4cc0-a9eb-8b8bfb67f0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:46.935975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42889ca6-f20c-4cc0-a9eb-8b8bfb67f0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:46.936246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42889ca6-f20c-4cc0-a9eb-8b8bfb67f0b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:46.937055 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42889ca6-f20c-4cc0-a9eb-8b8bfb67f0b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:46.937361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42889ca6-f20c-4cc0-a9eb-8b8bfb67f0b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:46.939962 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42889ca6-f20c-4cc0-a9eb-8b8bfb67f0b9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:46.955481 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 396/774] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:46.956907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99265dd6-c771-48ad-89dd-4c68bd1acb59 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:46.957194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99265dd6-c771-48ad-89dd-4c68bd1acb59 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:46.957476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99265dd6-c771-48ad-89dd-4c68bd1acb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:46.975880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-99265dd6-c771-48ad-89dd-4c68bd1acb59 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:46.978206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-99265dd6-c771-48ad-89dd-4c68bd1acb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:46.986761 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 379/775] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:18:46.986761 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941e096-ea4a-4f9b-864b-fdb940cb72ae None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:47.034208 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:47.040004 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:47.099021 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 397/776] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:18:47.101014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99265dd6-c771-48ad-89dd-4c68bd1acb59 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:47.142345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941e096-ea4a-4f9b-864b-fdb940cb72ae None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:47.194828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac304d1-89ff-412d-93a1-c4a978b321d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:47.195507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac304d1-89ff-412d-93a1-c4a978b321d1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:47.196448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac304d1-89ff-412d-93a1-c4a978b321d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:47.196733 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac304d1-89ff-412d-93a1-c4a978b321d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:47.197872 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac304d1-89ff-412d-93a1-c4a978b321d1 None admin] RBAC: Adding query filter params (role.id=42cae330d9ab456c8212ca146daf9322, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=18030043de1942779baf3ad94aec4071) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:47.198896 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac304d1-89ff-412d-93a1-c4a978b321d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:47.201545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac304d1-89ff-412d-93a1-c4a978b321d1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:47.208826 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 380/777] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:18:46 2022] GET /identity/v3/role_assignments?user.id=18030043de1942779baf3ad94aec4071&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=42cae330d9ab456c8212ca146daf9322 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:47.210888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac304d1-89ff-412d-93a1-c4a978b321d1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:47.271270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99265dd6-c771-48ad-89dd-4c68bd1acb59 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:47.317553 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c583a4-11c5-4298-8f04-c4e7ba393c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:47.318386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c583a4-11c5-4298-8f04-c4e7ba393c2c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:47.318664 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c583a4-11c5-4298-8f04-c4e7ba393c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:47.318979 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c583a4-11c5-4298-8f04-c4e7ba393c2c None admin] PATH_INFO: `/v3/services/network` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:47.319655 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c583a4-11c5-4298-8f04-c4e7ba393c2c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:47.321086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c583a4-11c5-4298-8f04-c4e7ba393c2c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:47.336829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-76c583a4-11c5-4298-8f04-c4e7ba393c2c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 12:18:47.336829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:47.336829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:18:47.336829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:18:47.336829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:18:47.336829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:18:47.336829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:18:47.336829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:47.336829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 12:18:47.336829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:47.336829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:18:47.336829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:47.336829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:47.336829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:47.336829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:47.336829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:47.336829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:47.337871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:47.337871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:47.337871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:47.337871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:47.337871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:47.337871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:47.337871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:18:47.337871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:18:47.337871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:18:47.337871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:18:47.337871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:47.337871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:47.337871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:47.337871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:47.337871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:47.337871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:47.339586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:47.339586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:47.339586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:47.339586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:47.339586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:47.339586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:47.339586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:47.339586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:47.339586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:47.339586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:47.339586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:18:47.339586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:47.339586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 12:18:47.339586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:47.339586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 398/778] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:47 2022] GET /identity/v3/services/network => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:47.349989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c583a4-11c5-4298-8f04-c4e7ba393c2c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:47.417227 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:47.438221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:47.457252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac304d1-89ff-412d-93a1-c4a978b321d1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:47.505885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88b6b1-ce78-4770-83db-8f85edfa7a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:47.506696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88b6b1-ce78-4770-83db-8f85edfa7a65 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:47.515253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88b6b1-ce78-4770-83db-8f85edfa7a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:47.516147 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88b6b1-ce78-4770-83db-8f85edfa7a65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:47.527453 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88b6b1-ce78-4770-83db-8f85edfa7a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:47.531058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c583a4-11c5-4298-8f04-c4e7ba393c2c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:47.535687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-1f88b6b1-ce78-4770-83db-8f85edfa7a65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:18:47.535687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:47.535687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:47.535687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:47.535687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:47.535687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:47.535687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:47.535687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:47.535687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:47.535687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:47.535687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:47.535687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:47.535687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:47.535687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:47.535687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:47.535687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:47.537602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:47.537602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:47.537602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:47.537602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:47.537602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:47.537602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:47.537602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:47.537602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:47.537602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:47.537602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:47.537602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:47.537602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:47.537602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:47.537602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:47.537602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:47.537602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:47.538716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:47.538716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:47.538716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:47.538716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:47.538716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:47.538716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:47.538716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:47.538716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:47.538716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:47.538716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:47.538716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:18:47.538716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:47.538716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 381/779] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:18:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:47.547242 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88b6b1-ce78-4770-83db-8f85edfa7a65 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:47.593095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25799023-589e-4a3b-a8ec-e32891204c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:47.595698 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25799023-589e-4a3b-a8ec-e32891204c3c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:47.595978 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25799023-589e-4a3b-a8ec-e32891204c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:47.596245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25799023-589e-4a3b-a8ec-e32891204c3c None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:47.596970 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25799023-589e-4a3b-a8ec-e32891204c3c None admin] RBAC: Adding query filter params (name=network) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:47.597274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25799023-589e-4a3b-a8ec-e32891204c3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:47.598658 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25799023-589e-4a3b-a8ec-e32891204c3c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:47.612335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 399/780] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 19 12:18:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:47.619663 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25799023-589e-4a3b-a8ec-e32891204c3c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:47.809382 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88b6b1-ce78-4770-83db-8f85edfa7a65 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:47.814055 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:47.825573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25799023-589e-4a3b-a8ec-e32891204c3c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:47.870595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6848451-2763-45ae-94e0-c0f81305cfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:47.871218 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6848451-2763-45ae-94e0-c0f81305cfb5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:47.871500 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6848451-2763-45ae-94e0-c0f81305cfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:47.871780 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6848451-2763-45ae-94e0-c0f81305cfb5 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:47.872488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6848451-2763-45ae-94e0-c0f81305cfb5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:47.872798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6848451-2763-45ae-94e0-c0f81305cfb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:47.874266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6848451-2763-45ae-94e0-c0f81305cfb5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:47.881177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 400/781] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 19 12:18:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:47.891185 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6848451-2763-45ae-94e0-c0f81305cfb5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:47.907606 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c82b6-bfe2-4293-8f34-ebf9ac1c342c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:47.908545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c82b6-bfe2-4293-8f34-ebf9ac1c342c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:47.908987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c82b6-bfe2-4293-8f34-ebf9ac1c342c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:47.909450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c82b6-bfe2-4293-8f34-ebf9ac1c342c None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:47.910393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c82b6-bfe2-4293-8f34-ebf9ac1c342c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:47.910937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c82b6-bfe2-4293-8f34-ebf9ac1c342c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:47.912524 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c82b6-bfe2-4293-8f34-ebf9ac1c342c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:47.941528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 382/782] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:47.951710 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c82b6-bfe2-4293-8f34-ebf9ac1c342c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:47.972813 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:48.001904 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6848451-2763-45ae-94e0-c0f81305cfb5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:48.037701 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfed15-d43b-4261-a3cd-cbc9dede6d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:48.038370 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfed15-d43b-4261-a3cd-cbc9dede6d81 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:48.038651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfed15-d43b-4261-a3cd-cbc9dede6d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:48.039002 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfed15-d43b-4261-a3cd-cbc9dede6d81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:48.039797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfed15-d43b-4261-a3cd-cbc9dede6d81 None admin] RBAC: Adding query filter params (interface=public, service_id=c5e029d8ee4b457e83bcca2184727918, region_id=RegionOne) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:48.040107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfed15-d43b-4261-a3cd-cbc9dede6d81 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:48.041594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfed15-d43b-4261-a3cd-cbc9dede6d81 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:48.049853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 401/783] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Jul 19 12:18:47 2022] GET /identity/v3/endpoints?service_id=c5e029d8ee4b457e83bcca2184727918&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:48.058246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfed15-d43b-4261-a3cd-cbc9dede6d81 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:48.089032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:48.168129 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfed15-d43b-4261-a3cd-cbc9dede6d81 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:48.209017 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f143c-1e72-432d-b535-dd2bb5671be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:48.209818 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f143c-1e72-432d-b535-dd2bb5671be5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:48.210107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f143c-1e72-432d-b535-dd2bb5671be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:48.210383 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f143c-1e72-432d-b535-dd2bb5671be5 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:48.211093 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f143c-1e72-432d-b535-dd2bb5671be5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:48.212735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f143c-1e72-432d-b535-dd2bb5671be5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:48.219187 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 402/784] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Jul 19 12:18:48 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:48.255728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c82b6-bfe2-4293-8f34-ebf9ac1c342c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:48.313656 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c16166-ec33-4d07-a645-8938bea31303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:48.314907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c16166-ec33-4d07-a645-8938bea31303 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:48.315343 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c16166-ec33-4d07-a645-8938bea31303 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:48.315764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c16166-ec33-4d07-a645-8938bea31303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:48.335799 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c16166-ec33-4d07-a645-8938bea31303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:48.337535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c16166-ec33-4d07-a645-8938bea31303 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:48.363579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-44c16166-ec33-4d07-a645-8938bea31303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:48.363579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:48.363579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:48.363579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:48.363579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:48.363579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:48.363579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:48.363579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:48.363579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:48.363579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:48.363579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:48.363579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:48.363579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:48.363579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:48.363579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:48.364736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:48.364736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:48.364736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:48.364736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:48.364736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:48.364736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:48.364736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:48.364736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:48.364736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:48.364736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:48.364736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:48.364736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:48.364736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:48.364736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:48.364736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:48.364736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:48.364736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:48.365862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:48.365862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:48.365862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:48.365862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:48.370864 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 383/785] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:48.375853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f143c-1e72-432d-b535-dd2bb5671be5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:48.493631 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:48.512618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f143c-1e72-432d-b535-dd2bb5671be5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:48.555671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75562dff-994f-4b2f-9c0e-953be4228113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:48.556365 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75562dff-994f-4b2f-9c0e-953be4228113 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:48.556646 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75562dff-994f-4b2f-9c0e-953be4228113 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:48.556919 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75562dff-994f-4b2f-9c0e-953be4228113 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:48.557646 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75562dff-994f-4b2f-9c0e-953be4228113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:48.557948 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75562dff-994f-4b2f-9c0e-953be4228113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:48.559444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75562dff-994f-4b2f-9c0e-953be4228113 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:48.573714 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 403/786] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:48.580237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c16166-ec33-4d07-a645-8938bea31303 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:48.651373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:48.720270 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c16166-ec33-4d07-a645-8938bea31303 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:48.768005 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdc6cc-015a-432d-a58a-70b59f1491f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:48.768739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdc6cc-015a-432d-a58a-70b59f1491f0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:48.769025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdc6cc-015a-432d-a58a-70b59f1491f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:48.769303 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdc6cc-015a-432d-a58a-70b59f1491f0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:48.783880 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdc6cc-015a-432d-a58a-70b59f1491f0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:48.785336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdc6cc-015a-432d-a58a-70b59f1491f0 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:48.803924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-d0cdc6cc-015a-432d-a58a-70b59f1491f0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 12:18:48.803924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:48.803924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:48.803924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:48.803924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:48.803924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:48.803924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:48.803924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:48.803924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:48.803924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:48.803924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:48.803924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:48.803924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:48.803924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:48.803924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:48.803924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:48.804889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:48.804889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:48.804889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:48.804889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:48.804889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:48.804889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:48.804889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:48.804889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:48.804889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:48.804889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:48.804889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:48.804889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:48.804889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:48.804889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:48.804889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:48.804889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:48.804889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:48.804889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:48.805818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:48.805818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:48.805818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:48.805818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:48.805818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:48.805818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:48.805818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:48.805818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:48.805818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 12:18:48.805818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:48.805818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 384/787] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:18:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:48.811297 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75562dff-994f-4b2f-9c0e-953be4228113 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:48.983078 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75562dff-994f-4b2f-9c0e-953be4228113 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:49.022466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90574edd-5df0-426f-84cc-3aacccdd1f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:49.023172 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90574edd-5df0-426f-84cc-3aacccdd1f22 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:49.023503 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90574edd-5df0-426f-84cc-3aacccdd1f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:49.023779 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90574edd-5df0-426f-84cc-3aacccdd1f22 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:49.024629 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90574edd-5df0-426f-84cc-3aacccdd1f22 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:49.024936 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90574edd-5df0-426f-84cc-3aacccdd1f22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:49.026366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90574edd-5df0-426f-84cc-3aacccdd1f22 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:49.049868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:49.058912 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 404/788] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Jul 19 12:18:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:49.064655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdc6cc-015a-432d-a58a-70b59f1491f0 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:49.087328 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1fc10-3428-4749-8ec4-f07260892034 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:49.087643 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1fc10-3428-4749-8ec4-f07260892034 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:49.087884 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1fc10-3428-4749-8ec4-f07260892034 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:49.089257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 405/789] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:18:49.094277 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5b03f-d0ff-42cc-af6c-fa27a5e59e92 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:49.094563 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5b03f-d0ff-42cc-af6c-fa27a5e59e92 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:49.094962 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5b03f-d0ff-42cc-af6c-fa27a5e59e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:49.116131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b4f5b03f-d0ff-42cc-af6c-fa27a5e59e92 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:49.118141 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b4f5b03f-d0ff-42cc-af6c-fa27a5e59e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:49.197679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 406/790] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:18:49.233462 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5b03f-d0ff-42cc-af6c-fa27a5e59e92 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:49.238182 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdc6cc-015a-432d-a58a-70b59f1491f0 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:49.259725 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:49.284977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c55bb-4a21-4ee1-aacd-4fdc4e023bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:49.286133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c55bb-4a21-4ee1-aacd-4fdc4e023bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:49.286620 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c55bb-4a21-4ee1-aacd-4fdc4e023bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:49.287225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c55bb-4a21-4ee1-aacd-4fdc4e023bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:49.304595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c55bb-4a21-4ee1-aacd-4fdc4e023bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:49.307029 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c55bb-4a21-4ee1-aacd-4fdc4e023bd9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:49.337235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-953c55bb-4a21-4ee1-aacd-4fdc4e023bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:49.337235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:49.337235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:49.337235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:49.337235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:49.337235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:49.337235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:49.337235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:49.337235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:49.337235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:49.337235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:49.337235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:49.337235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:49.337235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:49.337235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:49.338171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:49.338171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:49.338171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:49.338171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:49.338171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:49.338171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:49.338171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:49.338171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:49.338171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:49.338171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:49.338171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:49.338171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:49.338171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:49.338171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:49.338171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:49.338171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:49.338171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:49.339452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:49.339452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:49.339452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:49.339452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:49.343427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 385/791] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:49.344897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3136c26-4509-41af-bd7e-1302a2f44733 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:49.345825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3136c26-4509-41af-bd7e-1302a2f44733 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:49.346208 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3136c26-4509-41af-bd7e-1302a2f44733 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:49.347996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 386/792] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:49.353202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3136c26-4509-41af-bd7e-1302a2f44733 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:49.399109 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5b03f-d0ff-42cc-af6c-fa27a5e59e92 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:49.430442 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:49.437658 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9851086-c0b4-4ebd-a25e-1761e7dfaac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:49.438400 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9851086-c0b4-4ebd-a25e-1761e7dfaac5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:49.439283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9851086-c0b4-4ebd-a25e-1761e7dfaac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:49.439558 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9851086-c0b4-4ebd-a25e-1761e7dfaac5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:49.451033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9851086-c0b4-4ebd-a25e-1761e7dfaac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:49.460048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-e9851086-c0b4-4ebd-a25e-1761e7dfaac5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:18:49.460048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:49.460048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:49.460048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:49.460048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:49.460048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:49.460048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:49.460048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:49.460048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:49.460048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:49.460048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:49.460048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:49.460048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:49.460048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:49.460048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:49.460048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:49.460959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:49.460959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:49.460959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:49.460959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:49.460959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:49.460959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:49.460959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:49.460959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:49.460959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:49.460959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:49.460959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:49.460959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:49.460959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:49.460959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:49.460959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:49.460959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:49.461814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:49.461814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:49.461814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:49.461814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:49.461814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:49.461814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:49.461814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:49.461814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:49.461814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:49.461814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:49.461814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:18:49.461814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:49.461814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 407/793] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:18:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:49.463023 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909234e0-7a9b-48e5-b565-0bcef0ce25ae None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:49.463376 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909234e0-7a9b-48e5-b565-0bcef0ce25ae None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:49.463663 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909234e0-7a9b-48e5-b565-0bcef0ce25ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:49.470882 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3136c26-4509-41af-bd7e-1302a2f44733 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:49.481385 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-909234e0-7a9b-48e5-b565-0bcef0ce25ae None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:49.482561 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-909234e0-7a9b-48e5-b565-0bcef0ce25ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:49.507678 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b0e2c-6914-4179-9618-d892c2a29c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:49.508747 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b0e2c-6914-4179-9618-d892c2a29c40 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:49.509255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b0e2c-6914-4179-9618-d892c2a29c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:49.509729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b0e2c-6914-4179-9618-d892c2a29c40 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:49.510875 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b0e2c-6914-4179-9618-d892c2a29c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:49.511381 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b0e2c-6914-4179-9618-d892c2a29c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:49.513044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b0e2c-6914-4179-9618-d892c2a29c40 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:49.529228 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 387/794] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:49.530649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b0e2c-6914-4179-9618-d892c2a29c40 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:49.555061 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 408/795] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:18:49.555722 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909234e0-7a9b-48e5-b565-0bcef0ce25ae None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:49.571026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:49.659583 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b0e2c-6914-4179-9618-d892c2a29c40 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:49.669826 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909234e0-7a9b-48e5-b565-0bcef0ce25ae None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:49.701509 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:49.710709 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f18fd9-b382-4ab2-b640-8ff35d9d0f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:49.710890 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e834b8-d259-4a22-b354-31ced5b10e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:49.711556 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f18fd9-b382-4ab2-b640-8ff35d9d0f32 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:49.711669 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e834b8-d259-4a22-b354-31ced5b10e7a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:49.711839 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e834b8-d259-4a22-b354-31ced5b10e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:49.711934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f18fd9-b382-4ab2-b640-8ff35d9d0f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:49.712111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f18fd9-b382-4ab2-b640-8ff35d9d0f32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:49.712215 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e834b8-d259-4a22-b354-31ced5b10e7a None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:49.712947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e834b8-d259-4a22-b354-31ced5b10e7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:49.713260 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e834b8-d259-4a22-b354-31ced5b10e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:49.715154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e834b8-d259-4a22-b354-31ced5b10e7a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:49.719224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f18fd9-b382-4ab2-b640-8ff35d9d0f32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:49.721442 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f18fd9-b382-4ab2-b640-8ff35d9d0f32 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:49.729982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 388/796] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:49.729982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e834b8-d259-4a22-b354-31ced5b10e7a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:49.736821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-c8f18fd9-b382-4ab2-b640-8ff35d9d0f32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:49.736821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:49.736821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:49.736821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:49.736821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:49.736821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:49.736821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:49.736821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:49.736821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:49.736821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:49.736821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:49.736821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:49.736821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:49.736821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:49.736821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:49.737770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:49.737770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:49.737770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:49.737770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:49.737770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:49.737770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:49.737770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:49.737770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:49.737770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:49.737770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:49.737770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:49.737770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:49.737770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:49.737770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:49.737770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:49.737770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:49.737770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:49.738679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:49.738679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:49.738679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:49.738679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:49.738679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:49.738679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:49.738679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:49.738679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:49.738679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 409/797] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:49.739799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ea9dd-c81e-4cb4-a61d-720627abd536 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:49.740010 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ea9dd-c81e-4cb4-a61d-720627abd536 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:49.740252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ea9dd-c81e-4cb4-a61d-720627abd536 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:49.741755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 410/798] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:49.742694 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ea9dd-c81e-4cb4-a61d-720627abd536 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:49.834947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:49.843732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e834b8-d259-4a22-b354-31ced5b10e7a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:49.849226 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ea9dd-c81e-4cb4-a61d-720627abd536 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:49.878823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8af35-7674-4048-92d9-fadbd79d4fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:49.879628 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8af35-7674-4048-92d9-fadbd79d4fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:49.879912 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8af35-7674-4048-92d9-fadbd79d4fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:49.880188 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8af35-7674-4048-92d9-fadbd79d4fc6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:49.880834 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8af35-7674-4048-92d9-fadbd79d4fc6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:49.882203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8af35-7674-4048-92d9-fadbd79d4fc6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:49.885800 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d871fb-213a-4472-bf6f-fdafda392660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:49.886819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d871fb-213a-4472-bf6f-fdafda392660 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:49.887279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d871fb-213a-4472-bf6f-fdafda392660 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:49.887748 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d871fb-213a-4472-bf6f-fdafda392660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:49.895254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-36f8af35-7674-4048-92d9-fadbd79d4fc6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 12:18:49.895254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:49.895254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:18:49.895254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:18:49.895254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:18:49.895254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:18:49.895254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:18:49.895254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:49.895254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 12:18:49.895254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:49.895254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:18:49.895254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:49.895254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:49.895254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:49.895254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:49.895254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:49.896160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:49.896160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:49.896160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:49.896160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:49.896160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:49.896160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:49.896160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:49.896160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:18:49.896160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:18:49.896160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:18:49.896160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:18:49.896160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:49.896160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:49.896160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:49.896160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:49.896160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:49.896971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:49.896971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:49.896971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:49.896971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:49.896971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:49.896971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:49.896971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:49.896971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:49.896971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:49.896971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:49.896971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:49.896971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:18:49.896971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:49.896971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 12:18:49.896971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:49.896971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 389/799] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Jul 19 12:18:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:49.897791 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8af35-7674-4048-92d9-fadbd79d4fc6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:49.906707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d871fb-213a-4472-bf6f-fdafda392660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:49.908507 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d871fb-213a-4472-bf6f-fdafda392660 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:49.931066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-34d871fb-213a-4472-bf6f-fdafda392660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:49.931066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:49.931066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:49.931066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:49.931066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:49.931066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:49.931066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:49.931066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:49.931066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:49.931066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:49.931066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:49.931066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:49.931066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:49.931066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:49.931066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:49.932025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:49.932025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:49.932025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:49.932025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:49.932025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:49.932025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:49.932025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:49.932025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:49.932025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:49.932025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:49.932025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:49.932025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:49.932025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:49.932025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:49.932025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:49.932025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:49.932025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:49.932898 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:49.932898 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:49.932898 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:49.932898 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:49.933642 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 411/800] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:49.934419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9352da-9fb9-49af-a399-7e9cf3c59e12 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:49.934705 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9352da-9fb9-49af-a399-7e9cf3c59e12 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:49.935018 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9352da-9fb9-49af-a399-7e9cf3c59e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:49.952124 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4e9352da-9fb9-49af-a399-7e9cf3c59e12 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:49.953310 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4e9352da-9fb9-49af-a399-7e9cf3c59e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:49.981692 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:50.011396 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8af35-7674-4048-92d9-fadbd79d4fc6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:50.027848 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 412/801] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:18:50.028507 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9352da-9fb9-49af-a399-7e9cf3c59e12 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:50.066697 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c0b78-33fd-44d7-9af9-26bbe511220b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:50.067399 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c0b78-33fd-44d7-9af9-26bbe511220b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:50.067676 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c0b78-33fd-44d7-9af9-26bbe511220b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:50.067952 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c0b78-33fd-44d7-9af9-26bbe511220b None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:50.068746 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c0b78-33fd-44d7-9af9-26bbe511220b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:50.069055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c0b78-33fd-44d7-9af9-26bbe511220b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:50.070486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c0b78-33fd-44d7-9af9-26bbe511220b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:50.088594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 390/802] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:50.088594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c0b78-33fd-44d7-9af9-26bbe511220b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:50.106561 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:50.141270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9352da-9fb9-49af-a399-7e9cf3c59e12 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:50.178691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f65ff-5d51-4626-a271-953bd28c8c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:50.179383 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f65ff-5d51-4626-a271-953bd28c8c93 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:50.179663 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f65ff-5d51-4626-a271-953bd28c8c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:50.179935 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f65ff-5d51-4626-a271-953bd28c8c93 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:50.180633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f65ff-5d51-4626-a271-953bd28c8c93 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:50.180934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f65ff-5d51-4626-a271-953bd28c8c93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:50.182412 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f65ff-5d51-4626-a271-953bd28c8c93 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:50.192844 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 413/803] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Jul 19 12:18:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:50.192844 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f65ff-5d51-4626-a271-953bd28c8c93 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:50.198686 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c0b78-33fd-44d7-9af9-26bbe511220b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:50.221725 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:50.237822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6ff9b-63ac-48a7-821f-029b23f1cec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:50.238549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6ff9b-63ac-48a7-821f-029b23f1cec9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:50.238869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6ff9b-63ac-48a7-821f-029b23f1cec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:50.239141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6ff9b-63ac-48a7-821f-029b23f1cec9 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:50.239860 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6ff9b-63ac-48a7-821f-029b23f1cec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:50.240157 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6ff9b-63ac-48a7-821f-029b23f1cec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:50.241511 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6ff9b-63ac-48a7-821f-029b23f1cec9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:50.253015 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 391/804] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:50.253804 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6ff9b-63ac-48a7-821f-029b23f1cec9 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:50.312151 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f65ff-5d51-4626-a271-953bd28c8c93 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:50.346234 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:50.350168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef70fa2-4421-4a2d-b455-b2d87226f2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:50.351016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef70fa2-4421-4a2d-b455-b2d87226f2fa None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:50.351296 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef70fa2-4421-4a2d-b455-b2d87226f2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:50.351566 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef70fa2-4421-4a2d-b455-b2d87226f2fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:50.367134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef70fa2-4421-4a2d-b455-b2d87226f2fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:50.369561 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6ff9b-63ac-48a7-821f-029b23f1cec9 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:50.375121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8ef70fa2-4421-4a2d-b455-b2d87226f2fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:50.375121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:50.375121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:50.375121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:50.375121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:50.375121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:50.375121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:50.375121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:50.375121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:50.375121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:50.375121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:50.375121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:50.375121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:50.375121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:50.375121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:50.375121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:50.376624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:50.376624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:50.376624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:50.376624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:50.376624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:50.376624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:50.376624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:50.376624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:50.376624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:50.376624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:50.376624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:50.376624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:50.376624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:50.376624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:50.376624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:50.376624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:50.377488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:50.377488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:50.377488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:50.377488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:50.377488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:50.377488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:50.377488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:50.377488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:50.377488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:50.377488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:50.377488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:50.377488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:50.378112 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 414/805] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:50.378665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef70fa2-4421-4a2d-b455-b2d87226f2fa None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:50.411625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee898273-aae2-43c8-8ec8-ff814a15a73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:50.412521 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee898273-aae2-43c8-8ec8-ff814a15a73b None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:50.412868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee898273-aae2-43c8-8ec8-ff814a15a73b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:50.413150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee898273-aae2-43c8-8ec8-ff814a15a73b None admin] PATH_INFO: `/v3/projects/1ba395a1e22f430084089947e47a622d/users/35cc2e1079d34745a279588028945c3c/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:50.415185 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee898273-aae2-43c8-8ec8-ff814a15a73b None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba395a1e22f430084089947e47a622d, user_id=35cc2e1079d34745a279588028945c3c, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:50.416609 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee898273-aae2-43c8-8ec8-ff814a15a73b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:50.431027 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 392/806] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:18:50 2022] PUT /identity/v3/projects/1ba395a1e22f430084089947e47a622d/users/35cc2e1079d34745a279588028945c3c/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:18:50.443944 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee898273-aae2-43c8-8ec8-ff814a15a73b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:50.473745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:50.493409 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef70fa2-4421-4a2d-b455-b2d87226f2fa None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:50.533670 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae2fd7-32cd-47bb-80c0-aedfabdaa91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:50.534778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae2fd7-32cd-47bb-80c0-aedfabdaa91a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:50.535291 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae2fd7-32cd-47bb-80c0-aedfabdaa91a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:50.535765 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae2fd7-32cd-47bb-80c0-aedfabdaa91a None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:50.536694 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae2fd7-32cd-47bb-80c0-aedfabdaa91a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:50.537215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae2fd7-32cd-47bb-80c0-aedfabdaa91a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:50.538836 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae2fd7-32cd-47bb-80c0-aedfabdaa91a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:50.545203 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 415/807] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Jul 19 12:18:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:50.546413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae2fd7-32cd-47bb-80c0-aedfabdaa91a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:50.571824 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee898273-aae2-43c8-8ec8-ff814a15a73b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:50.612682 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d006f-1ce5-4bec-aaa7-aa5663ef04e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:50.613336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d006f-1ce5-4bec-aaa7-aa5663ef04e5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:50.613621 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d006f-1ce5-4bec-aaa7-aa5663ef04e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:50.613898 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d006f-1ce5-4bec-aaa7-aa5663ef04e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:50.623548 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d006f-1ce5-4bec-aaa7-aa5663ef04e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:50.624685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d006f-1ce5-4bec-aaa7-aa5663ef04e5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:50.627795 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:50.642145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-bc9d006f-1ce5-4bec-aaa7-aa5663ef04e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 12:18:50.642145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:50.642145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:50.642145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:50.642145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:50.642145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:50.642145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:50.642145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:50.642145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:50.642145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:50.642145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:50.642145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:50.642145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:50.642145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:50.642145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:50.642145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:50.643847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:50.643847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:50.643847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:50.643847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:50.643847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:50.643847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:50.643847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:50.643847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:50.643847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:50.643847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:50.643847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:50.643847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:50.643847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:50.643847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:50.643847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:50.643847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:50.643847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:50.643847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:50.644833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:50.644833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:50.644833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:50.644833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:50.644833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:50.644833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:50.644833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:50.644833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:50.644833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 12:18:50.644833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:50.644833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 393/808] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Jul 19 12:18:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:50.644833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d006f-1ce5-4bec-aaa7-aa5663ef04e5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:50.666535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae2fd7-32cd-47bb-80c0-aedfabdaa91a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:50.706757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff46cf-2b8d-4330-b380-0decf8ef93e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:50.707415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff46cf-2b8d-4330-b380-0decf8ef93e6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:50.707772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff46cf-2b8d-4330-b380-0decf8ef93e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:50.708175 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff46cf-2b8d-4330-b380-0decf8ef93e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:50.708923 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff46cf-2b8d-4330-b380-0decf8ef93e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:50.709297 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff46cf-2b8d-4330-b380-0decf8ef93e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:50.710761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff46cf-2b8d-4330-b380-0decf8ef93e6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:50.723842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 416/809] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:18:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:50.723842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff46cf-2b8d-4330-b380-0decf8ef93e6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:50.739514 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:50.770231 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d006f-1ce5-4bec-aaa7-aa5663ef04e5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:50.806324 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c48e8f-2946-472d-a918-d985fef449ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:50.807435 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c48e8f-2946-472d-a918-d985fef449ed None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:50.807729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c48e8f-2946-472d-a918-d985fef449ed None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:50.808010 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c48e8f-2946-472d-a918-d985fef449ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:50.808758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c48e8f-2946-472d-a918-d985fef449ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:50.810828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c48e8f-2946-472d-a918-d985fef449ed None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:50.839462 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 394/810] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Jul 19 12:18:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:18:50.839462 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81cf75-b95c-4ef1-b9c5-c50b03c7b801 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:50.839462 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81cf75-b95c-4ef1-b9c5-c50b03c7b801 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:50.839462 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81cf75-b95c-4ef1-b9c5-c50b03c7b801 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:50.839462 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 395/811] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:50.839462 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81cf75-b95c-4ef1-b9c5-c50b03c7b801 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:50.843050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff46cf-2b8d-4330-b380-0decf8ef93e6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:50.894269 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445d9be-faf1-48e9-aa49-5e60b39b676d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:50.895434 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445d9be-faf1-48e9-aa49-5e60b39b676d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:50.895935 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445d9be-faf1-48e9-aa49-5e60b39b676d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:50.896405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445d9be-faf1-48e9-aa49-5e60b39b676d None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:50.897519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445d9be-faf1-48e9-aa49-5e60b39b676d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:50.898030 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445d9be-faf1-48e9-aa49-5e60b39b676d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:50.899930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445d9be-faf1-48e9-aa49-5e60b39b676d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:50.927094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 417/812] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Jul 19 12:18:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:50.929018 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2420760-b71b-423d-86ac-368b3ed4b994 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:50.929529 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2420760-b71b-423d-86ac-368b3ed4b994 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:50.930018 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2420760-b71b-423d-86ac-368b3ed4b994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:50.931843 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:50.956635 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d2420760-b71b-423d-86ac-368b3ed4b994 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:50.958790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d2420760-b71b-423d-86ac-368b3ed4b994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:50.999234 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81cf75-b95c-4ef1-b9c5-c50b03c7b801 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:51.033920 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:51.042287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9ea26-0cb7-411a-b116-aa9f86b83657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:51.043102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9ea26-0cb7-411a-b116-aa9f86b83657 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:51.043382 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9ea26-0cb7-411a-b116-aa9f86b83657 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:51.043652 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9ea26-0cb7-411a-b116-aa9f86b83657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:51.044837 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 418/813] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:18:51.045999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2420760-b71b-423d-86ac-368b3ed4b994 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:51.068741 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9ea26-0cb7-411a-b116-aa9f86b83657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:51.070821 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9ea26-0cb7-411a-b116-aa9f86b83657 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:51.089822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-5fb9ea26-0cb7-411a-b116-aa9f86b83657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:51.089822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:51.089822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:51.089822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:51.089822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:51.089822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:51.089822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:51.089822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:51.089822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:51.089822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:51.089822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:51.089822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:51.089822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:51.089822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:51.089822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:51.090729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:51.090729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:51.090729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:51.090729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:51.090729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:51.090729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:51.090729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:51.090729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:51.090729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:51.090729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:51.090729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:51.090729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:51.090729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:51.090729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:51.090729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:51.090729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:51.090729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:51.091669 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:51.091669 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:51.091669 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:51.091669 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:51.096268 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 396/814] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:51.097164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9ea26-0cb7-411a-b116-aa9f86b83657 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:51.163948 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2420760-b71b-423d-86ac-368b3ed4b994 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:51.201332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717e4dc-9fcb-4352-8caf-26dbcf9bec46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:51.201986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717e4dc-9fcb-4352-8caf-26dbcf9bec46 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:51.202267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717e4dc-9fcb-4352-8caf-26dbcf9bec46 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:51.202538 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717e4dc-9fcb-4352-8caf-26dbcf9bec46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:51.227566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9ea26-0cb7-411a-b116-aa9f86b83657 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:51.236621 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:51.268772 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef54d5e-b95e-4b3e-9768-0869aa549fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:51.270072 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef54d5e-b95e-4b3e-9768-0869aa549fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:51.270574 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:51.271740 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef54d5e-b95e-4b3e-9768-0869aa549fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:51.272251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef54d5e-b95e-4b3e-9768-0869aa549fb3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:51.273112 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef54d5e-b95e-4b3e-9768-0869aa549fb3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:51.274690 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef54d5e-b95e-4b3e-9768-0869aa549fb3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:51.278816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717e4dc-9fcb-4352-8caf-26dbcf9bec46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:51.280214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717e4dc-9fcb-4352-8caf-26dbcf9bec46 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:51.289119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-6ef54d5e-b95e-4b3e-9768-0869aa549fb3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 12:18:51.289119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:51.289119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:18:51.289119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:18:51.289119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:18:51.289119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:18:51.289119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:18:51.289119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:51.289119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 12:18:51.289119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:51.289119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:18:51.289119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:51.289119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:51.289119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:51.289119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:51.289119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:51.289119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:51.290086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:51.290086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:51.290086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:51.290086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:51.290086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:51.290086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:51.290086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:18:51.290086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:18:51.290086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:18:51.290086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:18:51.290086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:51.290086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:51.290086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:51.290086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:51.290086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:51.290086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:51.290927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:51.290927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:51.290927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:51.290927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:51.290927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:51.290927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:51.290927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:51.290927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:51.290927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:51.290927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:51.290927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:18:51.290927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:51.290927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 12:18:51.290927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:51.293867 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 397/815] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:51 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:51.295027 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef54d5e-b95e-4b3e-9768-0869aa549fb3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:51.394555 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 419/816] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 12:18:51.395093 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717e4dc-9fcb-4352-8caf-26dbcf9bec46 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:51.408166 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef54d5e-b95e-4b3e-9768-0869aa549fb3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:51.446007 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07337146-edc7-4731-bc32-22c2c9f47830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:51.447161 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07337146-edc7-4731-bc32-22c2c9f47830 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:51.447664 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07337146-edc7-4731-bc32-22c2c9f47830 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:51.448172 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07337146-edc7-4731-bc32-22c2c9f47830 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:51.449188 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07337146-edc7-4731-bc32-22c2c9f47830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:51.449695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07337146-edc7-4731-bc32-22c2c9f47830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:51.451299 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07337146-edc7-4731-bc32-22c2c9f47830 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:51.465645 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 398/817] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:51.466808 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07337146-edc7-4731-bc32-22c2c9f47830 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:51.494490 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:51.500839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717e4dc-9fcb-4352-8caf-26dbcf9bec46 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:51.502044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:51.539335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f616d-7eed-4655-8556-d9ecc53ad26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:51.540321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f616d-7eed-4655-8556-d9ecc53ad26e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:51.540605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f616d-7eed-4655-8556-d9ecc53ad26e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:51.540881 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f616d-7eed-4655-8556-d9ecc53ad26e None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:51.541930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f616d-7eed-4655-8556-d9ecc53ad26e None admin] RBAC: Adding query filter params (name=network) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:51.542286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f616d-7eed-4655-8556-d9ecc53ad26e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:51.543679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f616d-7eed-4655-8556-d9ecc53ad26e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:51.556020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 420/818] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 19 12:18:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:51.556922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f616d-7eed-4655-8556-d9ecc53ad26e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:51.586131 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07337146-edc7-4731-bc32-22c2c9f47830 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:51.627926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38b827-f36b-4822-8f2d-08fe2f2d9637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:51.629096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38b827-f36b-4822-8f2d-08fe2f2d9637 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:51.629605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38b827-f36b-4822-8f2d-08fe2f2d9637 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:51.630079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38b827-f36b-4822-8f2d-08fe2f2d9637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:51.641354 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38b827-f36b-4822-8f2d-08fe2f2d9637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:51.643685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38b827-f36b-4822-8f2d-08fe2f2d9637 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:51.687743 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f616d-7eed-4655-8556-d9ecc53ad26e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:51.727194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e6ed4-788e-4d6d-b099-45f4d2ee04a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:51.728031 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e6ed4-788e-4d6d-b099-45f4d2ee04a8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:51.728313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e6ed4-788e-4d6d-b099-45f4d2ee04a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:51.728593 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e6ed4-788e-4d6d-b099-45f4d2ee04a8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:51.737233 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e6ed4-788e-4d6d-b099-45f4d2ee04a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:51.738848 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e6ed4-788e-4d6d-b099-45f4d2ee04a8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:51.756215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b97e6ed4-788e-4d6d-b099-45f4d2ee04a8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 12:18:51.756215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:51.756215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:51.756215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:51.756215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:51.756215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:51.756215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:51.756215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:51.756215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:51.756215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:51.756215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:51.756215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:51.756215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:51.756215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:51.756215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:51.756215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:51.757211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:51.757211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:51.757211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:51.757211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:51.757211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:51.757211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:51.757211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:51.757211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:51.757211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:51.757211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:51.757211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:51.757211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:51.757211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:51.757211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:51.757211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:51.757211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:51.757211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:51.757211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:51.758155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:51.758155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:51.758155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:51.758155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:51.758155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:51.758155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:51.758155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:51.758155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:51.758155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 12:18:51.758155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:51.758155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 421/819] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 19 12:18:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:51.758774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e6ed4-788e-4d6d-b099-45f4d2ee04a8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:51.784687 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:51.802366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-0c38b827-f36b-4822-8f2d-08fe2f2d9637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:51.802366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:51.802366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:51.802366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:51.802366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:51.802366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:51.802366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:51.802366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:51.802366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:51.802366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:51.802366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:51.802366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:51.802366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:51.802366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:51.802366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:51.803297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:51.803297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:51.803297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:51.803297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:51.803297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:51.803297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:51.803297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:51.803297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:51.803297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:51.803297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:51.803297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:51.803297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:51.803297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:51.803297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:51.803297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:51.803297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:51.803297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:51.804271 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:51.804271 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:51.804271 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:51.804271 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:51.806583 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 399/820] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:51.807668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38b827-f36b-4822-8f2d-08fe2f2d9637 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:51.880065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e6ed4-788e-4d6d-b099-45f4d2ee04a8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:51.918059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53a08f-6cf2-403f-bde7-fabf67e11b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:51.918973 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:51.919378 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53a08f-6cf2-403f-bde7-fabf67e11b12 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:51.919877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53a08f-6cf2-403f-bde7-fabf67e11b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:51.920388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53a08f-6cf2-403f-bde7-fabf67e11b12 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:51.921285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53a08f-6cf2-403f-bde7-fabf67e11b12 None admin] RBAC: Adding query filter params (type=network) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:51.921788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53a08f-6cf2-403f-bde7-fabf67e11b12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:51.923643 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53a08f-6cf2-403f-bde7-fabf67e11b12 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:51.929408 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 422/821] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 19 12:18:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:51.930529 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53a08f-6cf2-403f-bde7-fabf67e11b12 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:51.952417 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38b827-f36b-4822-8f2d-08fe2f2d9637 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:52.000724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed9fb1-851c-4bab-861f-33f5c9074735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:52.002120 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed9fb1-851c-4bab-861f-33f5c9074735 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:52.002401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed9fb1-851c-4bab-861f-33f5c9074735 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:52.002955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed9fb1-851c-4bab-861f-33f5c9074735 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:52.004580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed9fb1-851c-4bab-861f-33f5c9074735 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:52.004908 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed9fb1-851c-4bab-861f-33f5c9074735 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:52.006660 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed9fb1-851c-4bab-861f-33f5c9074735 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:52.030377 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:52.030567 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 400/822] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Jul 19 12:18:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:52.030567 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed9fb1-851c-4bab-861f-33f5c9074735 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:52.050762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53a08f-6cf2-403f-bde7-fabf67e11b12 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:52.089947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f7a03-7a7e-496b-a1a0-6297d19e1d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:52.090615 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f7a03-7a7e-496b-a1a0-6297d19e1d5b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:52.090953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f7a03-7a7e-496b-a1a0-6297d19e1d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:52.091328 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f7a03-7a7e-496b-a1a0-6297d19e1d5b None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:52.092210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f7a03-7a7e-496b-a1a0-6297d19e1d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:52.092510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f7a03-7a7e-496b-a1a0-6297d19e1d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:52.093943 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f7a03-7a7e-496b-a1a0-6297d19e1d5b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:52.112207 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 423/823] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:52.113116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f7a03-7a7e-496b-a1a0-6297d19e1d5b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:52.139674 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed9fb1-851c-4bab-861f-33f5c9074735 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:52.176986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb6cb7-be66-4e58-918d-28a972e74407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:52.177652 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb6cb7-be66-4e58-918d-28a972e74407 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:52.177935 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb6cb7-be66-4e58-918d-28a972e74407 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:52.178208 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb6cb7-be66-4e58-918d-28a972e74407 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:52.179001 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb6cb7-be66-4e58-918d-28a972e74407 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:52.180336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb6cb7-be66-4e58-918d-28a972e74407 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:52.188832 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:52.211132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 401/824] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Jul 19 12:18:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:18:52.212059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb6cb7-be66-4e58-918d-28a972e74407 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:52.229722 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f7a03-7a7e-496b-a1a0-6297d19e1d5b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:52.276877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d86b9-ff19-428f-9afe-5f59706cc0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:52.277944 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d86b9-ff19-428f-9afe-5f59706cc0bb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:52.278450 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d86b9-ff19-428f-9afe-5f59706cc0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:52.278897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d86b9-ff19-428f-9afe-5f59706cc0bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:52.293736 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:52.300686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d86b9-ff19-428f-9afe-5f59706cc0bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:52.302517 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d86b9-ff19-428f-9afe-5f59706cc0bb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:52.340049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-375d86b9-ff19-428f-9afe-5f59706cc0bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:52.340049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:52.340049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:52.340049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:52.340049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:52.340049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:52.340049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:52.340049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:52.340049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:52.340049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:52.340049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:52.340049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:52.340049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:52.340049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:52.340049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:52.341128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:52.341128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:52.341128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:52.341128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:52.341128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:52.341128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:52.341128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:52.341128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:52.341128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:52.341128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:52.341128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:52.341128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:52.341128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:52.341128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:52.341128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:52.341128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:52.341128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:52.341994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:52.341994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:52.341994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:52.341994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:52.352059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 424/825] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:52.353649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d86b9-ff19-428f-9afe-5f59706cc0bb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:52.458950 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb6cb7-be66-4e58-918d-28a972e74407 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:52.511701 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400e174-8048-4dbe-a95b-45d6e90f6358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:52.512622 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d86b9-ff19-428f-9afe-5f59706cc0bb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:52.512893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400e174-8048-4dbe-a95b-45d6e90f6358 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:52.513313 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400e174-8048-4dbe-a95b-45d6e90f6358 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:52.513740 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400e174-8048-4dbe-a95b-45d6e90f6358 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:52.525171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400e174-8048-4dbe-a95b-45d6e90f6358 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:52.527610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400e174-8048-4dbe-a95b-45d6e90f6358 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:52.548227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-4400e174-8048-4dbe-a95b-45d6e90f6358 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:52.548227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:52.548227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:52.548227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:52.548227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:52.548227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:52.548227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:52.548227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:52.548227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:52.548227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:52.548227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:52.548227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:52.548227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:52.548227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:52.548227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:52.549348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:52.549348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:52.549348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:52.549348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:52.549348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:52.549348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:52.549348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:52.549348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:52.549348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:52.549348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:52.549348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:52.549348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:52.549348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:52.549348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:52.549348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:52.549348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:52.549348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:52.550443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:52.550443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:52.550443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:52.550443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:52.550443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:52.550443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:52.550443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:52.550443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:52.555933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 402/826] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:52.558614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400e174-8048-4dbe-a95b-45d6e90f6358 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:52.567488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51d3d4-7786-4d3c-93be-2473aec90d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:52.568638 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51d3d4-7786-4d3c-93be-2473aec90d01 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:52.569169 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51d3d4-7786-4d3c-93be-2473aec90d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:52.569667 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51d3d4-7786-4d3c-93be-2473aec90d01 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:52.570589 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51d3d4-7786-4d3c-93be-2473aec90d01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:52.571197 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51d3d4-7786-4d3c-93be-2473aec90d01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:52.573275 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51d3d4-7786-4d3c-93be-2473aec90d01 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:52.590123 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 425/827] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:52.592914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d5fba-fc15-4076-baec-df0c76dbc53f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:52.592914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d5fba-fc15-4076-baec-df0c76dbc53f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:52.592914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d5fba-fc15-4076-baec-df0c76dbc53f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:52.592914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 426/828] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:52.597940 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d5fba-fc15-4076-baec-df0c76dbc53f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:52.625822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:52.663401 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:52.676502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400e174-8048-4dbe-a95b-45d6e90f6358 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:52.716666 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d5c86-6e42-407f-9b47-65f5e7edf290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:52.717320 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d5c86-6e42-407f-9b47-65f5e7edf290 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:52.717599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d5c86-6e42-407f-9b47-65f5e7edf290 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:52.717869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d5c86-6e42-407f-9b47-65f5e7edf290 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:52.718651 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d5c86-6e42-407f-9b47-65f5e7edf290 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:52.719014 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d5c86-6e42-407f-9b47-65f5e7edf290 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:52.720467 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d5c86-6e42-407f-9b47-65f5e7edf290 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:52.723153 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d5fba-fc15-4076-baec-df0c76dbc53f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:52.733151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 403/829] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:52.734961 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3611d-2f0e-43d0-b29e-323ecc4900f4 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:52.735726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3611d-2f0e-43d0-b29e-323ecc4900f4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:52.736167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3611d-2f0e-43d0-b29e-323ecc4900f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:52.754857 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d4a3611d-2f0e-43d0-b29e-323ecc4900f4 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:52.756028 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d4a3611d-2f0e-43d0-b29e-323ecc4900f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:52.761228 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b1938-bf30-49ac-9e8a-b1231d300874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:52.762078 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b1938-bf30-49ac-9e8a-b1231d300874 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:52.762311 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b1938-bf30-49ac-9e8a-b1231d300874 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:52.762587 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b1938-bf30-49ac-9e8a-b1231d300874 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:52.770404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b1938-bf30-49ac-9e8a-b1231d300874 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:52.772664 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b1938-bf30-49ac-9e8a-b1231d300874 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:52.792062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-4c7b1938-bf30-49ac-9e8a-b1231d300874 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:52.792062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:52.792062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:52.792062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:52.792062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:52.792062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:52.792062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:52.792062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:52.792062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:52.792062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:52.792062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:52.792062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:52.792062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:52.792062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:52.792062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:52.792974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:52.792974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:52.792974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:52.792974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:52.792974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:52.792974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:52.792974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:52.792974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:52.792974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:52.792974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:52.792974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:52.792974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:52.792974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:52.792974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:52.792974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:52.792974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:52.792974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:52.793938 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:52.793938 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:52.793938 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:52.793938 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:52.793938 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:52.793938 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:52.793938 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:52.793938 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:52.795214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 427/830] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:52.796343 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b1938-bf30-49ac-9e8a-b1231d300874 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:52.831091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 404/831] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:18:52.831091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3611d-2f0e-43d0-b29e-323ecc4900f4 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:52.889207 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:52.912729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b1938-bf30-49ac-9e8a-b1231d300874 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:52.926763 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:52.948360 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3611d-2f0e-43d0-b29e-323ecc4900f4 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:52.951943 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475c89f-6da2-4313-8c29-702c47239e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:52.952611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475c89f-6da2-4313-8c29-702c47239e49 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:52.952896 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475c89f-6da2-4313-8c29-702c47239e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:52.953176 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475c89f-6da2-4313-8c29-702c47239e49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:52.954002 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475c89f-6da2-4313-8c29-702c47239e49 None admin] RBAC: Adding query filter params (role.id=386cb814e8464fda8832b13c75eabdaf, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=5d9543657e1e4a6d85632bf57f6ba6eb) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:52.954911 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475c89f-6da2-4313-8c29-702c47239e49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:52.956291 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475c89f-6da2-4313-8c29-702c47239e49 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:52.963489 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 428/832] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:18:52 2022] GET /identity/v3/role_assignments?user.id=5d9543657e1e4a6d85632bf57f6ba6eb&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=386cb814e8464fda8832b13c75eabdaf => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:52.964281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475c89f-6da2-4313-8c29-702c47239e49 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:52.999231 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213c9b8-c141-460b-a76c-fa4f7abe03bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:52.999917 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213c9b8-c141-460b-a76c-fa4f7abe03bd None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:53.000200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213c9b8-c141-460b-a76c-fa4f7abe03bd None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:53.000471 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213c9b8-c141-460b-a76c-fa4f7abe03bd None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:53.002145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213c9b8-c141-460b-a76c-fa4f7abe03bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:53.002145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213c9b8-c141-460b-a76c-fa4f7abe03bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:53.004127 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213c9b8-c141-460b-a76c-fa4f7abe03bd None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:53.023491 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 405/833] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:53.024690 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213c9b8-c141-460b-a76c-fa4f7abe03bd None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:53.100194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475c89f-6da2-4313-8c29-702c47239e49 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:53.140175 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213c9b8-c141-460b-a76c-fa4f7abe03bd None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:53.144302 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4cbb6-b4f7-4304-9fc5-5e202181daef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:53.145100 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4cbb6-b4f7-4304-9fc5-5e202181daef None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:53.145379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4cbb6-b4f7-4304-9fc5-5e202181daef None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:53.145653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4cbb6-b4f7-4304-9fc5-5e202181daef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:53.148100 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:53.159510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4cbb6-b4f7-4304-9fc5-5e202181daef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:53.167140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-dfc4cbb6-b4f7-4304-9fc5-5e202181daef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:18:53.167140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:53.167140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:53.167140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:53.167140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:53.167140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:53.167140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:53.167140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:53.167140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:53.167140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:53.167140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:53.167140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:53.167140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:53.167140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:53.167140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:53.167140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:53.168094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:53.168094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:53.168094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:53.168094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:53.168094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:53.168094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:53.168094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:53.168094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:53.168094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:53.168094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:53.168094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:53.168094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:53.168094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:53.168094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:53.168094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:53.168094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:53.168917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:53.168917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:53.168917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:53.168917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:53.168917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:53.168917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:53.168917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:53.168917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:53.168917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:53.168917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:53.168917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:18:53.168917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:53.168917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 429/834] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:18:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:53.169918 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba8123-e2e1-4e78-b775-b08ab596a846 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:53.170149 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba8123-e2e1-4e78-b775-b08ab596a846 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:53.170421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba8123-e2e1-4e78-b775-b08ab596a846 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:53.172161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 430/835] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:53.174478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba8123-e2e1-4e78-b775-b08ab596a846 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:53.184985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93723921-9811-4de6-9685-1b2171344ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:53.185878 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93723921-9811-4de6-9685-1b2171344ee9 None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:53.186160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93723921-9811-4de6-9685-1b2171344ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:53.186436 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93723921-9811-4de6-9685-1b2171344ee9 None admin] PATH_INFO: `/v3/projects/1ba395a1e22f430084089947e47a622d/users/18030043de1942779baf3ad94aec4071/roles/42cae330d9ab456c8212ca146daf9322` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:53.202994 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93723921-9811-4de6-9685-1b2171344ee9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba395a1e22f430084089947e47a622d, user_id=18030043de1942779baf3ad94aec4071, role_id=42cae330d9ab456c8212ca146daf9322)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:53.205026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93723921-9811-4de6-9685-1b2171344ee9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:53.217692 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:53.226758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 406/836] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:18:53 2022] PUT /identity/v3/projects/1ba395a1e22f430084089947e47a622d/users/18030043de1942779baf3ad94aec4071/roles/42cae330d9ab456c8212ca146daf9322 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:18:53.226758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df307e9-44af-4fa9-8b46-3f9d8ba2bb6c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:53.226758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df307e9-44af-4fa9-8b46-3f9d8ba2bb6c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:53.226758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df307e9-44af-4fa9-8b46-3f9d8ba2bb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:53.248848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0df307e9-44af-4fa9-8b46-3f9d8ba2bb6c None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:53.251633 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0df307e9-44af-4fa9-8b46-3f9d8ba2bb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:53.308645 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba8123-e2e1-4e78-b775-b08ab596a846 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:53.346686 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 407/837] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:18:53.359624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6154b-5c49-4a6b-9265-39dae72d85a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:53.360483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6154b-5c49-4a6b-9265-39dae72d85a3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:53.360876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6154b-5c49-4a6b-9265-39dae72d85a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:53.361090 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6154b-5c49-4a6b-9265-39dae72d85a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:53.361918 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6154b-5c49-4a6b-9265-39dae72d85a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:53.362340 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6154b-5c49-4a6b-9265-39dae72d85a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:53.363882 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6154b-5c49-4a6b-9265-39dae72d85a3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:53.371735 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df307e9-44af-4fa9-8b46-3f9d8ba2bb6c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:53.374449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 431/838] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:18:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:53.386042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6154b-5c49-4a6b-9265-39dae72d85a3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:53.477848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:53.497791 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df307e9-44af-4fa9-8b46-3f9d8ba2bb6c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:53.516139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:53.522292 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6154b-5c49-4a6b-9265-39dae72d85a3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:53.546530 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c3ee1-b93a-4e07-9d7c-87879c504695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:53.548537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c3ee1-b93a-4e07-9d7c-87879c504695 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:53.548941 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c3ee1-b93a-4e07-9d7c-87879c504695 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:53.549331 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c3ee1-b93a-4e07-9d7c-87879c504695 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:53.550337 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c3ee1-b93a-4e07-9d7c-87879c504695 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:53.552528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c3ee1-b93a-4e07-9d7c-87879c504695 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:53.562698 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addfbe3-a45f-4f5f-b946-1a5a38094593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:53.563784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addfbe3-a45f-4f5f-b946-1a5a38094593 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:53.564206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addfbe3-a45f-4f5f-b946-1a5a38094593 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:53.564640 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addfbe3-a45f-4f5f-b946-1a5a38094593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:53.570115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-078c3ee1-b93a-4e07-9d7c-87879c504695 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 12:18:53.570115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:53.570115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:18:53.570115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:18:53.570115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:18:53.570115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:18:53.570115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:18:53.570115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:53.570115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 12:18:53.570115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:53.570115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:18:53.570115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:53.570115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:53.570115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:53.570115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:53.570115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:53.570115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:53.571146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:53.571146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:53.571146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:53.571146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:53.571146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:53.571146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:53.571146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:18:53.571146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:18:53.571146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:18:53.571146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:18:53.571146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:53.571146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:53.571146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:53.571146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:53.571146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:53.571146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:53.571968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:53.571968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:53.571968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:53.571968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:53.571968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:53.571968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:53.571968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:53.571968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:53.571968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:53.571968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:53.571968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:18:53.571968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:53.571968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 12:18:53.571968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:53.572675 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 408/839] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:18:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:53.580778 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c3ee1-b93a-4e07-9d7c-87879c504695 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:53.581647 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6addfbe3-a45f-4f5f-b946-1a5a38094593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:53.583343 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6addfbe3-a45f-4f5f-b946-1a5a38094593 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:53.603858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6addfbe3-a45f-4f5f-b946-1a5a38094593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:53.603858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:53.603858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:53.603858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:53.603858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:53.603858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:53.603858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:53.603858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:53.603858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:53.603858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:53.603858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:53.603858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:53.603858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:53.603858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:53.603858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:53.604784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:53.604784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:53.604784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:53.604784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:53.604784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:53.604784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:53.604784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:53.604784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:53.604784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:53.604784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:53.604784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:53.604784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:53.604784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:53.604784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:53.604784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:53.604784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:53.604784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:53.605689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:53.605689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:53.605689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:53.605689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:53.612498 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 432/840] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:53.613667 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addfbe3-a45f-4f5f-b946-1a5a38094593 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:53.713153 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c3ee1-b93a-4e07-9d7c-87879c504695 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:53.739902 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addfbe3-a45f-4f5f-b946-1a5a38094593 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:53.754226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277ce4c-15dc-4612-a670-bfd84842ed32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:53.755233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277ce4c-15dc-4612-a670-bfd84842ed32 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:53.755714 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277ce4c-15dc-4612-a670-bfd84842ed32 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:53.756182 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277ce4c-15dc-4612-a670-bfd84842ed32 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:53.757114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277ce4c-15dc-4612-a670-bfd84842ed32 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:53.757698 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277ce4c-15dc-4612-a670-bfd84842ed32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:53.759489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277ce4c-15dc-4612-a670-bfd84842ed32 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:53.770202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 409/841] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:18:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:53.771390 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277ce4c-15dc-4612-a670-bfd84842ed32 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:53.783422 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e057e-f088-4c0c-ba26-ece884746ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:53.784089 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e057e-f088-4c0c-ba26-ece884746ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:53.784363 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e057e-f088-4c0c-ba26-ece884746ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:53.784631 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e057e-f088-4c0c-ba26-ece884746ff9 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:53.785823 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e057e-f088-4c0c-ba26-ece884746ff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:53.786125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e057e-f088-4c0c-ba26-ece884746ff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:53.788417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e057e-f088-4c0c-ba26-ece884746ff9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:53.791387 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:53.806781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 433/842] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:53.811454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e057e-f088-4c0c-ba26-ece884746ff9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:53.830651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:53.892862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277ce4c-15dc-4612-a670-bfd84842ed32 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:53.933707 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a563ec4-22d1-485e-a091-f7220e0d0856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:53.935151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a563ec4-22d1-485e-a091-f7220e0d0856 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:53.935635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a563ec4-22d1-485e-a091-f7220e0d0856 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:53.936107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a563ec4-22d1-485e-a091-f7220e0d0856 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:53.937013 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a563ec4-22d1-485e-a091-f7220e0d0856 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:53.938087 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a563ec4-22d1-485e-a091-f7220e0d0856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:53.940425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a563ec4-22d1-485e-a091-f7220e0d0856 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:53.948054 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 410/843] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:18:53 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:53.958165 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e057e-f088-4c0c-ba26-ece884746ff9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:53.999523 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5895a-3b90-4a39-9a12-763a6ceb31e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:54.000791 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5895a-3b90-4a39-9a12-763a6ceb31e5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:54.001859 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5895a-3b90-4a39-9a12-763a6ceb31e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:54.002335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5895a-3b90-4a39-9a12-763a6ceb31e5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:54.011966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5895a-3b90-4a39-9a12-763a6ceb31e5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:54.013793 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5895a-3b90-4a39-9a12-763a6ceb31e5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:54.030325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b0f5895a-3b90-4a39-9a12-763a6ceb31e5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 12:18:54.030325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:54.030325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:54.030325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:54.030325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:54.030325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:54.030325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:54.030325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:54.030325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:54.030325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:54.030325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:54.030325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:54.030325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:54.030325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:54.030325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:54.030325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:54.031355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:54.031355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:54.031355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:54.031355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:54.031355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:54.031355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:54.031355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:54.031355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:54.031355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:54.031355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:54.031355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:54.031355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:54.031355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:54.031355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:54.031355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:54.031355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:54.031355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:54.031355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:54.032870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:54.032870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:54.032870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:54.032870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:54.032870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:54.032870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:54.032870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:54.032870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:54.032870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 12:18:54.032870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:54.035695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 434/844] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:18:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:54.041169 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a563ec4-22d1-485e-a091-f7220e0d0856 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:54.132627 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:54.156230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a563ec4-22d1-485e-a091-f7220e0d0856 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:54.193913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8da5f3-c5ff-40c1-9a58-525b06af7d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:54.194635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8da5f3-c5ff-40c1-9a58-525b06af7d27 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:54.194961 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8da5f3-c5ff-40c1-9a58-525b06af7d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:54.195236 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8da5f3-c5ff-40c1-9a58-525b06af7d27 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:54.196073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8da5f3-c5ff-40c1-9a58-525b06af7d27 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:54.196379 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8da5f3-c5ff-40c1-9a58-525b06af7d27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:54.197792 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8da5f3-c5ff-40c1-9a58-525b06af7d27 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:54.216865 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 411/845] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Jul 19 12:18:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:54.222524 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5895a-3b90-4a39-9a12-763a6ceb31e5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:54.295046 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:54.327598 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5895a-3b90-4a39-9a12-763a6ceb31e5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:54.363398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bf777-b074-45dc-8886-508de5c50fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:54.364050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bf777-b074-45dc-8886-508de5c50fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:54.364327 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bf777-b074-45dc-8886-508de5c50fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:54.364677 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bf777-b074-45dc-8886-508de5c50fa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:54.438220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bf777-b074-45dc-8886-508de5c50fa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:54.440405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bf777-b074-45dc-8886-508de5c50fa2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:54.510855 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:54.545087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 435/846] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:54 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 12:18:54.551262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8da5f3-c5ff-40c1-9a58-525b06af7d27 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:54.655018 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8da5f3-c5ff-40c1-9a58-525b06af7d27 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:54.694502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa927a0-de96-4245-b0ab-cdde6a5d7cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:54.701427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa927a0-de96-4245-b0ab-cdde6a5d7cfa None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:54.701915 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa927a0-de96-4245-b0ab-cdde6a5d7cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:54.702413 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa927a0-de96-4245-b0ab-cdde6a5d7cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:54.706026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:54.722778 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa927a0-de96-4245-b0ab-cdde6a5d7cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:54.722778 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa927a0-de96-4245-b0ab-cdde6a5d7cfa None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:54.739239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-5aa927a0-de96-4245-b0ab-cdde6a5d7cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:54.739239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:54.739239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:54.739239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:54.739239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:54.739239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:54.739239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:54.739239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:54.739239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:54.739239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:54.739239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:54.739239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:54.739239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:54.739239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:54.739239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:54.740138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:54.740138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:54.740138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:54.740138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:54.740138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:54.740138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:54.740138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:54.740138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:54.740138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:54.740138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:54.740138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:54.740138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:54.740138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:54.740138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:54.740138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:54.740138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:54.740138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:54.741011 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:54.741011 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:54.741011 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:54.741011 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:54.741011 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 412/847] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:54.747315 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bf777-b074-45dc-8886-508de5c50fa2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:54.853283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bf777-b074-45dc-8886-508de5c50fa2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:54.889131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae67dc7-3500-40a1-a41d-3882bee3da0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:54.889797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae67dc7-3500-40a1-a41d-3882bee3da0c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:54.890071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae67dc7-3500-40a1-a41d-3882bee3da0c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:54.890340 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae67dc7-3500-40a1-a41d-3882bee3da0c None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:54.891111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae67dc7-3500-40a1-a41d-3882bee3da0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:54.891409 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae67dc7-3500-40a1-a41d-3882bee3da0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:54.892847 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae67dc7-3500-40a1-a41d-3882bee3da0c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:54.904643 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 436/848] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:54.911868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa927a0-de96-4245-b0ab-cdde6a5d7cfa None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:55.019809 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa927a0-de96-4245-b0ab-cdde6a5d7cfa None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:55.055747 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cd865-6bfc-4bec-a7e2-47cf508d5cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:55.056546 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cd865-6bfc-4bec-a7e2-47cf508d5cae None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:55.056833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cd865-6bfc-4bec-a7e2-47cf508d5cae None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:55.057109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cd865-6bfc-4bec-a7e2-47cf508d5cae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:55.064240 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cd865-6bfc-4bec-a7e2-47cf508d5cae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:55.065674 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cd865-6bfc-4bec-a7e2-47cf508d5cae None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:55.080339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-bc9cd865-6bfc-4bec-a7e2-47cf508d5cae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:55.080339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:55.080339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:55.080339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:55.080339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:55.080339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:55.080339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:55.080339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:55.080339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:55.080339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:55.080339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:55.080339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:55.080339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:55.080339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:55.080339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:55.081230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:55.081230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:55.081230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:55.081230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:55.081230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:55.081230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:55.081230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:55.081230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:55.081230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:55.081230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:55.081230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:55.081230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:55.081230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:55.081230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:55.081230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:55.081230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:55.081230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:55.082105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:55.082105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:55.082105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:55.082105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:55.082105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:55.082105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:55.082105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:55.082105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:55.082105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 413/849] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:55.088647 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae67dc7-3500-40a1-a41d-3882bee3da0c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:55.106415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e37eb-62ae-4f8f-b0c0-3302248f839e None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:55.106719 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e37eb-62ae-4f8f-b0c0-3302248f839e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:55.107276 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e37eb-62ae-4f8f-b0c0-3302248f839e None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:55.108479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 414/850] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:18:55.113751 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef3089-3c01-4187-8e78-d5a5ef3dd524 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:55.114036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef3089-3c01-4187-8e78-d5a5ef3dd524 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:55.114311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef3089-3c01-4187-8e78-d5a5ef3dd524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:55.124702 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:55.135816 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ddef3089-3c01-4187-8e78-d5a5ef3dd524 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:55.137041 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ddef3089-3c01-4187-8e78-d5a5ef3dd524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:55.196415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:55.221828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae67dc7-3500-40a1-a41d-3882bee3da0c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:55.238762 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 415/851] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 12:18:55.253865 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef3089-3c01-4187-8e78-d5a5ef3dd524 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:55.278162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988b26a-ddb2-4ed9-b31e-3cfe6a60075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:55.278162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988b26a-ddb2-4ed9-b31e-3cfe6a60075d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:55.278162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988b26a-ddb2-4ed9-b31e-3cfe6a60075d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:55.278162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988b26a-ddb2-4ed9-b31e-3cfe6a60075d None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:55.278855 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988b26a-ddb2-4ed9-b31e-3cfe6a60075d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:55.278855 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988b26a-ddb2-4ed9-b31e-3cfe6a60075d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:55.278855 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988b26a-ddb2-4ed9-b31e-3cfe6a60075d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:55.289961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 437/852] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:55.299958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988b26a-ddb2-4ed9-b31e-3cfe6a60075d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:55.363977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef3089-3c01-4187-8e78-d5a5ef3dd524 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:55.400516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2299324-4422-40cd-8703-915690735cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:55.401319 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2299324-4422-40cd-8703-915690735cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:55.401593 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2299324-4422-40cd-8703-915690735cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:55.401859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2299324-4422-40cd-8703-915690735cd2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:55.402502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2299324-4422-40cd-8703-915690735cd2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:55.403991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2299324-4422-40cd-8703-915690735cd2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:55.407688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:55.417191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-c2299324-4422-40cd-8703-915690735cd2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 12:18:55.417191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:55.417191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:18:55.417191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:18:55.417191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:18:55.417191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:18:55.417191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:18:55.417191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:55.417191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 12:18:55.417191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:55.417191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:18:55.417191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:55.417191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:55.417191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:55.417191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:55.417191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:55.418115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:55.418115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:55.418115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:55.418115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:55.418115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:55.418115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:55.418115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:55.418115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:18:55.418115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:18:55.418115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:18:55.418115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:18:55.418115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:55.418115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:55.418115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:55.418115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:55.418115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:55.419598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:55.419598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:55.419598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:55.419598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:55.419598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:55.419598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:55.419598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:55.419598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:55.419598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:55.419598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:55.419598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:55.419598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:18:55.419598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:55.419598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 12:18:55.419598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:55.420406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988b26a-ddb2-4ed9-b31e-3cfe6a60075d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:55.420479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 416/853] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Jul 19 12:18:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:55.420479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6e23a-5021-4cfe-968a-7984003d9ac9 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:55.420479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6e23a-5021-4cfe-968a-7984003d9ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:55.420479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6e23a-5021-4cfe-968a-7984003d9ac9 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:55.421772 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 417/854] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:55.426350 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6e23a-5021-4cfe-968a-7984003d9ac9 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:55.461586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fecc20-fe2b-4461-8093-13aa603864ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:55.462250 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fecc20-fe2b-4461-8093-13aa603864ee None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:55.462530 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fecc20-fe2b-4461-8093-13aa603864ee None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:55.462835 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fecc20-fe2b-4461-8093-13aa603864ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:55.463665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fecc20-fe2b-4461-8093-13aa603864ee None admin] RBAC: Adding query filter params (role.id=386cb814e8464fda8832b13c75eabdaf, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=35cc2e1079d34745a279588028945c3c) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:55.463975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fecc20-fe2b-4461-8093-13aa603864ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:55.465392 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fecc20-fe2b-4461-8093-13aa603864ee None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:55.472667 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:55.479147 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 438/855] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:18:55 2022] GET /identity/v3/role_assignments?user.id=35cc2e1079d34745a279588028945c3c&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=386cb814e8464fda8832b13c75eabdaf => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:55.481693 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e84a8-a65d-4ef6-9bd3-4c1cad64def2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:55.482258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e84a8-a65d-4ef6-9bd3-4c1cad64def2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:55.482757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e84a8-a65d-4ef6-9bd3-4c1cad64def2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:55.508568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-508e84a8-a65d-4ef6-9bd3-4c1cad64def2 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:55.510184 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-508e84a8-a65d-4ef6-9bd3-4c1cad64def2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:55.543858 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6e23a-5021-4cfe-968a-7984003d9ac9 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:55.584751 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405724ee-4588-4394-8261-cb54e31141e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:55.585524 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405724ee-4588-4394-8261-cb54e31141e1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:55.585813 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405724ee-4588-4394-8261-cb54e31141e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:55.586091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405724ee-4588-4394-8261-cb54e31141e1 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:55.586853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405724ee-4588-4394-8261-cb54e31141e1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:55.587168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405724ee-4588-4394-8261-cb54e31141e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:55.588682 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405724ee-4588-4394-8261-cb54e31141e1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:55.595213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 418/856] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 19 12:18:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:55.601714 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405724ee-4588-4394-8261-cb54e31141e1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:55.615318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 439/857] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:18:55.642519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e84a8-a65d-4ef6-9bd3-4c1cad64def2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:55.721765 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405724ee-4588-4394-8261-cb54e31141e1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:55.730987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:55.755808 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:55.765489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffa3dd-65ea-4f8f-9f12-f030f3b7c06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:55.766760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffa3dd-65ea-4f8f-9f12-f030f3b7c06c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:55.766923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffa3dd-65ea-4f8f-9f12-f030f3b7c06c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:55.767485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffa3dd-65ea-4f8f-9f12-f030f3b7c06c None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:55.768675 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffa3dd-65ea-4f8f-9f12-f030f3b7c06c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:55.769191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffa3dd-65ea-4f8f-9f12-f030f3b7c06c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:55.771044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ffa3dd-65ea-4f8f-9f12-f030f3b7c06c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:55.774086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e84a8-a65d-4ef6-9bd3-4c1cad64def2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:55.778212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 419/858] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 19 12:18:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:55.817720 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d80e4-4efb-44ca-a199-f507d6f66cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:55.818462 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d80e4-4efb-44ca-a199-f507d6f66cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:55.818759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d80e4-4efb-44ca-a199-f507d6f66cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:55.819056 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d80e4-4efb-44ca-a199-f507d6f66cf9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:55.832668 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d80e4-4efb-44ca-a199-f507d6f66cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:18:55.840916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d25d80e4-4efb-44ca-a199-f507d6f66cf9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:55.840916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:55.840916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:55.840916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:55.840916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:55.840916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:55.840916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:55.840916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:55.840916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:55.840916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:55.840916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:55.840916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:55.840916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:18:55.840916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:18:55.840916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:18:55.840916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:18:55.841907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:18:55.841907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:18:55.841907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:18:55.841907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:18:55.841907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:55.841907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:55.841907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:55.841907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:55.841907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:55.841907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:55.841907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:55.841907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:55.841907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:55.841907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:55.841907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:55.841907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:55.842761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:55.842761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:55.842761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:55.842761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:55.842761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:18:55.842761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:18:55.842761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:18:55.842761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:18:55.842761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:18:55.842761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:18:55.842761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:18:55.842761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:55.846882 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 440/859] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:18:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:55.848883 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffa3dd-65ea-4f8f-9f12-f030f3b7c06c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:55.962136 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ffa3dd-65ea-4f8f-9f12-f030f3b7c06c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:55.997540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbb66d-a03d-41da-a408-39d889cab047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:55.998207 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbb66d-a03d-41da-a408-39d889cab047 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:55.998486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbb66d-a03d-41da-a408-39d889cab047 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:55.998783 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbb66d-a03d-41da-a408-39d889cab047 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:55.999535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbb66d-a03d-41da-a408-39d889cab047 None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:55.999837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbb66d-a03d-41da-a408-39d889cab047 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:56.001971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbb66d-a03d-41da-a408-39d889cab047 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:56.010889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 420/860] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:18:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:56.016781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d80e4-4efb-44ca-a199-f507d6f66cf9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:56.125842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d80e4-4efb-44ca-a199-f507d6f66cf9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:56.162839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391a06e-2dbb-4508-b0df-9fd4d67a1d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:56.163642 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391a06e-2dbb-4508-b0df-9fd4d67a1d60 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:56.163925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391a06e-2dbb-4508-b0df-9fd4d67a1d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:56.164200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391a06e-2dbb-4508-b0df-9fd4d67a1d60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:56.175822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391a06e-2dbb-4508-b0df-9fd4d67a1d60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:56.177291 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391a06e-2dbb-4508-b0df-9fd4d67a1d60 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:56.179991 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:56.196437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a151188-327d-4846-85e9-c3df5c8de146 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:56.196922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a151188-327d-4846-85e9-c3df5c8de146 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:56.196996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a151188-327d-4846-85e9-c3df5c8de146 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:56.197542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a391a06e-2dbb-4508-b0df-9fd4d67a1d60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:56.197542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:56.197542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:56.197542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:56.197542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:56.197542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:56.197542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:56.197542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:56.197542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:56.197542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:56.197542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:56.197542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:56.197542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:56.197542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:56.197542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:56.198368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:56.198368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:56.198368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:56.198368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:56.198368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:56.198368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:56.198368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:56.198368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:56.198368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:56.198368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:56.198368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:56.198368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:56.198368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:56.198368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:56.198368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:56.198368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:56.198368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:56.199273 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:56.199273 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:56.199273 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:56.199273 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:56.199514 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 421/861] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:18:56.199583 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 441/862] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:56.203679 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666fe8e-9d62-4607-9adb-65851f58188a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:56.204017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666fe8e-9d62-4607-9adb-65851f58188a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:56.204514 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666fe8e-9d62-4607-9adb-65851f58188a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:56.208235 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391a06e-2dbb-4508-b0df-9fd4d67a1d60 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:56.226126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c666fe8e-9d62-4607-9adb-65851f58188a None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:56.227760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c666fe8e-9d62-4607-9adb-65851f58188a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:56.262868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:56.323010 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 422/863] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:18:56.326186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391a06e-2dbb-4508-b0df-9fd4d67a1d60 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:56.342722 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666fe8e-9d62-4607-9adb-65851f58188a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:56.363206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c120927-1b71-4fd0-b19d-4f1a9b282409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:56.363930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c120927-1b71-4fd0-b19d-4f1a9b282409 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:56.364161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c120927-1b71-4fd0-b19d-4f1a9b282409 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:56.364431 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c120927-1b71-4fd0-b19d-4f1a9b282409 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:56.365172 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c120927-1b71-4fd0-b19d-4f1a9b282409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:56.365449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c120927-1b71-4fd0-b19d-4f1a9b282409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:56.366835 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c120927-1b71-4fd0-b19d-4f1a9b282409 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:56.380376 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 442/864] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:56.387701 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c120927-1b71-4fd0-b19d-4f1a9b282409 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:56.462315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666fe8e-9d62-4607-9adb-65851f58188a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:56.466967 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:56.506943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e92bcc-1f85-43c8-88ae-e4d158077149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:56.507613 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e92bcc-1f85-43c8-88ae-e4d158077149 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:56.507892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e92bcc-1f85-43c8-88ae-e4d158077149 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:56.508160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e92bcc-1f85-43c8-88ae-e4d158077149 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:56.508985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e92bcc-1f85-43c8-88ae-e4d158077149 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:56.510353 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e92bcc-1f85-43c8-88ae-e4d158077149 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:56.525163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c120927-1b71-4fd0-b19d-4f1a9b282409 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:56.533594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 423/865] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 19 12:18:56 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:18:56.576178 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d382466-e15a-4102-815f-cbe01b38517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:56.577440 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d382466-e15a-4102-815f-cbe01b38517e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:56.577953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d382466-e15a-4102-815f-cbe01b38517e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:56.578433 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d382466-e15a-4102-815f-cbe01b38517e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:56.588649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d382466-e15a-4102-815f-cbe01b38517e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:56.590548 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d382466-e15a-4102-815f-cbe01b38517e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:56.608928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-0d382466-e15a-4102-815f-cbe01b38517e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 12:18:56.608928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:56.608928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:56.608928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:56.608928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:56.608928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:56.608928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:56.608928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:56.608928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:56.608928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:56.608928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:56.608928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:56.608928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:18:56.608928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:18:56.608928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:18:56.608928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:18:56.609942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:56.609942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:56.609942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:18:56.609942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:56.609942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:18:56.609942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:18:56.609942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:56.609942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:56.609942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:56.609942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:56.609942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:56.609942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:56.609942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:56.609942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:56.609942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:56.609942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:56.609942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:56.609942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:56.611459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:56.611459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:56.611459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:18:56.611459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:18:56.611459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:18:56.611459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:18:56.611459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:18:56.611459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:18:56.611459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 12:18:56.611459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:18:56.618965 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 443/866] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 19 12:18:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:56.622480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e92bcc-1f85-43c8-88ae-e4d158077149 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:56.653117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:56.748009 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e92bcc-1f85-43c8-88ae-e4d158077149 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:56.785773 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8362cab-c8c7-43fd-a841-18e22f3306d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:56.786451 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8362cab-c8c7-43fd-a841-18e22f3306d4 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:56.786805 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8362cab-c8c7-43fd-a841-18e22f3306d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:56.787032 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8362cab-c8c7-43fd-a841-18e22f3306d4 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:56.787874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8362cab-c8c7-43fd-a841-18e22f3306d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:56.788176 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8362cab-c8c7-43fd-a841-18e22f3306d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:56.789725 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8362cab-c8c7-43fd-a841-18e22f3306d4 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:56.809017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 424/867] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Jul 19 12:18:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:56.815468 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d382466-e15a-4102-815f-cbe01b38517e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:56.925470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d382466-e15a-4102-815f-cbe01b38517e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:56.940657 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:56.961627 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003d14b-17ee-4112-93e9-f3ff364cb5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:56.962275 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003d14b-17ee-4112-93e9-f3ff364cb5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:56.962550 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003d14b-17ee-4112-93e9-f3ff364cb5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:56.962849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003d14b-17ee-4112-93e9-f3ff364cb5a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:57.036704 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003d14b-17ee-4112-93e9-f3ff364cb5a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:57.038146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003d14b-17ee-4112-93e9-f3ff364cb5a5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:57.140509 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 444/868] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:18:56 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 12:18:57.146295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8362cab-c8c7-43fd-a841-18e22f3306d4 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:57.232268 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:57.252770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8362cab-c8c7-43fd-a841-18e22f3306d4 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:57.287912 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87183d2c-31f8-4b4b-bb35-99e655159939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:57.288715 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87183d2c-31f8-4b4b-bb35-99e655159939 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:57.288997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87183d2c-31f8-4b4b-bb35-99e655159939 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:57.289269 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87183d2c-31f8-4b4b-bb35-99e655159939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:57.300277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87183d2c-31f8-4b4b-bb35-99e655159939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:57.301735 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87183d2c-31f8-4b4b-bb35-99e655159939 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:57.320202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-87183d2c-31f8-4b4b-bb35-99e655159939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:57.320202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:57.320202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:57.320202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:57.320202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:57.320202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:57.320202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:57.320202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:57.320202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:57.320202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:57.320202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:57.320202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:57.320202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:18:57.320202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:18:57.320202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:18:57.321333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:18:57.321333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:57.321333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:57.321333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:57.321333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:57.321333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:57.321333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:57.321333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:57.321333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:57.321333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:57.321333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:57.321333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:57.321333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:57.321333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:57.321333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:57.321333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:57.321333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:57.322427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:18:57.322427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:18:57.322427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:18:57.322427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:57.328725 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 425/869] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:57.330657 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003d14b-17ee-4112-93e9-f3ff364cb5a5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:57.347119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:57.441782 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003d14b-17ee-4112-93e9-f3ff364cb5a5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:57.476557 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af52fdc-3481-4451-aa9d-eb0366f33f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:57.477211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af52fdc-3481-4451-aa9d-eb0366f33f20 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:57.477487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af52fdc-3481-4451-aa9d-eb0366f33f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:57.477759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af52fdc-3481-4451-aa9d-eb0366f33f20 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:57.478465 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af52fdc-3481-4451-aa9d-eb0366f33f20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:57.478788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af52fdc-3481-4451-aa9d-eb0366f33f20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:57.480140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af52fdc-3481-4451-aa9d-eb0366f33f20 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:57.492456 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 445/870] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:57.497740 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87183d2c-31f8-4b4b-bb35-99e655159939 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:57.605615 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87183d2c-31f8-4b4b-bb35-99e655159939 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:57.638861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:57.646355 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c0898-7f7c-49c6-ac26-7891551bff52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:57.647764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c0898-7f7c-49c6-ac26-7891551bff52 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:57.648284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c0898-7f7c-49c6-ac26-7891551bff52 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:57.648760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c0898-7f7c-49c6-ac26-7891551bff52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:57.656125 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c0898-7f7c-49c6-ac26-7891551bff52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:57.658632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c0898-7f7c-49c6-ac26-7891551bff52 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:57.672940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-4a9c0898-7f7c-49c6-ac26-7891551bff52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:57.672940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:57.672940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:57.672940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:57.672940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:57.672940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:57.672940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:57.672940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:57.672940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:57.672940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:57.672940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:57.672940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:57.672940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:18:57.672940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:18:57.672940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:18:57.674317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:18:57.674317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:57.674317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:57.674317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:57.674317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:57.674317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:57.674317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:57.674317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:57.674317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:57.674317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:57.674317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:57.674317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:57.674317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:57.674317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:57.674317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:57.674317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:57.674317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:57.675224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:18:57.675224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:18:57.675224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:18:57.675224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:18:57.675224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:18:57.675224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:18:57.675224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:18:57.675224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:57.677670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 426/871] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:18:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:57.684226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec1bbd-802b-4f48-8747-1510b31859dd None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:57.684511 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec1bbd-802b-4f48-8747-1510b31859dd None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:57.684788 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec1bbd-802b-4f48-8747-1510b31859dd None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:57.686389 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 427/872] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:18:57.689917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af52fdc-3481-4451-aa9d-eb0366f33f20 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:57.692076 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda08c75-014f-4a77-abd8-f41f8be1e8d8 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:57.692365 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda08c75-014f-4a77-abd8-f41f8be1e8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:57.692641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda08c75-014f-4a77-abd8-f41f8be1e8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:57.716181 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-dda08c75-014f-4a77-abd8-f41f8be1e8d8 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:57.717385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-dda08c75-014f-4a77-abd8-f41f8be1e8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:57.776143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:57.810756 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 428/873] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:57 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 12:18:57.813749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af52fdc-3481-4451-aa9d-eb0366f33f20 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:57.827386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda08c75-014f-4a77-abd8-f41f8be1e8d8 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:57.855642 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4a624-d49f-47b2-ade5-a98c84683f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:57.856770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4a624-d49f-47b2-ade5-a98c84683f93 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:57.857260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4a624-d49f-47b2-ade5-a98c84683f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:57.857812 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4a624-d49f-47b2-ade5-a98c84683f93 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:57.859496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4a624-d49f-47b2-ade5-a98c84683f93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:57.860919 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4a624-d49f-47b2-ade5-a98c84683f93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:57.863521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4a624-d49f-47b2-ade5-a98c84683f93 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:57.877384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 446/874] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:18:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:57.884162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4a624-d49f-47b2-ade5-a98c84683f93 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:57.956079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda08c75-014f-4a77-abd8-f41f8be1e8d8 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:57.982311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:57.996244 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c262de-5186-43f4-8bfe-89f75b9c360d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:57.997357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c262de-5186-43f4-8bfe-89f75b9c360d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:57.997847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c262de-5186-43f4-8bfe-89f75b9c360d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:57.998325 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c262de-5186-43f4-8bfe-89f75b9c360d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:57.999232 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c262de-5186-43f4-8bfe-89f75b9c360d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:58.001345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c262de-5186-43f4-8bfe-89f75b9c360d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:58.011590 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4a624-d49f-47b2-ade5-a98c84683f93 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:58.014599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-74c262de-5186-43f4-8bfe-89f75b9c360d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 12:18:58.014599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:58.014599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:18:58.014599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:18:58.014599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:18:58.014599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:18:58.014599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:18:58.014599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:58.014599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 12:18:58.014599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:58.014599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:18:58.014599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:58.014599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:58.014599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:58.014599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:58.014599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:58.014599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:58.015646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:58.015646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:58.015646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:58.015646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:58.015646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:58.015646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:58.015646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:18:58.015646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:18:58.015646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:18:58.015646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:18:58.015646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:58.015646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:58.015646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:58.015646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:58.015646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:58.015646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:58.016572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:58.016572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:58.016572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:58.016572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:58.016572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:58.016572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:58.016572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:58.016572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:58.016572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:58.016572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:58.016572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:18:58.016572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:58.016572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 12:18:58.016572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:58.024915 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 429/875] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 19 12:18:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:18:58.026021 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c262de-5186-43f4-8bfe-89f75b9c360d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:58.049608 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:58.057348 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514906a-8fc4-42ce-a100-070376a49a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:58.058381 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514906a-8fc4-42ce-a100-070376a49a83 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:58.058665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514906a-8fc4-42ce-a100-070376a49a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:58.058969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514906a-8fc4-42ce-a100-070376a49a83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:58.060424 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514906a-8fc4-42ce-a100-070376a49a83 None admin] RBAC: Adding query filter params (role.id=42cae330d9ab456c8212ca146daf9322, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=18030043de1942779baf3ad94aec4071) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:58.060999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514906a-8fc4-42ce-a100-070376a49a83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:58.062454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514906a-8fc4-42ce-a100-070376a49a83 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:58.078772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 447/876] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:18:57 2022] GET /identity/v3/role_assignments?user.id=18030043de1942779baf3ad94aec4071&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=42cae330d9ab456c8212ca146daf9322 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:58.078772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17432a1a-0aad-466e-a0e7-c04775992cef None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:58.078772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17432a1a-0aad-466e-a0e7-c04775992cef None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:58.078772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17432a1a-0aad-466e-a0e7-c04775992cef None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:58.078772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 448/877] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:58.085782 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9a4d6-57b0-49d0-a91c-682b5dc433a2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:58.086065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9a4d6-57b0-49d0-a91c-682b5dc433a2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:58.086343 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9a4d6-57b0-49d0-a91c-682b5dc433a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:58.149423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c262de-5186-43f4-8bfe-89f75b9c360d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:58.193329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a60891-e327-43e4-903d-4439f46b81f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:58.194320 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a60891-e327-43e4-903d-4439f46b81f0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:58.194763 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a60891-e327-43e4-903d-4439f46b81f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:58.195179 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a60891-e327-43e4-903d-4439f46b81f0 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:58.196065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a60891-e327-43e4-903d-4439f46b81f0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:58.196547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a60891-e327-43e4-903d-4439f46b81f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:58.198123 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a60891-e327-43e4-903d-4439f46b81f0 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:58.205116 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 430/878] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 19 12:18:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:58.210783 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a60891-e327-43e4-903d-4439f46b81f0 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:58.232588 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-26e9a4d6-57b0-49d0-a91c-682b5dc433a2 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:58.234496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-26e9a4d6-57b0-49d0-a91c-682b5dc433a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:58.271417 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:58.337922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 449/879] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 12:18:58.345096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a60891-e327-43e4-903d-4439f46b81f0 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:58.361519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9a4d6-57b0-49d0-a91c-682b5dc433a2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:58.393341 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4834e68-73da-47e6-8300-580d0ff7e5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:58.394127 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4834e68-73da-47e6-8300-580d0ff7e5fa None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:58.394408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4834e68-73da-47e6-8300-580d0ff7e5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:58.394949 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4834e68-73da-47e6-8300-580d0ff7e5fa None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:58.396076 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4834e68-73da-47e6-8300-580d0ff7e5fa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:58.396513 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4834e68-73da-47e6-8300-580d0ff7e5fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:58.398327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4834e68-73da-47e6-8300-580d0ff7e5fa None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:58.405293 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 431/880] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 19 12:18:58 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:18:58.481737 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9a4d6-57b0-49d0-a91c-682b5dc433a2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:58.512231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:58.522483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2e3b7-e970-4a5c-8811-f810ba344a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:58.523213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2e3b7-e970-4a5c-8811-f810ba344a10 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:58.523491 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2e3b7-e970-4a5c-8811-f810ba344a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:58.523770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2e3b7-e970-4a5c-8811-f810ba344a10 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:58.524501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2e3b7-e970-4a5c-8811-f810ba344a10 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:58.525905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2e3b7-e970-4a5c-8811-f810ba344a10 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:58.544650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 450/881] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 19 12:18:58 2022] POST /identity/v3/services => generated 269 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:18:58.705587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29546d9a-94a2-4e72-92a3-fc1e21d93e11 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:58.705868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29546d9a-94a2-4e72-92a3-fc1e21d93e11 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:58.706140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29546d9a-94a2-4e72-92a3-fc1e21d93e11 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:58.707885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 432/882] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:18:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:18:58.713050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c258e7-7b89-48d4-aba0-bf1fe2dc0c64 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:58.713343 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c258e7-7b89-48d4-aba0-bf1fe2dc0c64 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:58.713622 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c258e7-7b89-48d4-aba0-bf1fe2dc0c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:58.734009 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-10c258e7-7b89-48d4-aba0-bf1fe2dc0c64 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:18:58.735293 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-10c258e7-7b89-48d4-aba0-bf1fe2dc0c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:58.822416 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 451/883] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:18:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:18:58.845040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29546d9a-94a2-4e72-92a3-fc1e21d93e11 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:58.951323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29546d9a-94a2-4e72-92a3-fc1e21d93e11 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:58.966128 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:58.987720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b69c89-3115-4f2e-a156-89bd1c7f35e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:58.988531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b69c89-3115-4f2e-a156-89bd1c7f35e0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:58.988807 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b69c89-3115-4f2e-a156-89bd1c7f35e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:58.989084 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b69c89-3115-4f2e-a156-89bd1c7f35e0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:58.989735 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b69c89-3115-4f2e-a156-89bd1c7f35e0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:58.991159 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b69c89-3115-4f2e-a156-89bd1c7f35e0 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:59.003551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-87b69c89-3115-4f2e-a156-89bd1c7f35e0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 12:18:59.003551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:59.003551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:18:59.003551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:18:59.003551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:18:59.003551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:18:59.003551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:18:59.003551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:59.003551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 12:18:59.003551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:59.003551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:18:59.003551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:59.003551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:18:59.003551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:18:59.003551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:18:59.003551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:18:59.003551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:18:59.004507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:18:59.004507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:18:59.004507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:18:59.004507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:18:59.004507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:18:59.004507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:18:59.004507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:18:59.004507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:18:59.004507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:18:59.004507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:18:59.004507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:18:59.004507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:18:59.004507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:18:59.004507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:18:59.004507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:18:59.004507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:18:59.005322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:18:59.005322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:18:59.005322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:18:59.005322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:18:59.005322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:18:59.005322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:18:59.005322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:18:59.005322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:18:59.005322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:18:59.005322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:18:59.005322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:18:59.005322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:18:59.005322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 12:18:59.005322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:18:59.005322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 433/884] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:18:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:18:59.014940 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c258e7-7b89-48d4-aba0-bf1fe2dc0c64 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:59.123122 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c258e7-7b89-48d4-aba0-bf1fe2dc0c64 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:59.137019 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:59.161222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8bf6d-093e-4eaa-967f-b164ccf4b130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:59.161906 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8bf6d-093e-4eaa-967f-b164ccf4b130 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:59.162192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8bf6d-093e-4eaa-967f-b164ccf4b130 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:59.162470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8bf6d-093e-4eaa-967f-b164ccf4b130 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:59.163210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8bf6d-093e-4eaa-967f-b164ccf4b130 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:59.163517 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8bf6d-093e-4eaa-967f-b164ccf4b130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:59.164889 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8bf6d-093e-4eaa-967f-b164ccf4b130 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:59.169838 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 452/885] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:18:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:59.175685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b69c89-3115-4f2e-a156-89bd1c7f35e0 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:59.278098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b69c89-3115-4f2e-a156-89bd1c7f35e0 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:59.313280 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd8ada-0dd2-4c6c-ab9b-c201081ef1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:59.313949 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd8ada-0dd2-4c6c-ab9b-c201081ef1ee None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:59.314227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd8ada-0dd2-4c6c-ab9b-c201081ef1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:59.314499 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd8ada-0dd2-4c6c-ab9b-c201081ef1ee None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:59.315231 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd8ada-0dd2-4c6c-ab9b-c201081ef1ee None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:59.315529 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd8ada-0dd2-4c6c-ab9b-c201081ef1ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:59.316877 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd8ada-0dd2-4c6c-ab9b-c201081ef1ee None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:59.322160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 434/886] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:18:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:59.327617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8bf6d-093e-4eaa-967f-b164ccf4b130 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:59.435593 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8bf6d-093e-4eaa-967f-b164ccf4b130 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:59.471192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253e1c7-37d3-4f19-9f87-5817ec87a1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:59.471850 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253e1c7-37d3-4f19-9f87-5817ec87a1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:59.472133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253e1c7-37d3-4f19-9f87-5817ec87a1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:59.472413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253e1c7-37d3-4f19-9f87-5817ec87a1c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:59.473199 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253e1c7-37d3-4f19-9f87-5817ec87a1c9 None admin] RBAC: Adding query filter params (interface=public, service_id=2d0377a0fb824088ab6dfdd5d1881ade, region_id=RegionOne) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:18:59.473508 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253e1c7-37d3-4f19-9f87-5817ec87a1c9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:59.474895 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253e1c7-37d3-4f19-9f87-5817ec87a1c9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:59.480303 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 453/887] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Jul 19 12:18:59 2022] GET /identity/v3/endpoints?service_id=2d0377a0fb824088ab6dfdd5d1881ade&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:18:59.485466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd8ada-0dd2-4c6c-ab9b-c201081ef1ee None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:59.529834 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:59.588117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd8ada-0dd2-4c6c-ab9b-c201081ef1ee None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:59.625229 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cfdb5-88e6-4de8-8d28-49a3b1a33a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:59.625984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cfdb5-88e6-4de8-8d28-49a3b1a33a46 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:59.626265 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cfdb5-88e6-4de8-8d28-49a3b1a33a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:59.626532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cfdb5-88e6-4de8-8d28-49a3b1a33a46 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:59.627239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cfdb5-88e6-4de8-8d28-49a3b1a33a46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:59.628587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cfdb5-88e6-4de8-8d28-49a3b1a33a46 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:59.634850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 435/888] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Jul 19 12:18:59 2022] GET /identity/v3/services => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:19:00.327807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1400b1a-f2d8-4844-8fa8-7f756005bba5 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:00.328092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1400b1a-f2d8-4844-8fa8-7f756005bba5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:00.328624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1400b1a-f2d8-4844-8fa8-7f756005bba5 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:00.331227 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 454/889] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:00.337052 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb57f4-0b1f-431e-bd5c-2ec7a69b37f9 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:00.337957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb57f4-0b1f-431e-bd5c-2ec7a69b37f9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:00.338441 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb57f4-0b1f-431e-bd5c-2ec7a69b37f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:00.355898 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-64cb57f4-0b1f-431e-bd5c-2ec7a69b37f9 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:00.357409 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-64cb57f4-0b1f-431e-bd5c-2ec7a69b37f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:00.439141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 436/890] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:00.456124 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1400b1a-f2d8-4844-8fa8-7f756005bba5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:00.509773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:00.528045 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b76e09-2148-4c89-8443-ed3c998301b6 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:00.528645 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b76e09-2148-4c89-8443-ed3c998301b6 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:00.529144 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b76e09-2148-4c89-8443-ed3c998301b6 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:00.531027 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 437/891] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:19:00.536661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b269f13-e319-4b6a-960b-ccf2e58b9d85 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:00.537239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b269f13-e319-4b6a-960b-ccf2e58b9d85 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:00.537709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b269f13-e319-4b6a-960b-ccf2e58b9d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:00.555847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9b269f13-e319-4b6a-960b-ccf2e58b9d85 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:00.557427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9b269f13-e319-4b6a-960b-ccf2e58b9d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:00.580029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1400b1a-f2d8-4844-8fa8-7f756005bba5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:00.597207 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:00.619633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dca10f-a42b-4856-bff1-1d4b647bce9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:00.620763 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dca10f-a42b-4856-bff1-1d4b647bce9b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:00.621246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dca10f-a42b-4856-bff1-1d4b647bce9b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:00.621716 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dca10f-a42b-4856-bff1-1d4b647bce9b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:00.633803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dca10f-a42b-4856-bff1-1d4b647bce9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:19:00.643110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d5dca10f-a42b-4856-bff1-1d4b647bce9b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 12:19:00.643110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:00.643110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:00.643110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:00.643110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:00.643110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:00.643110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:00.643110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:00.643110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:00.643110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:00.643110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:00.643110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:00.643110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:19:00.643110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:19:00.643110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:19:00.643110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:19:00.644059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:19:00.644059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:19:00.644059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:19:00.644059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:19:00.644059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:00.644059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:00.644059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:00.644059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:00.644059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:00.644059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:00.644059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:00.644059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:00.644059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:00.644059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:00.644059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:00.644059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:00.644899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:00.644899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:00.644899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:00.644899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:00.644899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:19:00.644899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:19:00.644899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:19:00.644899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:19:00.644899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:19:00.644899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:19:00.644899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 12:19:00.644899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:00.647910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 455/893] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Jul 19 12:19:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:00.650797 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 438/893] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 12:19:00.653461 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dca10f-a42b-4856-bff1-1d4b647bce9b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:00.674006 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b269f13-e319-4b6a-960b-ccf2e58b9d85 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:00.770222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:00.773702 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dca10f-a42b-4856-bff1-1d4b647bce9b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:00.811625 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3744ba2-a15f-4aad-aeb1-c3a359bc8589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:00.812325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3744ba2-a15f-4aad-aeb1-c3a359bc8589 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:00.812601 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3744ba2-a15f-4aad-aeb1-c3a359bc8589 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:00.812871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3744ba2-a15f-4aad-aeb1-c3a359bc8589 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:00.814167 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3744ba2-a15f-4aad-aeb1-c3a359bc8589 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:00.814466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3744ba2-a15f-4aad-aeb1-c3a359bc8589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:00.815859 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3744ba2-a15f-4aad-aeb1-c3a359bc8589 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:00.818794 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b269f13-e319-4b6a-960b-ccf2e58b9d85 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:00.824919 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 456/894] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Jul 19 12:19:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:00.826191 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b0af3-6bf1-4f44-944c-e6c59e80ed3e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:00.826522 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b0af3-6bf1-4f44-944c-e6c59e80ed3e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:00.826946 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b0af3-6bf1-4f44-944c-e6c59e80ed3e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:00.831072 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 457/895] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:00.831769 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b0af3-6bf1-4f44-944c-e6c59e80ed3e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:00.865532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f485d-15d6-40c1-914f-8a6c10a504af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:00.866199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f485d-15d6-40c1-914f-8a6c10a504af None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:00.866483 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f485d-15d6-40c1-914f-8a6c10a504af None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:00.866777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f485d-15d6-40c1-914f-8a6c10a504af None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:00.867510 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f485d-15d6-40c1-914f-8a6c10a504af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:00.868876 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f485d-15d6-40c1-914f-8a6c10a504af None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:00.886292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 439/896] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 19 12:19:00 2022] POST /identity/v3/services => generated 241 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:19:00.887565 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce3691-4196-46dd-9d99-70808b1103e5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:00.887859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce3691-4196-46dd-9d99-70808b1103e5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:00.888186 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce3691-4196-46dd-9d99-70808b1103e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:00.917832 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-31ce3691-4196-46dd-9d99-70808b1103e5 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:00.919527 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-31ce3691-4196-46dd-9d99-70808b1103e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:00.955975 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:00.974866 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b0af3-6bf1-4f44-944c-e6c59e80ed3e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:01.020620 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb8ff8-1697-44f7-9a62-ebb984620829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:01.021430 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb8ff8-1697-44f7-9a62-ebb984620829 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:01.021704 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb8ff8-1697-44f7-9a62-ebb984620829 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:01.021972 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb8ff8-1697-44f7-9a62-ebb984620829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:01.033184 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 440/897] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:01.042647 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb8ff8-1697-44f7-9a62-ebb984620829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:01.044209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb8ff8-1697-44f7-9a62-ebb984620829 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:01.057642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce3691-4196-46dd-9d99-70808b1103e5 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:01.067819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a2cb8ff8-1697-44f7-9a62-ebb984620829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:01.067819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:01.067819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:01.067819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:01.067819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:01.067819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:01.067819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:01.067819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:01.067819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:01.067819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:01.067819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:01.067819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:01.067819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:19:01.067819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:19:01.067819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:19:01.068913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:19:01.068913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:01.068913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:01.068913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:01.068913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:01.068913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:01.068913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:01.068913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:01.068913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:01.068913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:01.068913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:01.068913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:01.068913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:01.068913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:01.068913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:01.068913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:01.068913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:01.071478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:19:01.071478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:19:01.071478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:01.071478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:01.071478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 458/898] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:01.076398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb8ff8-1697-44f7-9a62-ebb984620829 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:01.091499 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:01.188572 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb8ff8-1697-44f7-9a62-ebb984620829 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:01.193597 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce3691-4196-46dd-9d99-70808b1103e5 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:01.227887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2102c9-9480-49ad-82af-66ae4e363d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:01.228697 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2102c9-9480-49ad-82af-66ae4e363d05 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:01.229042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2102c9-9480-49ad-82af-66ae4e363d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:01.229382 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2102c9-9480-49ad-82af-66ae4e363d05 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:01.230259 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2102c9-9480-49ad-82af-66ae4e363d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:01.230645 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2102c9-9480-49ad-82af-66ae4e363d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:01.232197 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2102c9-9480-49ad-82af-66ae4e363d05 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:01.239163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307c9f5-1fcb-47ab-bfae-551c1bf05c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:01.240808 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307c9f5-1fcb-47ab-bfae-551c1bf05c82 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:01.241281 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307c9f5-1fcb-47ab-bfae-551c1bf05c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:01.241758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307c9f5-1fcb-47ab-bfae-551c1bf05c82 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:01.243188 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307c9f5-1fcb-47ab-bfae-551c1bf05c82 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:01.245067 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307c9f5-1fcb-47ab-bfae-551c1bf05c82 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:01.250304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 459/899] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:01.252009 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2102c9-9480-49ad-82af-66ae4e363d05 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:01.259504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-8307c9f5-1fcb-47ab-bfae-551c1bf05c82 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 12:19:01.259504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:01.259504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:19:01.259504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:19:01.259504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:19:01.259504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:19:01.259504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:19:01.259504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:01.259504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 12:19:01.259504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:01.259504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:19:01.259504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:01.259504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:01.259504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:01.259504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:01.259504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:01.260452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:01.260452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:01.260452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:01.260452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:01.260452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:01.260452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:01.260452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:01.260452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:19:01.260452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:19:01.260452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:19:01.260452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:19:01.260452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:01.260452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:01.260452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:01.260452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:01.260452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:01.261684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:01.261684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:01.261684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:01.261684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:01.261684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:01.261684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:01.261684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:01.261684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:01.261684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:01.261684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:01.261684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:01.261684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:19:01.261684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:01.261684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 12:19:01.261684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:01.261684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 441/900] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Jul 19 12:19:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:01.267580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307c9f5-1fcb-47ab-bfae-551c1bf05c82 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:01.289931 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:01.336201 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:01.374805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2102c9-9480-49ad-82af-66ae4e363d05 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:01.392077 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307c9f5-1fcb-47ab-bfae-551c1bf05c82 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:01.420902 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c61eb-a988-4a69-be39-7d7ac0eed947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:01.422816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c61eb-a988-4a69-be39-7d7ac0eed947 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:01.423306 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c61eb-a988-4a69-be39-7d7ac0eed947 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:01.424016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c61eb-a988-4a69-be39-7d7ac0eed947 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:01.429768 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bc39c-85d1-497f-a68c-2f8e1ccfead8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:01.430451 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bc39c-85d1-497f-a68c-2f8e1ccfead8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:01.430750 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bc39c-85d1-497f-a68c-2f8e1ccfead8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:01.431069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bc39c-85d1-497f-a68c-2f8e1ccfead8 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:01.431789 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bc39c-85d1-497f-a68c-2f8e1ccfead8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:01.432097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bc39c-85d1-497f-a68c-2f8e1ccfead8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:01.433712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2bc39c-85d1-497f-a68c-2f8e1ccfead8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:01.435229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c61eb-a988-4a69-be39-7d7ac0eed947 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:01.437482 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c61eb-a988-4a69-be39-7d7ac0eed947 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:01.440661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 442/901] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 19 12:19:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:01.447690 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bc39c-85d1-497f-a68c-2f8e1ccfead8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:01.458049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-062c61eb-a988-4a69-be39-7d7ac0eed947 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 12:19:01.458049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:01.458049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:01.458049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:01.458049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:01.458049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:01.458049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:01.458049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:01.458049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:01.458049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:01.458049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:01.458049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:01.458049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:19:01.458049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:19:01.458049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:19:01.458049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:19:01.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:01.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:01.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:19:01.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:19:01.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:19:01.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:19:01.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:01.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:01.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:01.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:01.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:01.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:01.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:01.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:01.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:01.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:01.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:01.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:01.460290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:01.460290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:01.460290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:19:01.460290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:19:01.460290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:19:01.460290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:19:01.460290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:19:01.460290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:19:01.460290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 12:19:01.460290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:01.460290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 460/902] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 19 12:19:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:01.464854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c61eb-a988-4a69-be39-7d7ac0eed947 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:01.556246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:01.574279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bc39c-85d1-497f-a68c-2f8e1ccfead8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:01.604808 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c61eb-a988-4a69-be39-7d7ac0eed947 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:01.612121 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee2d03-f82a-4b76-ac7d-c149a628c58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:01.612791 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee2d03-f82a-4b76-ac7d-c149a628c58f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:01.613068 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee2d03-f82a-4b76-ac7d-c149a628c58f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:01.613339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee2d03-f82a-4b76-ac7d-c149a628c58f None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:01.614050 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee2d03-f82a-4b76-ac7d-c149a628c58f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:01.614351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee2d03-f82a-4b76-ac7d-c149a628c58f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:01.615889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee2d03-f82a-4b76-ac7d-c149a628c58f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:01.621622 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 443/903] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 19 12:19:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:01.627611 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee2d03-f82a-4b76-ac7d-c149a628c58f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:01.651375 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa20bd0-a661-4ae9-a9e4-90d61e3fdcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:01.652795 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa20bd0-a661-4ae9-a9e4-90d61e3fdcba None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:01.653238 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa20bd0-a661-4ae9-a9e4-90d61e3fdcba None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:01.653949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa20bd0-a661-4ae9-a9e4-90d61e3fdcba None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:01.656383 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:01.658493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa20bd0-a661-4ae9-a9e4-90d61e3fdcba None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:01.659143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa20bd0-a661-4ae9-a9e4-90d61e3fdcba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:01.661831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa20bd0-a661-4ae9-a9e4-90d61e3fdcba None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:01.692654 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 461/904] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Jul 19 12:19:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:01.694489 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa20bd0-a661-4ae9-a9e4-90d61e3fdcba None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:01.754167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee2d03-f82a-4b76-ac7d-c149a628c58f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:01.795984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b721e19-9901-4695-9c98-e2846c28a7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:01.796638 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b721e19-9901-4695-9c98-e2846c28a7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:01.796933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b721e19-9901-4695-9c98-e2846c28a7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:01.797184 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b721e19-9901-4695-9c98-e2846c28a7f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:01.799137 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b721e19-9901-4695-9c98-e2846c28a7f7 None admin] RBAC: Adding query filter params (interface=public, service_id=2889d1d9ea1849ffbcb04fea3f438e93, region_id=RegionOne) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:01.799448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b721e19-9901-4695-9c98-e2846c28a7f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:01.800809 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b721e19-9901-4695-9c98-e2846c28a7f7 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:01.810061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 444/905] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Jul 19 12:19:01 2022] GET /identity/v3/endpoints?service_id=2889d1d9ea1849ffbcb04fea3f438e93&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:01.810061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f01f4-62ab-4b35-a095-fb6b7bb6b660 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:01.810061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f01f4-62ab-4b35-a095-fb6b7bb6b660 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:01.810061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f01f4-62ab-4b35-a095-fb6b7bb6b660 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:01.810061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 445/906] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:01.814776 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f01f4-62ab-4b35-a095-fb6b7bb6b660 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:01.818723 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa20bd0-a661-4ae9-a9e4-90d61e3fdcba None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:01.831116 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:01.854126 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df5379-96f8-43c7-83b7-fefc094bd398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:01.854795 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5379-96f8-43c7-83b7-fefc094bd398 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:01.855078 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5379-96f8-43c7-83b7-fefc094bd398 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:01.855350 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5379-96f8-43c7-83b7-fefc094bd398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:01.914757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:01.929344 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f01f4-62ab-4b35-a095-fb6b7bb6b660 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:01.930073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df5379-96f8-43c7-83b7-fefc094bd398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:01.931552 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df5379-96f8-43c7-83b7-fefc094bd398 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:01.967017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd61e0-46c4-4072-90bf-bbf54cdaf162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:01.967745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd61e0-46c4-4072-90bf-bbf54cdaf162 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:01.968031 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd61e0-46c4-4072-90bf-bbf54cdaf162 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:01.968342 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd61e0-46c4-4072-90bf-bbf54cdaf162 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:01.969025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd61e0-46c4-4072-90bf-bbf54cdaf162 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:01.970455 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd61e0-46c4-4072-90bf-bbf54cdaf162 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:01.976779 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 446/907] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Jul 19 12:19:01 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:19:01.984760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675a32d-9a80-45b4-a132-4e8b4d712415 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:01.985598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675a32d-9a80-45b4-a132-4e8b4d712415 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:01.985843 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675a32d-9a80-45b4-a132-4e8b4d712415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:02.012092 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8675a32d-9a80-45b4-a132-4e8b4d712415 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:02.013359 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8675a32d-9a80-45b4-a132-4e8b4d712415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:02.048251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 462/908] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:19:01 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 12:19:02.054373 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df5379-96f8-43c7-83b7-fefc094bd398 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:02.122695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 447/909] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:02.150388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675a32d-9a80-45b4-a132-4e8b4d712415 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:02.161863 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:02.180331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:02.200634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df5379-96f8-43c7-83b7-fefc094bd398 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:02.247017 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a902f-44af-4cdd-a996-9f3cf40b337a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:02.247846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a902f-44af-4cdd-a996-9f3cf40b337a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:02.248128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a902f-44af-4cdd-a996-9f3cf40b337a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:02.248400 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a902f-44af-4cdd-a996-9f3cf40b337a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:02.260073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a902f-44af-4cdd-a996-9f3cf40b337a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:02.261507 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a902f-44af-4cdd-a996-9f3cf40b337a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:02.275797 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675a32d-9a80-45b4-a132-4e8b4d712415 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:02.281317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-670a902f-44af-4cdd-a996-9f3cf40b337a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:02.281317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:02.281317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:02.281317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:02.281317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:02.281317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:02.281317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:02.281317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:02.281317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:02.281317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:02.281317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:02.281317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:02.281317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:19:02.281317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:19:02.281317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:19:02.282288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:19:02.282288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:02.282288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:02.282288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:02.282288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:02.282288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:02.282288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:02.282288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:02.282288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:02.282288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:02.282288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:02.282288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:02.282288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:02.282288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:02.282288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:02.282288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:02.282288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:02.283274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:19:02.283274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:19:02.283274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:02.283274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:02.283916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 463/910] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:02.289277 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a902f-44af-4cdd-a996-9f3cf40b337a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:02.315752 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ef6f5-6922-46af-a77b-305864d70485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:02.317034 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef6f5-6922-46af-a77b-305864d70485 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:02.317325 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef6f5-6922-46af-a77b-305864d70485 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:02.317600 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef6f5-6922-46af-a77b-305864d70485 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:02.318554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ef6f5-6922-46af-a77b-305864d70485 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:02.320440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ef6f5-6922-46af-a77b-305864d70485 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:02.335252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-b74ef6f5-6922-46af-a77b-305864d70485 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 12:19:02.335252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:02.335252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:19:02.335252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:19:02.335252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:19:02.335252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:19:02.335252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:19:02.335252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:02.335252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 12:19:02.335252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:02.335252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:19:02.335252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:02.335252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:02.335252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:02.335252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:02.335252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:02.335252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:02.336545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:02.336545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:02.336545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:02.336545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:02.336545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:02.336545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:02.336545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:19:02.336545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:19:02.336545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:19:02.336545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:19:02.336545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:02.336545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:02.336545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:02.336545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:02.336545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:02.336545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:02.337423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:02.337423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:02.337423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:02.337423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:02.337423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:02.337423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:02.337423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:02.337423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:02.337423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:02.337423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:02.337423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:19:02.337423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:02.337423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 12:19:02.337423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:02.337423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 448/911] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:19:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:02.342670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ef6f5-6922-46af-a77b-305864d70485 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:02.421926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:02.425359 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a902f-44af-4cdd-a996-9f3cf40b337a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:02.458617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ef6f5-6922-46af-a77b-305864d70485 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:02.476739 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6a567-8d9e-4b82-b221-e569ef2cf66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:02.477419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6a567-8d9e-4b82-b221-e569ef2cf66c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:02.477699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6a567-8d9e-4b82-b221-e569ef2cf66c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:02.477971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6a567-8d9e-4b82-b221-e569ef2cf66c None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:02.478696 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6a567-8d9e-4b82-b221-e569ef2cf66c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:02.479035 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6a567-8d9e-4b82-b221-e569ef2cf66c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:02.481046 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6a567-8d9e-4b82-b221-e569ef2cf66c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:02.493081 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:02.499449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 464/912] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:02.503981 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7140b4-6c71-40d5-8bf3-a0d01424bef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:02.504778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6a567-8d9e-4b82-b221-e569ef2cf66c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:02.505135 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7140b4-6c71-40d5-8bf3-a0d01424bef1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:02.505631 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7140b4-6c71-40d5-8bf3-a0d01424bef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:02.506114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7140b4-6c71-40d5-8bf3-a0d01424bef1 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:02.507064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7140b4-6c71-40d5-8bf3-a0d01424bef1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:02.507587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7140b4-6c71-40d5-8bf3-a0d01424bef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:02.509168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7140b4-6c71-40d5-8bf3-a0d01424bef1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:02.515177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 449/913] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:19:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:02.521100 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7140b4-6c71-40d5-8bf3-a0d01424bef1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:02.642534 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6a567-8d9e-4b82-b221-e569ef2cf66c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:02.657308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7140b4-6c71-40d5-8bf3-a0d01424bef1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:02.681876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be6d51-b003-4279-87f4-32541599c6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:02.683186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be6d51-b003-4279-87f4-32541599c6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:02.683685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be6d51-b003-4279-87f4-32541599c6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:02.684155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be6d51-b003-4279-87f4-32541599c6b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:02.694763 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b5a6a-cacb-4658-8dd7-39935da9a7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:02.695471 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b5a6a-cacb-4658-8dd7-39935da9a7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:02.695755 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b5a6a-cacb-4658-8dd7-39935da9a7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:02.696029 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b5a6a-cacb-4658-8dd7-39935da9a7c7 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:02.696777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be6d51-b003-4279-87f4-32541599c6b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:02.696905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b5a6a-cacb-4658-8dd7-39935da9a7c7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:02.697077 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b5a6a-cacb-4658-8dd7-39935da9a7c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:02.698442 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b5a6a-cacb-4658-8dd7-39935da9a7c7 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:02.698931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be6d51-b003-4279-87f4-32541599c6b7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:02.699867 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:02.709607 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 450/914] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Jul 19 12:19:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:02.711094 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b5a6a-cacb-4658-8dd7-39935da9a7c7 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:02.721419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-88be6d51-b003-4279-87f4-32541599c6b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:19:02.721419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:02.721419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:02.721419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:02.721419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:02.721419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:02.721419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:02.721419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:02.721419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:02.721419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:02.721419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:02.721419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:02.721419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:19:02.721419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:19:02.721419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:19:02.722339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:19:02.722339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:02.722339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:02.722339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:02.722339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:02.722339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:02.722339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:02.722339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:02.722339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:02.722339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:02.722339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:02.722339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:02.722339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:02.722339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:02.722339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:02.722339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:02.722339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:02.723260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:19:02.723260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:19:02.723260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:19:02.723260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:19:02.723260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:19:02.723260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:19:02.723260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:19:02.723260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:02.730237 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 465/915] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:19:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:02.731548 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be6d51-b003-4279-87f4-32541599c6b7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:02.797009 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:02.824179 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b5a6a-cacb-4658-8dd7-39935da9a7c7 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:02.842767 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be6d51-b003-4279-87f4-32541599c6b7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:02.863276 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58293cb6-a8bb-4cfd-90a9-8f046ed29b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:02.863945 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58293cb6-a8bb-4cfd-90a9-8f046ed29b02 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:02.864230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58293cb6-a8bb-4cfd-90a9-8f046ed29b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:02.864507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58293cb6-a8bb-4cfd-90a9-8f046ed29b02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:02.865249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58293cb6-a8bb-4cfd-90a9-8f046ed29b02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:02.866617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58293cb6-a8bb-4cfd-90a9-8f046ed29b02 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:02.883293 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09abd89-9539-48f4-a8b7-06edf7c1449b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:02.884495 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09abd89-9539-48f4-a8b7-06edf7c1449b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:02.885019 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09abd89-9539-48f4-a8b7-06edf7c1449b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:02.885476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09abd89-9539-48f4-a8b7-06edf7c1449b None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:02.886438 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09abd89-9539-48f4-a8b7-06edf7c1449b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:02.886948 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09abd89-9539-48f4-a8b7-06edf7c1449b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:02.888598 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09abd89-9539-48f4-a8b7-06edf7c1449b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:02.890814 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 451/916] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Jul 19 12:19:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:19:02.907497 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 466/917] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:19:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:02.914486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58293cb6-a8bb-4cfd-90a9-8f046ed29b02 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:02.992155 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:03.047232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784542f6-1593-4718-932d-acda8a507f6c None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:03.047432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58293cb6-a8bb-4cfd-90a9-8f046ed29b02 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:03.047858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784542f6-1593-4718-932d-acda8a507f6c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:03.049692 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784542f6-1593-4718-932d-acda8a507f6c None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:03.051408 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 467/918] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:03.056809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f69c5e-a381-43b2-9a9d-12ba41ee188e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:03.057090 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f69c5e-a381-43b2-9a9d-12ba41ee188e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:03.057359 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f69c5e-a381-43b2-9a9d-12ba41ee188e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:03.080786 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-89f69c5e-a381-43b2-9a9d-12ba41ee188e None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:03.081990 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-89f69c5e-a381-43b2-9a9d-12ba41ee188e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:03.085882 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fee3b-d6d3-4615-93b0-e51e7ea999a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:03.086781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fee3b-d6d3-4615-93b0-e51e7ea999a9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:03.087268 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fee3b-d6d3-4615-93b0-e51e7ea999a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:03.087726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fee3b-d6d3-4615-93b0-e51e7ea999a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:03.088732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fee3b-d6d3-4615-93b0-e51e7ea999a9 None admin] RBAC: Adding query filter params (role.id=8339ef0a95734b5e815beb576a29d631, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=18030043de1942779baf3ad94aec4071) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:03.089218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fee3b-d6d3-4615-93b0-e51e7ea999a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:03.090854 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fee3b-d6d3-4615-93b0-e51e7ea999a9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:03.097147 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 452/919] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:19:02 2022] GET /identity/v3/role_assignments?user.id=18030043de1942779baf3ad94aec4071&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=8339ef0a95734b5e815beb576a29d631 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:03.176610 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 468/920] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:03.200452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fee3b-d6d3-4615-93b0-e51e7ea999a9 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:03.311518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fee3b-d6d3-4615-93b0-e51e7ea999a9 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:03.325939 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:03.348845 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109dfc2-13c7-479d-8a9f-97673008098d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:03.349662 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109dfc2-13c7-479d-8a9f-97673008098d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:03.349946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109dfc2-13c7-479d-8a9f-97673008098d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:03.350221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109dfc2-13c7-479d-8a9f-97673008098d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:03.350907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109dfc2-13c7-479d-8a9f-97673008098d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:03.352266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109dfc2-13c7-479d-8a9f-97673008098d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:03.365139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-c109dfc2-13c7-479d-8a9f-97673008098d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 12:19:03.365139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:03.365139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:19:03.365139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:19:03.365139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:19:03.365139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:19:03.365139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:19:03.365139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:03.365139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 12:19:03.365139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:03.365139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:19:03.365139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:03.365139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:03.365139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:03.365139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:03.365139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:03.365139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:03.366140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:03.366140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:03.366140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:03.366140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:03.366140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:03.366140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:03.366140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:19:03.366140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:19:03.366140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:19:03.366140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:19:03.366140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:03.366140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:03.366140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:03.366140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:03.366140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:03.366140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:03.367040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:03.367040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:03.367040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:03.367040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:03.367040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:03.367040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:03.367040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:03.367040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:03.367040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:03.367040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:03.367040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:19:03.367040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:03.367040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 12:19:03.367040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:03.370843 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 453/921] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 19 12:19:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:03.372805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f69c5e-a381-43b2-9a9d-12ba41ee188e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:03.427949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:03.483878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f69c5e-a381-43b2-9a9d-12ba41ee188e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:03.521704 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff73e35-6c33-46fb-993f-9eb87c205819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:03.522532 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff73e35-6c33-46fb-993f-9eb87c205819 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:03.522838 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff73e35-6c33-46fb-993f-9eb87c205819 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:03.523111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff73e35-6c33-46fb-993f-9eb87c205819 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:03.523815 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff73e35-6c33-46fb-993f-9eb87c205819 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:03.524117 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff73e35-6c33-46fb-993f-9eb87c205819 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:03.525484 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff73e35-6c33-46fb-993f-9eb87c205819 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:03.530905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 469/922] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 19 12:19:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:03.536572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109dfc2-13c7-479d-8a9f-97673008098d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:03.643397 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109dfc2-13c7-479d-8a9f-97673008098d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:03.679056 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817482ee-8e52-41b2-ae8b-f4216d24b7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:03.679726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817482ee-8e52-41b2-ae8b-f4216d24b7fb None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:03.680012 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817482ee-8e52-41b2-ae8b-f4216d24b7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:03.680291 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817482ee-8e52-41b2-ae8b-f4216d24b7fb None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:03.681008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817482ee-8e52-41b2-ae8b-f4216d24b7fb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:03.681318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817482ee-8e52-41b2-ae8b-f4216d24b7fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:03.682689 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817482ee-8e52-41b2-ae8b-f4216d24b7fb None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:03.693849 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 454/923] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 19 12:19:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:03.695307 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff73e35-6c33-46fb-993f-9eb87c205819 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:03.807117 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff73e35-6c33-46fb-993f-9eb87c205819 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:03.822956 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:03.846285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542561ab-89bd-4c22-b262-e233f40ba0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:03.846970 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542561ab-89bd-4c22-b262-e233f40ba0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:03.847399 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542561ab-89bd-4c22-b262-e233f40ba0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:03.847678 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542561ab-89bd-4c22-b262-e233f40ba0d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:03.848469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542561ab-89bd-4c22-b262-e233f40ba0d0 None admin] RBAC: Adding query filter params (interface=public, service_id=952338fecc984cc88e011e2ce98cf073, region_id=RegionOne) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:03.848777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542561ab-89bd-4c22-b262-e233f40ba0d0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:03.850131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542561ab-89bd-4c22-b262-e233f40ba0d0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:03.855783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 470/924] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Jul 19 12:19:03 2022] GET /identity/v3/endpoints?service_id=952338fecc984cc88e011e2ce98cf073&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:03.861957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817482ee-8e52-41b2-ae8b-f4216d24b7fb None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:03.915168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:03.966683 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817482ee-8e52-41b2-ae8b-f4216d24b7fb None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:04.002459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce11446-7f13-4bcd-af6c-b72655d74491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:04.003162 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce11446-7f13-4bcd-af6c-b72655d74491 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:04.003445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce11446-7f13-4bcd-af6c-b72655d74491 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:04.003720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce11446-7f13-4bcd-af6c-b72655d74491 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:04.004404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce11446-7f13-4bcd-af6c-b72655d74491 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:04.005779 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce11446-7f13-4bcd-af6c-b72655d74491 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:04.018007 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 455/925] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Jul 19 12:19:03 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:19:04.158420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a528f3-7986-4e9c-80f6-5c53f6e4e125 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:04.158420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a528f3-7986-4e9c-80f6-5c53f6e4e125 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:04.158420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a528f3-7986-4e9c-80f6-5c53f6e4e125 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:04.159695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 471/926] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:04.165051 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaca87e-e83a-41c7-acf1-d69b5cfd77a2 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:04.165664 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaca87e-e83a-41c7-acf1-d69b5cfd77a2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:04.166120 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaca87e-e83a-41c7-acf1-d69b5cfd77a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:04.185414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-fdaca87e-e83a-41c7-acf1-d69b5cfd77a2 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:04.186620 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fdaca87e-e83a-41c7-acf1-d69b5cfd77a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:04.261580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 456/927] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:04.285081 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a528f3-7986-4e9c-80f6-5c53f6e4e125 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:04.395730 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a528f3-7986-4e9c-80f6-5c53f6e4e125 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:04.432337 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3f5d3-7fe7-4541-88c1-c0624041bb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:04.433453 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3f5d3-7fe7-4541-88c1-c0624041bb06 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:04.433931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3f5d3-7fe7-4541-88c1-c0624041bb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:04.434419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3f5d3-7fe7-4541-88c1-c0624041bb06 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:04.435297 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3f5d3-7fe7-4541-88c1-c0624041bb06 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:04.436847 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3f5d3-7fe7-4541-88c1-c0624041bb06 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:04.450796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d7d3f5d3-7fe7-4541-88c1-c0624041bb06 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 12:19:04.450796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:04.450796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:19:04.450796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:19:04.450796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:19:04.450796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:19:04.450796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:19:04.450796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:04.450796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 12:19:04.450796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:04.450796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:19:04.450796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:04.450796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:04.450796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:04.450796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:04.450796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:04.451762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:04.451762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:04.451762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:04.451762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:04.451762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:04.451762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:04.451762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:04.451762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:19:04.451762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:19:04.451762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:19:04.451762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:19:04.451762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:04.451762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:04.451762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:04.451762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:04.451762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:04.452586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:04.452586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:04.452586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:04.452586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:04.452586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:04.452586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:04.452586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:04.452586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:04.452586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:04.452586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:04.452586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:04.452586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:19:04.452586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:04.452586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 12:19:04.452586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:04.456089 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 472/928] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Jul 19 12:19:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:04.464626 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaca87e-e83a-41c7-acf1-d69b5cfd77a2 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:04.507073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:04.566911 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaca87e-e83a-41c7-acf1-d69b5cfd77a2 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:04.607595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092648a0-3de8-4cb2-888d-210fc1eb4dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:04.608275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092648a0-3de8-4cb2-888d-210fc1eb4dff None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:04.608560 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092648a0-3de8-4cb2-888d-210fc1eb4dff None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:04.608838 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092648a0-3de8-4cb2-888d-210fc1eb4dff None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:04.609550 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092648a0-3de8-4cb2-888d-210fc1eb4dff None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:04.609852 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092648a0-3de8-4cb2-888d-210fc1eb4dff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:04.611467 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092648a0-3de8-4cb2-888d-210fc1eb4dff None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:04.616922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 457/929] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 19 12:19:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:04.622168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3f5d3-7fe7-4541-88c1-c0624041bb06 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:04.671117 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:04.734853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3f5d3-7fe7-4541-88c1-c0624041bb06 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:04.771135 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54a02e-d886-4882-adb8-505ae11d934b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:04.771803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54a02e-d886-4882-adb8-505ae11d934b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:04.772074 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54a02e-d886-4882-adb8-505ae11d934b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:04.772341 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54a02e-d886-4882-adb8-505ae11d934b None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:04.773043 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54a02e-d886-4882-adb8-505ae11d934b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:04.773341 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54a02e-d886-4882-adb8-505ae11d934b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:04.774692 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54a02e-d886-4882-adb8-505ae11d934b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:04.780250 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 473/930] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 19 12:19:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:04.786097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092648a0-3de8-4cb2-888d-210fc1eb4dff None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:04.892032 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:04.895149 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092648a0-3de8-4cb2-888d-210fc1eb4dff None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:04.935388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0a143-0e65-4f03-9a48-97d2984cb86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:04.936056 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0a143-0e65-4f03-9a48-97d2984cb86e None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:04.936339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0a143-0e65-4f03-9a48-97d2984cb86e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:04.936612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0a143-0e65-4f03-9a48-97d2984cb86e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:04.937371 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0a143-0e65-4f03-9a48-97d2984cb86e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:04.939736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0a143-0e65-4f03-9a48-97d2984cb86e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:04.961449 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 458/931] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Jul 19 12:19:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:19:05.237959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c10a43-9efc-4624-83dd-12c50d45659d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:05.238586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c10a43-9efc-4624-83dd-12c50d45659d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:05.239112 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c10a43-9efc-4624-83dd-12c50d45659d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:05.239971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f9161-eb29-413b-8edd-ca9231e291ea None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:05.240263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f9161-eb29-413b-8edd-ca9231e291ea None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:05.240541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f9161-eb29-413b-8edd-ca9231e291ea None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:05.241676 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 474/932] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:05.242127 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 459/933] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:05.247151 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10112240-dd3e-4753-8fc4-8d55228c20e8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:05.247438 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafe3a0-5269-4cd2-a752-096e552746ad None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:05.247727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafe3a0-5269-4cd2-a752-096e552746ad None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:05.248003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafe3a0-5269-4cd2-a752-096e552746ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:05.248348 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10112240-dd3e-4753-8fc4-8d55228c20e8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:05.248821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10112240-dd3e-4753-8fc4-8d55228c20e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:05.266876 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-beafe3a0-5269-4cd2-a752-096e552746ad None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:05.268414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-beafe3a0-5269-4cd2-a752-096e552746ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:05.270151 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-10112240-dd3e-4753-8fc4-8d55228c20e8 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:05.271352 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-10112240-dd3e-4753-8fc4-8d55228c20e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:05.356177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 475/934] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:05.362503 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 460/935] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:05.376350 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10112240-dd3e-4753-8fc4-8d55228c20e8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:05.386654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafe3a0-5269-4cd2-a752-096e552746ad None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:05.411231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:05.480119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:05.499100 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafe3a0-5269-4cd2-a752-096e552746ad None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:05.504720 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10112240-dd3e-4753-8fc4-8d55228c20e8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:05.536679 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f8b05-e461-47cf-99c4-fa2c353a17ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:05.537739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f8b05-e461-47cf-99c4-fa2c353a17ca None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:05.538304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f8b05-e461-47cf-99c4-fa2c353a17ca None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:05.538895 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f8b05-e461-47cf-99c4-fa2c353a17ca None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:05.539821 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f8b05-e461-47cf-99c4-fa2c353a17ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:05.541457 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f8b05-e461-47cf-99c4-fa2c353a17ca None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:05.543070 dv-cinder-820994-4-smb devstack@keystone.service[80230]: WARNING keystone.server.flask.common [None req-356f8b05-e461-47cf-99c4-fa2c353a17ca None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 19 12:19:05.547095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e8f8-e144-42f5-9867-a5ef6b8b1993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:05.548457 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e8f8-e144-42f5-9867-a5ef6b8b1993 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:05.549043 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e8f8-e144-42f5-9867-a5ef6b8b1993 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:05.549321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e8f8-e144-42f5-9867-a5ef6b8b1993 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:05.561500 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2e8f8-e144-42f5-9867-a5ef6b8b1993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:19:05.563520 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.sql.core [None req-356f8b05-e461-47cf-99c4-fa2c353a17ca None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 12:19:05.563520 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 12:19:05.563520 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [parameters: {'id': '4591c5d7deab433f904d5172c7f781f0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 19 12:19:05.563520 dv-cinder-820994-4-smb devstack@keystone.service[80230]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80230) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 12:19:05.569987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-1ff2e8f8-e144-42f5-9867-a5ef6b8b1993 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 12:19:05.569987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:05.569987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:05.569987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:05.569987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:05.569987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:05.569987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:05.569987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:05.569987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:05.569987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:05.569987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:05.569987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:05.569987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:19:05.569987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:19:05.569987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:19:05.569987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:19:05.570930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:19:05.570930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:19:05.570930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:19:05.570930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:19:05.570930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:05.570930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:05.570930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:05.570930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:05.570930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:05.570930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:05.570930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:05.570930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:05.570930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:05.570930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:05.570930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:05.570930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:05.571803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:05.571803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:05.571803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:05.571803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:05.571803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:19:05.571803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:19:05.571803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:19:05.571803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:19:05.571803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:19:05.571803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:19:05.571803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 12:19:05.571803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:05.576177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 476/936] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Jul 19 12:19:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:05.577034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e8f8-e144-42f5-9867-a5ef6b8b1993 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:05.586599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-356f8b05-e461-47cf-99c4-fa2c353a17ca None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4591c5d7deab433f904d5172c7f781f0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4591c5d7deab433f904d5172c7f781f0. Jul 19 12:19:05.586599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:05.586599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 12:19:05.586599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 12:19:05.586599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 12:19:05.586599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 12:19:05.586599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 12:19:05.586599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 12:19:05.586599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 12:19:05.586599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application conn.query(q) Jul 19 12:19:05.586599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 12:19:05.586599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 12:19:05.586599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 12:19:05.587874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application result.read() Jul 19 12:19:05.587874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 12:19:05.587874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 12:19:05.587874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 12:19:05.587874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 12:19:05.587874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 12:19:05.587874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 12:19:05.587874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 12:19:05.587874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 12:19:05.587874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 12:19:05.587874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:05.587874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 12:19:05.587874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:05.587874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:05.587874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 12:19:05.587874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 12:19:05.587874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 19 12:19:05.587874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 19 12:19:05.588825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 12:19:05.588825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application next(self.gen) Jul 19 12:19:05.588825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 12:19:05.588825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application yield resource Jul 19 12:19:05.588825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 12:19:05.588825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application next(self.gen) Jul 19 12:19:05.588825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 12:19:05.588825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 12:19:05.588825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 12:19:05.588825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 12:19:05.588825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 12:19:05.588825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise self.value Jul 19 12:19:05.588825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 12:19:05.588825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 12:19:05.588825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 12:19:05.588825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application session.commit() Jul 19 12:19:05.588825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 12:19:05.589726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 12:19:05.589726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 12:19:05.589726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 12:19:05.589726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 12:19:05.589726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self.session.flush() Jul 19 12:19:05.589726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 12:19:05.589726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 12:19:05.589726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 12:19:05.589726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 12:19:05.589726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 12:19:05.589726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application compat.raise_( Jul 19 12:19:05.589726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 12:19:05.589726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception Jul 19 12:19:05.589726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 12:19:05.589726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 12:19:05.589726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 12:19:05.589726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 12:19:05.590623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 12:19:05.590623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 12:19:05.590623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 12:19:05.590623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 12:19:05.590623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 19 12:19:05.590623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 19 12:19:05.590623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 12:19:05.590623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 12:19:05.590623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 12:19:05.590623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 12:19:05.590623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 12:19:05.590623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 12:19:05.590623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 12:19:05.590623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 12:19:05.590623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 12:19:05.593163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 12:19:05.593163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 12:19:05.593163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception Jul 19 12:19:05.593163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 12:19:05.593163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 12:19:05.593163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 12:19:05.593163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 12:19:05.593163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 12:19:05.593163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 12:19:05.593163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 12:19:05.593163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application conn.query(q) Jul 19 12:19:05.593163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 12:19:05.593163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 12:19:05.593163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 12:19:05.593163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application result.read() Jul 19 12:19:05.593163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 12:19:05.593163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 12:19:05.595386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 12:19:05.595386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 12:19:05.595386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 12:19:05.595386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 12:19:05.595386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 12:19:05.595386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 12:19:05.595386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 12:19:05.595386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 12:19:05.595386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [parameters: {'id': '4591c5d7deab433f904d5172c7f781f0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 19 12:19:05.595386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 12:19:05.595386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:05.595386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:19:05.595386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:05.595386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:05.595386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 19 12:19:05.597249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 19 12:19:05.597249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 12:19:05.597249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 12:19:05.597249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 19 12:19:05.597249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:05.597249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:19:05.597249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:05.597249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:05.597249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:05.597249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:05.597249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:05.597249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:05.597249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:05.597249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:05.597249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:05.597249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:05.597249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:05.599440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:05.599440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 19 12:19:05.599440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 19 12:19:05.599440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:05.599440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:05.599440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 19 12:19:05.599440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 19 12:19:05.599440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4591c5d7deab433f904d5172c7f781f0. Jul 19 12:19:05.599440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:05.599440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 461/937] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Jul 19 12:19:05 2022] POST /identity/v3/projects => generated 262 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:05.607141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f8b05-e461-47cf-99c4-fa2c353a17ca None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:05.694221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:05.705217 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e8f8-e144-42f5-9867-a5ef6b8b1993 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:05.746908 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f4d9c-efea-435f-ba6c-307365a1269a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:05.748580 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f4d9c-efea-435f-ba6c-307365a1269a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:05.749069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f4d9c-efea-435f-ba6c-307365a1269a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:05.749624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f4d9c-efea-435f-ba6c-307365a1269a None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:05.750454 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f8b05-e461-47cf-99c4-fa2c353a17ca None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:05.750867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f4d9c-efea-435f-ba6c-307365a1269a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:05.751379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f4d9c-efea-435f-ba6c-307365a1269a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:05.754184 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f4d9c-efea-435f-ba6c-307365a1269a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:05.765754 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 477/938] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Jul 19 12:19:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:05.772047 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f4d9c-efea-435f-ba6c-307365a1269a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:05.799474 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17348bc7-36ca-4fec-ab08-766479c439ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:05.801180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17348bc7-36ca-4fec-ab08-766479c439ad None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:05.801616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17348bc7-36ca-4fec-ab08-766479c439ad None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:05.802055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17348bc7-36ca-4fec-ab08-766479c439ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:05.811860 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17348bc7-36ca-4fec-ab08-766479c439ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:05.814472 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17348bc7-36ca-4fec-ab08-766479c439ad None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:05.832928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-17348bc7-36ca-4fec-ab08-766479c439ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:19:05.832928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:05.832928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:05.832928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:05.832928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:05.832928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:05.832928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:05.832928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:05.832928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:05.832928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:05.832928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:05.832928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:05.832928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:19:05.832928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:19:05.832928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:19:05.834059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:19:05.834059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:05.834059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:05.834059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:05.834059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:05.834059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:05.834059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:05.834059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:05.834059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:05.834059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:05.834059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:05.834059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:05.834059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:05.834059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:05.834059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:05.834059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:05.834059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:05.834937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:19:05.834937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:19:05.834937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:19:05.834937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:19:05.834937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:19:05.834937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:19:05.834937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:19:05.834937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:05.840286 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 462/939] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:19:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:05.841315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17348bc7-36ca-4fec-ab08-766479c439ad None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:05.845052 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:05.911788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f4d9c-efea-435f-ba6c-307365a1269a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:05.951319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8ded8-1b90-4506-a5f4-803b01179985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:05.952187 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8ded8-1b90-4506-a5f4-803b01179985 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:05.952540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8ded8-1b90-4506-a5f4-803b01179985 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:05.952901 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8ded8-1b90-4506-a5f4-803b01179985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:05.958049 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17348bc7-36ca-4fec-ab08-766479c439ad None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:05.965712 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8ded8-1b90-4506-a5f4-803b01179985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:05.967390 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8ded8-1b90-4506-a5f4-803b01179985 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:05.986685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-73a8ded8-1b90-4506-a5f4-803b01179985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:05.986685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:05.986685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:05.986685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:05.986685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:05.986685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:05.986685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:05.986685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:05.986685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:05.986685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:05.986685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:05.986685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:05.986685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:19:05.986685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:19:05.986685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:19:05.987634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:19:05.987634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:05.987634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:05.987634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:05.987634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:05.987634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:05.987634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:05.987634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:05.987634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:05.987634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:05.987634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:05.987634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:05.987634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:05.987634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:05.987634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:05.987634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:05.987634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:05.988501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:19:05.988501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:19:05.988501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:05.988501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:05.992911 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 478/940] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:05.993821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8ded8-1b90-4506-a5f4-803b01179985 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:06.002014 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58dae2-acab-44fa-b4e3-a6dc8f749b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:06.002952 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58dae2-acab-44fa-b4e3-a6dc8f749b1d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:06.003412 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58dae2-acab-44fa-b4e3-a6dc8f749b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:06.003883 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58dae2-acab-44fa-b4e3-a6dc8f749b1d None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:06.004843 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:06.005723 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58dae2-acab-44fa-b4e3-a6dc8f749b1d None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:06.006205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58dae2-acab-44fa-b4e3-a6dc8f749b1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:06.008782 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58dae2-acab-44fa-b4e3-a6dc8f749b1d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:06.043164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 463/941] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 19 12:19:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:06.119504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8ded8-1b90-4506-a5f4-803b01179985 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:06.161531 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b91e8e-adff-4032-8ecf-d1273dbf85d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:06.162207 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b91e8e-adff-4032-8ecf-d1273dbf85d1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:06.162481 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b91e8e-adff-4032-8ecf-d1273dbf85d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:06.162769 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b91e8e-adff-4032-8ecf-d1273dbf85d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:06.163489 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b91e8e-adff-4032-8ecf-d1273dbf85d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:06.163785 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b91e8e-adff-4032-8ecf-d1273dbf85d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:06.165156 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b91e8e-adff-4032-8ecf-d1273dbf85d1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:06.179734 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 479/942] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:06.188703 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58dae2-acab-44fa-b4e3-a6dc8f749b1d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:06.189595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dd7b4-b324-4ba5-aaed-40115891868d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:06.189895 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dd7b4-b324-4ba5-aaed-40115891868d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:06.190173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dd7b4-b324-4ba5-aaed-40115891868d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:06.195887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 480/943] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:06.197793 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade179-065e-4284-ab69-17656dba6e7f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:06.198076 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade179-065e-4284-ab69-17656dba6e7f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:06.198354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade179-065e-4284-ab69-17656dba6e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:06.217182 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-73ade179-065e-4284-ab69-17656dba6e7f None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:06.218437 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-73ade179-065e-4284-ab69-17656dba6e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:06.284705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:06.294999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:06.305976 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 481/944] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 12:19:06.329253 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ade179-065e-4284-ab69-17656dba6e7f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:06.338653 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58dae2-acab-44fa-b4e3-a6dc8f749b1d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:06.387729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975dfc4-5d68-45be-8449-e55f633c8cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:06.389916 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975dfc4-5d68-45be-8449-e55f633c8cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:06.390570 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975dfc4-5d68-45be-8449-e55f633c8cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:06.391133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975dfc4-5d68-45be-8449-e55f633c8cc4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:06.403143 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975dfc4-5d68-45be-8449-e55f633c8cc4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:06.405350 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975dfc4-5d68-45be-8449-e55f633c8cc4 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:06.428097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-7975dfc4-5d68-45be-8449-e55f633c8cc4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 12:19:06.428097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:06.428097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:06.428097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:06.428097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:06.428097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:06.428097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:06.428097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:06.428097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:06.428097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:06.428097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:06.428097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:06.428097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:19:06.428097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:19:06.428097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:19:06.428097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:19:06.429327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:06.429327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:06.429327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:19:06.429327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:19:06.429327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:19:06.429327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:19:06.429327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:06.429327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:06.429327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:06.429327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:06.429327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:06.429327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:06.429327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:06.429327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:06.429327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:06.429327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:06.429327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:06.429327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:06.430533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:06.430533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:06.430533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:19:06.430533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:19:06.430533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:19:06.430533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:19:06.430533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:19:06.430533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:19:06.430533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 12:19:06.430533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:06.432298 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 464/945] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 19 12:19:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:06.437569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975dfc4-5d68-45be-8449-e55f633c8cc4 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:06.459043 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ade179-065e-4284-ab69-17656dba6e7f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:06.498973 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec645a2-aa48-484e-a54a-7769e368b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:06.499793 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec645a2-aa48-484e-a54a-7769e368b4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:06.500080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec645a2-aa48-484e-a54a-7769e368b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:06.500468 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec645a2-aa48-484e-a54a-7769e368b4e4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:06.501735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec645a2-aa48-484e-a54a-7769e368b4e4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:06.503235 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec645a2-aa48-484e-a54a-7769e368b4e4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:06.515651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6ec645a2-aa48-484e-a54a-7769e368b4e4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 12:19:06.515651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:06.515651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:19:06.515651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:19:06.515651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:19:06.515651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:19:06.515651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:19:06.515651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:06.515651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 12:19:06.515651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:06.515651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:19:06.515651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:06.515651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:06.515651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:06.515651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:06.515651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:06.515651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:06.517134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:06.517134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:06.517134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:06.517134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:06.517134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:06.517134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:06.517134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:19:06.517134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:19:06.517134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:19:06.517134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:19:06.517134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:06.517134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:06.517134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:06.517134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:06.517134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:06.517134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:06.523130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:06.523130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:06.523130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:06.523130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:06.523130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:06.523130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:06.523130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:06.523130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:06.523130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:06.523130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:06.523130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:19:06.523130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:06.523130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 12:19:06.523130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:06.523130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 482/946] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 19 12:19:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:06.525824 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec645a2-aa48-484e-a54a-7769e368b4e4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:06.567704 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975dfc4-5d68-45be-8449-e55f633c8cc4 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:06.597750 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:06.605655 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:06.610632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120a3f9-c4f1-4700-92af-77dd74513c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:06.611457 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120a3f9-c4f1-4700-92af-77dd74513c83 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:06.611839 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120a3f9-c4f1-4700-92af-77dd74513c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:06.612218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120a3f9-c4f1-4700-92af-77dd74513c83 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:06.613169 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120a3f9-c4f1-4700-92af-77dd74513c83 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:06.613486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120a3f9-c4f1-4700-92af-77dd74513c83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:06.615231 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120a3f9-c4f1-4700-92af-77dd74513c83 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:06.638318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 465/947] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Jul 19 12:19:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:06.639540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120a3f9-c4f1-4700-92af-77dd74513c83 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:06.657506 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec645a2-aa48-484e-a54a-7769e368b4e4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:06.694852 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fbd69-3b17-4750-8bb6-80ac4af6dab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:06.696406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fbd69-3b17-4750-8bb6-80ac4af6dab8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:06.696894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fbd69-3b17-4750-8bb6-80ac4af6dab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:06.697370 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fbd69-3b17-4750-8bb6-80ac4af6dab8 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:06.698311 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fbd69-3b17-4750-8bb6-80ac4af6dab8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:06.698849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fbd69-3b17-4750-8bb6-80ac4af6dab8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:06.700541 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fbd69-3b17-4750-8bb6-80ac4af6dab8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:06.712242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 483/948] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 19 12:19:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:06.713853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fbd69-3b17-4750-8bb6-80ac4af6dab8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:06.748823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120a3f9-c4f1-4700-92af-77dd74513c83 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:06.786058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36491920-7372-4186-ac42-c71a3b1de6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:06.787146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36491920-7372-4186-ac42-c71a3b1de6bf None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:06.787146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36491920-7372-4186-ac42-c71a3b1de6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:06.787438 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36491920-7372-4186-ac42-c71a3b1de6bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:06.798055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36491920-7372-4186-ac42-c71a3b1de6bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:06.799549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36491920-7372-4186-ac42-c71a3b1de6bf None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:06.819610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-36491920-7372-4186-ac42-c71a3b1de6bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:06.819610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:06.819610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:06.819610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:06.819610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:06.819610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:06.819610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:06.819610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:06.819610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:06.819610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:06.819610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:06.819610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:06.819610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:19:06.819610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:19:06.819610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:19:06.820515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:19:06.820515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:06.820515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:06.820515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:06.820515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:06.820515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:06.820515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:06.820515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:06.820515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:06.820515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:06.820515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:06.820515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:06.820515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:06.820515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:06.820515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:06.820515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:06.820515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:06.821394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:19:06.821394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:19:06.821394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:06.821394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:06.825850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 466/949] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:06.826767 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36491920-7372-4186-ac42-c71a3b1de6bf None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:06.827673 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fbd69-3b17-4750-8bb6-80ac4af6dab8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:06.859408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:06.864116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:06.869968 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e3f44-a66a-42cc-b5ac-955addc5f9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:06.871622 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e3f44-a66a-42cc-b5ac-955addc5f9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:06.872118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e3f44-a66a-42cc-b5ac-955addc5f9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:06.872610 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e3f44-a66a-42cc-b5ac-955addc5f9e0 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:06.873933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e3f44-a66a-42cc-b5ac-955addc5f9e0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:06.874897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e3f44-a66a-42cc-b5ac-955addc5f9e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:06.877305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e3f44-a66a-42cc-b5ac-955addc5f9e0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:06.889971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 484/950] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 19 12:19:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:06.891926 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e3f44-a66a-42cc-b5ac-955addc5f9e0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:06.941039 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36491920-7372-4186-ac42-c71a3b1de6bf None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:06.977032 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e5e79-a16a-48d7-9279-9e14696400f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:06.977703 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e5e79-a16a-48d7-9279-9e14696400f1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:06.977986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e5e79-a16a-48d7-9279-9e14696400f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:06.978300 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e5e79-a16a-48d7-9279-9e14696400f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:06.979018 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e5e79-a16a-48d7-9279-9e14696400f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:06.979322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e5e79-a16a-48d7-9279-9e14696400f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:06.980682 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e5e79-a16a-48d7-9279-9e14696400f1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:06.997707 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 467/951] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:06.998576 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e5e79-a16a-48d7-9279-9e14696400f1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:07.029827 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e3f44-a66a-42cc-b5ac-955addc5f9e0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:07.073057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa4777-2125-46b8-982d-f973c933c65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:07.073634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa4777-2125-46b8-982d-f973c933c65a None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:07.073916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa4777-2125-46b8-982d-f973c933c65a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:07.074192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa4777-2125-46b8-982d-f973c933c65a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:07.074956 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa4777-2125-46b8-982d-f973c933c65a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:07.076326 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa4777-2125-46b8-982d-f973c933c65a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:07.099482 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:07.106172 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 485/952] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Jul 19 12:19:06 2022] POST /identity/v3/endpoints => generated 349 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:19:07.106172 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962696e2-595e-435e-abcd-5299308a2f70 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:07.106172 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962696e2-595e-435e-abcd-5299308a2f70 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:07.106172 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962696e2-595e-435e-abcd-5299308a2f70 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:07.106172 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 486/953] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:07.112218 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cbc5c-09a2-48d5-ba14-be72e7107b33 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:07.112502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cbc5c-09a2-48d5-ba14-be72e7107b33 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:07.112778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cbc5c-09a2-48d5-ba14-be72e7107b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:07.118276 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e5e79-a16a-48d7-9279-9e14696400f1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:07.131713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0c0cbc5c-09a2-48d5-ba14-be72e7107b33 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:07.133039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0c0cbc5c-09a2-48d5-ba14-be72e7107b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:07.176502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9695d5-c190-4600-9c8e-cfbc8e6624d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:07.177637 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9695d5-c190-4600-9c8e-cfbc8e6624d9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:07.178120 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9695d5-c190-4600-9c8e-cfbc8e6624d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:07.178541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9695d5-c190-4600-9c8e-cfbc8e6624d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:07.187843 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9695d5-c190-4600-9c8e-cfbc8e6624d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:07.189701 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9695d5-c190-4600-9c8e-cfbc8e6624d9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:07.194052 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:07.211770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-9a9695d5-c190-4600-9c8e-cfbc8e6624d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:19:07.211770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:07.211770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:07.211770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:07.211770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:07.211770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:07.211770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:07.211770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:07.211770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:07.211770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:07.211770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:07.211770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:07.211770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:19:07.211770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:19:07.211770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:19:07.212909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:19:07.212909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:07.212909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:07.212909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:07.212909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:07.212909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:07.212909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:07.212909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:07.212909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:07.212909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:07.212909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:07.212909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:07.212909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:07.212909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:07.212909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:07.212909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:07.212909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:07.213853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:19:07.213853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:19:07.213853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:19:07.213853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:19:07.213853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:19:07.213853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:19:07.213853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:19:07.213853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:07.221855 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 468/954] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:19:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:07.223481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9695d5-c190-4600-9c8e-cfbc8e6624d9 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:07.234850 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 487/955] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 12:19:07.258465 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cbc5c-09a2-48d5-ba14-be72e7107b33 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:07.360820 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9695d5-c190-4600-9c8e-cfbc8e6624d9 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:07.390043 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cbc5c-09a2-48d5-ba14-be72e7107b33 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:07.407164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bae26c-ab7d-4f1e-b2ba-ef9701d9c47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:07.408418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bae26c-ab7d-4f1e-b2ba-ef9701d9c47c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:07.408899 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bae26c-ab7d-4f1e-b2ba-ef9701d9c47c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:07.409850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bae26c-ab7d-4f1e-b2ba-ef9701d9c47c None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:07.411140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bae26c-ab7d-4f1e-b2ba-ef9701d9c47c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:07.411652 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bae26c-ab7d-4f1e-b2ba-ef9701d9c47c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:07.413875 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bae26c-ab7d-4f1e-b2ba-ef9701d9c47c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:07.430905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 469/956] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:19:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:07.436787 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bae26c-ab7d-4f1e-b2ba-ef9701d9c47c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:07.443030 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf15889-cf3c-4789-a620-bb386e2fb076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:07.443444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf15889-cf3c-4789-a620-bb386e2fb076 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:07.443724 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf15889-cf3c-4789-a620-bb386e2fb076 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:07.443994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf15889-cf3c-4789-a620-bb386e2fb076 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:07.444651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf15889-cf3c-4789-a620-bb386e2fb076 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:07.446012 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf15889-cf3c-4789-a620-bb386e2fb076 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:07.452913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:07.458726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6cf15889-cf3c-4789-a620-bb386e2fb076 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 12:19:07.458726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:07.458726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:19:07.458726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:19:07.458726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:19:07.458726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:19:07.458726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:19:07.458726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:07.458726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 12:19:07.458726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:07.458726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:19:07.458726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:07.458726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:07.458726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:07.458726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:07.458726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:07.458726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:07.459840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:07.459840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:07.459840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:07.459840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:07.459840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:07.459840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:07.459840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:19:07.459840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:19:07.459840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:19:07.459840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:19:07.459840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:07.459840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:07.459840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:07.459840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:07.459840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:07.459840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:07.460817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:07.460817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:07.460817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:07.460817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:07.460817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:07.460817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:07.460817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:07.460817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:07.460817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:07.460817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:07.460817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:19:07.460817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:07.460817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 12:19:07.460817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:07.460817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 488/957] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:19:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:07.465971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf15889-cf3c-4789-a620-bb386e2fb076 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:07.512011 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:07.578495 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf15889-cf3c-4789-a620-bb386e2fb076 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:07.583494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bae26c-ab7d-4f1e-b2ba-ef9701d9c47c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:07.620985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20aaf4b-6136-454a-8463-0c5fc96e3480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:07.621903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20aaf4b-6136-454a-8463-0c5fc96e3480 None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:07.622200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20aaf4b-6136-454a-8463-0c5fc96e3480 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:07.622477 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20aaf4b-6136-454a-8463-0c5fc96e3480 None admin] PATH_INFO: `/v3/projects/1ba395a1e22f430084089947e47a622d/users/18030043de1942779baf3ad94aec4071/roles/8339ef0a95734b5e815beb576a29d631` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:07.624958 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20aaf4b-6136-454a-8463-0c5fc96e3480 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba395a1e22f430084089947e47a622d, user_id=18030043de1942779baf3ad94aec4071, role_id=8339ef0a95734b5e815beb576a29d631)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:07.626723 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95165f9a-5871-4b21-a5d4-56f37947329e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:07.627084 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20aaf4b-6136-454a-8463-0c5fc96e3480 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:07.627885 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95165f9a-5871-4b21-a5d4-56f37947329e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:07.628380 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95165f9a-5871-4b21-a5d4-56f37947329e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:07.628849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95165f9a-5871-4b21-a5d4-56f37947329e None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:07.629932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95165f9a-5871-4b21-a5d4-56f37947329e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:07.630865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95165f9a-5871-4b21-a5d4-56f37947329e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:07.632526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95165f9a-5871-4b21-a5d4-56f37947329e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:07.638844 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 489/958] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 19 12:19:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:07.643421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 470/959] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:19:07 2022] PUT /identity/v3/projects/1ba395a1e22f430084089947e47a622d/users/18030043de1942779baf3ad94aec4071/roles/8339ef0a95734b5e815beb576a29d631 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:19:07.644965 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95165f9a-5871-4b21-a5d4-56f37947329e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:07.769914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95165f9a-5871-4b21-a5d4-56f37947329e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:07.778772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:07.813868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ea330-6be9-45e3-b80b-a3b35d7e41e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:07.814536 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ea330-6be9-45e3-b80b-a3b35d7e41e1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:07.814847 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ea330-6be9-45e3-b80b-a3b35d7e41e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:07.815106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ea330-6be9-45e3-b80b-a3b35d7e41e1 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:07.815813 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ea330-6be9-45e3-b80b-a3b35d7e41e1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:07.816114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ea330-6be9-45e3-b80b-a3b35d7e41e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:07.817466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ea330-6be9-45e3-b80b-a3b35d7e41e1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:07.825395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 490/960] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 19 12:19:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:08.259183 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739543f7-ada7-4291-b9c1-acc40cb4fc91 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:08.259521 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739543f7-ada7-4291-b9c1-acc40cb4fc91 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:08.259873 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739543f7-ada7-4291-b9c1-acc40cb4fc91 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:08.261520 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 471/961] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:08.267423 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5054968-d51f-44af-ad1c-5a6e6524cf46 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:08.267715 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5054968-d51f-44af-ad1c-5a6e6524cf46 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:08.267995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5054968-d51f-44af-ad1c-5a6e6524cf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:08.285395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c5054968-d51f-44af-ad1c-5a6e6524cf46 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:08.286594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c5054968-d51f-44af-ad1c-5a6e6524cf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:08.359291 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 491/962] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:08.385460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739543f7-ada7-4291-b9c1-acc40cb4fc91 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:08.456605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:08.495571 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739543f7-ada7-4291-b9c1-acc40cb4fc91 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:08.531646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef119a0-2b8e-4afa-b93b-67bf6c78e447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:08.532759 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef119a0-2b8e-4afa-b93b-67bf6c78e447 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:08.533049 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef119a0-2b8e-4afa-b93b-67bf6c78e447 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:08.533327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef119a0-2b8e-4afa-b93b-67bf6c78e447 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:08.534043 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef119a0-2b8e-4afa-b93b-67bf6c78e447 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:08.535508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef119a0-2b8e-4afa-b93b-67bf6c78e447 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:08.549202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.sql.core [None req-eef119a0-2b8e-4afa-b93b-67bf6c78e447 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 12:19:08.549202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 19 12:19:08.549202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [parameters: {'user_id': '80cc18e64f294cc5bf832d872207947a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 19 12:19:08.549202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80230) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 12:19:08.557096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-eef119a0-2b8e-4afa-b93b-67bf6c78e447 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 19 12:19:08.557096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:08.557096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 12:19:08.557096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 12:19:08.557096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 12:19:08.557096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 12:19:08.557096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 12:19:08.557096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 12:19:08.557096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 12:19:08.557096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application conn.query(q) Jul 19 12:19:08.557096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 12:19:08.557096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 12:19:08.557096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 12:19:08.557096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application result.read() Jul 19 12:19:08.557096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 12:19:08.557960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 12:19:08.557960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 12:19:08.557960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 12:19:08.557960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 12:19:08.557960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 12:19:08.557960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 12:19:08.557960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 12:19:08.557960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 12:19:08.557960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:08.557960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 12:19:08.557960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:08.557960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:08.557960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 12:19:08.557960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 12:19:08.557960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 19 12:19:08.557960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 19 12:19:08.557960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 12:19:08.557960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application next(self.gen) Jul 19 12:19:08.559415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 12:19:08.559415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application yield resource Jul 19 12:19:08.559415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 12:19:08.559415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application next(self.gen) Jul 19 12:19:08.559415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 12:19:08.559415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 12:19:08.559415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 12:19:08.559415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 12:19:08.559415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 12:19:08.559415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise self.value Jul 19 12:19:08.559415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 12:19:08.559415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 12:19:08.559415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 12:19:08.559415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application session.commit() Jul 19 12:19:08.559415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 12:19:08.559415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 12:19:08.559415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 12:19:08.560726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 12:19:08.560726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 12:19:08.560726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self.session.flush() Jul 19 12:19:08.560726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 12:19:08.560726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 12:19:08.560726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 12:19:08.560726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 12:19:08.560726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 12:19:08.560726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application compat.raise_( Jul 19 12:19:08.560726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 12:19:08.560726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception Jul 19 12:19:08.560726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 12:19:08.560726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 12:19:08.560726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 12:19:08.560726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 12:19:08.560726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 12:19:08.560726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 12:19:08.561612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 12:19:08.561612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 12:19:08.561612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 19 12:19:08.561612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 19 12:19:08.561612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 12:19:08.561612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 12:19:08.561612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 12:19:08.561612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 12:19:08.561612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 12:19:08.561612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 12:19:08.561612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 12:19:08.561612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 12:19:08.561612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 12:19:08.561612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 12:19:08.561612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 12:19:08.561612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception Jul 19 12:19:08.562447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 12:19:08.562447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 12:19:08.562447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 12:19:08.562447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 12:19:08.562447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 12:19:08.562447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 12:19:08.562447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 12:19:08.562447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application conn.query(q) Jul 19 12:19:08.562447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 12:19:08.562447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 12:19:08.562447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 12:19:08.562447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application result.read() Jul 19 12:19:08.562447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 12:19:08.562447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 12:19:08.562447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 12:19:08.562447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 12:19:08.567549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 12:19:08.567549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 12:19:08.567549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 12:19:08.567549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 12:19:08.567549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 12:19:08.567549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 19 12:19:08.567549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [parameters: {'user_id': '80cc18e64f294cc5bf832d872207947a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 19 12:19:08.567549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 12:19:08.567549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:08.567549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:19:08.567549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:08.567549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:08.567549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:08.567549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:08.567549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:08.568485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:08.568485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:08.568485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:08.568485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:08.568485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:08.568485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:08.568485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:08.568485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 19 12:19:08.568485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 19 12:19:08.568485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:08.568485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:08.568485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:19:08.568485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:19:08.568485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:19:08.568485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:19:08.568485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 19 12:19:08.568485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 19 12:19:08.569393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 19 12:19:08.569393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 19 12:19:08.569393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 12:19:08.569393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 12:19:08.569393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 19 12:19:08.569393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:08.569393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 472/963] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Jul 19 12:19:08 2022] POST /identity/v3/users => generated 160 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:08.571115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5054968-d51f-44af-ad1c-5a6e6524cf46 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:08.680733 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:08.692080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5054968-d51f-44af-ad1c-5a6e6524cf46 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:08.731096 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf446f-0345-406d-ad1f-bf4d09c34aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:08.731887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf446f-0345-406d-ad1f-bf4d09c34aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:08.732161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf446f-0345-406d-ad1f-bf4d09c34aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:08.732428 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf446f-0345-406d-ad1f-bf4d09c34aa6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:08.740599 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf446f-0345-406d-ad1f-bf4d09c34aa6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:08.742016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf446f-0345-406d-ad1f-bf4d09c34aa6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:08.756777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-febf446f-0345-406d-ad1f-bf4d09c34aa6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 12:19:08.756777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:08.756777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:08.756777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:08.756777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:08.756777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:08.756777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:08.756777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:08.756777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:08.756777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:08.756777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:08.756777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:08.756777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:19:08.756777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:19:08.756777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:19:08.756777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:19:08.757746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:08.757746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:08.757746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:19:08.757746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:19:08.757746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:19:08.757746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:19:08.757746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:08.757746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:08.757746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:08.757746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:08.757746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:08.757746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:08.757746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:08.757746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:08.757746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:08.757746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:08.757746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:08.757746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:08.758805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:08.758805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:08.758805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:19:08.758805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:19:08.758805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:19:08.758805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:19:08.758805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:19:08.758805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:19:08.758805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 12:19:08.758805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:08.758805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 492/964] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:19:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:08.765685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef119a0-2b8e-4afa-b93b-67bf6c78e447 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:08.879062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef119a0-2b8e-4afa-b93b-67bf6c78e447 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:08.910437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:08.919257 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4990b-247b-4636-ba28-fe21916ba465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:08.919936 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4990b-247b-4636-ba28-fe21916ba465 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:08.920275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4990b-247b-4636-ba28-fe21916ba465 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:08.920547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4990b-247b-4636-ba28-fe21916ba465 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:08.921410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4990b-247b-4636-ba28-fe21916ba465 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:08.921715 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4990b-247b-4636-ba28-fe21916ba465 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:08.924417 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4990b-247b-4636-ba28-fe21916ba465 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:08.963547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 473/965] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Jul 19 12:19:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:09.289692 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6e466-6dae-4b06-bc03-0c3910fb71ed None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:09.290233 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6e466-6dae-4b06-bc03-0c3910fb71ed None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:09.290233 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6e466-6dae-4b06-bc03-0c3910fb71ed None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:09.291772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 493/966] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:09.296857 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5520a1-53f6-4329-b63b-9d32f0acd89e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:09.297146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5520a1-53f6-4329-b63b-9d32f0acd89e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:09.297943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5520a1-53f6-4329-b63b-9d32f0acd89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:09.315512 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6e5520a1-53f6-4329-b63b-9d32f0acd89e None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:09.317022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6e5520a1-53f6-4329-b63b-9d32f0acd89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:09.392463 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 474/967] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:09.415961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6e466-6dae-4b06-bc03-0c3910fb71ed None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:09.520458 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6e466-6dae-4b06-bc03-0c3910fb71ed None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:09.554818 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b69051-1171-4cf9-93eb-b71b315ae14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:09.555539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b69051-1171-4cf9-93eb-b71b315ae14a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:09.555814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b69051-1171-4cf9-93eb-b71b315ae14a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:09.556079 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b69051-1171-4cf9-93eb-b71b315ae14a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:09.556747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b69051-1171-4cf9-93eb-b71b315ae14a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:09.558133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b69051-1171-4cf9-93eb-b71b315ae14a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:09.569983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-16b69051-1171-4cf9-93eb-b71b315ae14a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 12:19:09.569983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:09.569983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:19:09.569983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:19:09.569983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:19:09.569983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:19:09.569983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:19:09.569983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:09.569983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 12:19:09.569983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:09.569983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:19:09.569983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:09.569983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:09.569983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:09.569983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:09.569983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:09.569983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:09.570997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:09.570997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:09.570997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:09.570997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:09.570997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:09.570997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:09.570997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:19:09.570997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:19:09.570997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:19:09.570997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:19:09.570997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:09.570997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:09.570997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:09.570997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:09.570997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:09.570997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:09.571822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:09.571822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:09.571822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:09.571822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:09.571822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:09.571822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:09.571822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:09.571822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:09.571822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:09.571822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:09.571822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:19:09.571822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:09.571822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 12:19:09.571822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:09.571822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 494/968] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 19 12:19:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:09.577119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5520a1-53f6-4329-b63b-9d32f0acd89e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:09.678130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5520a1-53f6-4329-b63b-9d32f0acd89e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:09.702100 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:09.720823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2fb9a-ca6a-47ea-a858-f348a8e43cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:09.721485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2fb9a-ca6a-47ea-a858-f348a8e43cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:09.721762 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2fb9a-ca6a-47ea-a858-f348a8e43cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:09.722030 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2fb9a-ca6a-47ea-a858-f348a8e43cc1 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:09.722728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2fb9a-ca6a-47ea-a858-f348a8e43cc1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:09.723059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2fb9a-ca6a-47ea-a858-f348a8e43cc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:09.724405 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2fb9a-ca6a-47ea-a858-f348a8e43cc1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:09.734073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 475/969] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 19 12:19:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:09.735239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b69051-1171-4cf9-93eb-b71b315ae14a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:09.758889 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:09.768801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c74b79-256a-46f6-95a7-e2827a3ec91c None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:09.769593 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c74b79-256a-46f6-95a7-e2827a3ec91c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:09.770012 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c74b79-256a-46f6-95a7-e2827a3ec91c None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:09.771821 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 476/970] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:19:09.777347 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee31fc-2c0a-4b68-b715-59b07e6ecc07 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:09.777640 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee31fc-2c0a-4b68-b715-59b07e6ecc07 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:09.777915 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee31fc-2c0a-4b68-b715-59b07e6ecc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:09.795081 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7bee31fc-2c0a-4b68-b715-59b07e6ecc07 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:09.796306 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7bee31fc-2c0a-4b68-b715-59b07e6ecc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:09.848478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b69051-1171-4cf9-93eb-b71b315ae14a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:09.867827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 477/971] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 12:19:09.885781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434cae0-1cf2-40de-87c5-40fc4bd76d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:09.886446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434cae0-1cf2-40de-87c5-40fc4bd76d1c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:09.886720 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434cae0-1cf2-40de-87c5-40fc4bd76d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:09.887033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434cae0-1cf2-40de-87c5-40fc4bd76d1c None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:09.887726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434cae0-1cf2-40de-87c5-40fc4bd76d1c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:09.888023 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434cae0-1cf2-40de-87c5-40fc4bd76d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:09.889625 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434cae0-1cf2-40de-87c5-40fc4bd76d1c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:09.892880 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee31fc-2c0a-4b68-b715-59b07e6ecc07 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:09.895733 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 495/972] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 19 12:19:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:09.901398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434cae0-1cf2-40de-87c5-40fc4bd76d1c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:09.989166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:10.001345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee31fc-2c0a-4b68-b715-59b07e6ecc07 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:10.007112 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434cae0-1cf2-40de-87c5-40fc4bd76d1c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:10.015365 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:10.036902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77b951-c3c9-4c78-aaea-fbee155a3799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:10.037713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77b951-c3c9-4c78-aaea-fbee155a3799 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:10.037989 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77b951-c3c9-4c78-aaea-fbee155a3799 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:10.038257 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77b951-c3c9-4c78-aaea-fbee155a3799 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:10.042064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b7f32-6ace-4524-9e06-180767d6dd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:10.042722 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b7f32-6ace-4524-9e06-180767d6dd84 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:10.043029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b7f32-6ace-4524-9e06-180767d6dd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:10.043306 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b7f32-6ace-4524-9e06-180767d6dd84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:10.044100 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b7f32-6ace-4524-9e06-180767d6dd84 None admin] RBAC: Adding query filter params (interface=admin, service_id=952338fecc984cc88e011e2ce98cf073, region_id=RegionOne) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:10.044470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b7f32-6ace-4524-9e06-180767d6dd84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:10.045834 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b7f32-6ace-4524-9e06-180767d6dd84 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:10.048963 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77b951-c3c9-4c78-aaea-fbee155a3799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:19:10.051577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 496/973] 10.222.0.25 () {56 vars in 1249 bytes} [Tue Jul 19 12:19:09 2022] GET /identity/v3/endpoints?service_id=952338fecc984cc88e011e2ce98cf073&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:10.052862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a291ee3-6fee-4847-b23b-e0b45da74c51 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:10.053153 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a291ee3-6fee-4847-b23b-e0b45da74c51 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:10.053432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a291ee3-6fee-4847-b23b-e0b45da74c51 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:10.056928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 497/974] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:10.056928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a291ee3-6fee-4847-b23b-e0b45da74c51 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:10.057385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-6d77b951-c3c9-4c78-aaea-fbee155a3799 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 12:19:10.057385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:10.057385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:10.057385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:10.057385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:10.057385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:10.057385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:10.057385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:10.057385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:10.057385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:10.057385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:10.057385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:10.057385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:19:10.057385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:19:10.057385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:19:10.057385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:19:10.058272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:19:10.058272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:19:10.058272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:19:10.058272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:19:10.058272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:10.058272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:10.058272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:10.058272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:10.058272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:10.058272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:10.058272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:10.058272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:10.058272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:10.058272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:10.058272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:10.058272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:10.059133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:10.059133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:10.059133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:10.059133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:10.059133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:19:10.059133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:19:10.059133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:19:10.059133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:19:10.059133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:19:10.059133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:19:10.059133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 12:19:10.059133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:10.059133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 478/975] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Jul 19 12:19:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:10.059917 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a177897-31ea-45c3-9345-ae4c97e341a0 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:10.060480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a177897-31ea-45c3-9345-ae4c97e341a0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:10.060480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a177897-31ea-45c3-9345-ae4c97e341a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:10.078955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3a177897-31ea-45c3-9345-ae4c97e341a0 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:10.080131 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3a177897-31ea-45c3-9345-ae4c97e341a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:10.146646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 479/976] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:10.147569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a177897-31ea-45c3-9345-ae4c97e341a0 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:10.172123 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a291ee3-6fee-4847-b23b-e0b45da74c51 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:10.206658 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad41d1b-1f61-45ef-a76d-5c75e39f1741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:10.207342 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad41d1b-1f61-45ef-a76d-5c75e39f1741 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:10.207622 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad41d1b-1f61-45ef-a76d-5c75e39f1741 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:10.207893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad41d1b-1f61-45ef-a76d-5c75e39f1741 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:10.208571 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad41d1b-1f61-45ef-a76d-5c75e39f1741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:10.209921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad41d1b-1f61-45ef-a76d-5c75e39f1741 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:10.215818 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 498/977] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Jul 19 12:19:10 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:19:10.216559 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad41d1b-1f61-45ef-a76d-5c75e39f1741 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:10.232530 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:10.251513 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a177897-31ea-45c3-9345-ae4c97e341a0 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:10.253357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:10.291757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485a11b-9aaf-45b7-98c9-9510de763990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:10.292445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485a11b-9aaf-45b7-98c9-9510de763990 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:10.292726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485a11b-9aaf-45b7-98c9-9510de763990 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:10.292992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485a11b-9aaf-45b7-98c9-9510de763990 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:10.293764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485a11b-9aaf-45b7-98c9-9510de763990 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:10.294069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485a11b-9aaf-45b7-98c9-9510de763990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:10.295480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485a11b-9aaf-45b7-98c9-9510de763990 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:10.304675 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 480/978] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Jul 19 12:19:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:10.310462 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485a11b-9aaf-45b7-98c9-9510de763990 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:10.338205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad41d1b-1f61-45ef-a76d-5c75e39f1741 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:10.378615 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba531f8f-9b2d-4c75-96d7-2c6b7585d05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:10.379349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba531f8f-9b2d-4c75-96d7-2c6b7585d05d None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:10.379628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba531f8f-9b2d-4c75-96d7-2c6b7585d05d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:10.379899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba531f8f-9b2d-4c75-96d7-2c6b7585d05d None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:10.380613 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba531f8f-9b2d-4c75-96d7-2c6b7585d05d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:10.382407 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba531f8f-9b2d-4c75-96d7-2c6b7585d05d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:10.399643 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 499/979] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 19 12:19:10 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:19:10.429192 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485a11b-9aaf-45b7-98c9-9510de763990 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:10.481187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b207f-d7e3-4fad-8b35-aecadcca72ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:10.481997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b207f-d7e3-4fad-8b35-aecadcca72ce None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:10.482276 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b207f-d7e3-4fad-8b35-aecadcca72ce None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:10.482546 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b207f-d7e3-4fad-8b35-aecadcca72ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:10.495336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b207f-d7e3-4fad-8b35-aecadcca72ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:10.496799 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b207f-d7e3-4fad-8b35-aecadcca72ce None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:10.516996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-9e0b207f-d7e3-4fad-8b35-aecadcca72ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:10.516996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:10.516996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:10.516996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:10.516996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:10.516996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:10.516996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:10.516996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:10.516996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:10.516996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:10.516996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:10.516996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:10.516996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:19:10.516996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:19:10.516996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:19:10.517962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:19:10.517962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:10.517962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:10.517962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:10.517962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:10.517962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:10.517962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:10.517962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:10.517962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:10.517962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:10.517962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:10.517962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:10.517962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:10.517962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:10.517962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:10.517962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:10.517962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:10.518888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:19:10.518888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:19:10.518888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:10.518888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:10.519120 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 481/980] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:10.524619 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba531f8f-9b2d-4c75-96d7-2c6b7585d05d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:10.602894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:10.636807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba531f8f-9b2d-4c75-96d7-2c6b7585d05d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:10.671779 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dec6d9-36f0-4618-a097-3e9db7a05151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:10.672420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dec6d9-36f0-4618-a097-3e9db7a05151 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:10.673330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dec6d9-36f0-4618-a097-3e9db7a05151 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:10.673828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dec6d9-36f0-4618-a097-3e9db7a05151 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:10.674573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dec6d9-36f0-4618-a097-3e9db7a05151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:10.674907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dec6d9-36f0-4618-a097-3e9db7a05151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:10.676268 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dec6d9-36f0-4618-a097-3e9db7a05151 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:10.693781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 500/981] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:10.699393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b207f-d7e3-4fad-8b35-aecadcca72ce None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:10.715402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:10.805412 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b207f-d7e3-4fad-8b35-aecadcca72ce None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:10.839308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb87e11-5f9c-495d-aaaf-6d4ecc6c44aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:10.840118 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb87e11-5f9c-495d-aaaf-6d4ecc6c44aa None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:10.840397 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb87e11-5f9c-495d-aaaf-6d4ecc6c44aa None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:10.840667 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb87e11-5f9c-495d-aaaf-6d4ecc6c44aa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:10.849613 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb87e11-5f9c-495d-aaaf-6d4ecc6c44aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:10.852429 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb87e11-5f9c-495d-aaaf-6d4ecc6c44aa None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:10.868345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-4eb87e11-5f9c-495d-aaaf-6d4ecc6c44aa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 12:19:10.868345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:10.868345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:10.868345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:10.868345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:10.868345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:10.868345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:10.868345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:10.868345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:10.868345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:10.868345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:10.868345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:10.868345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:19:10.868345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:19:10.868345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:19:10.868345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:19:10.869310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:10.869310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:10.869310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:19:10.869310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:19:10.869310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:19:10.869310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:19:10.869310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:10.869310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:10.869310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:10.869310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:10.869310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:10.869310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:10.869310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:10.869310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:10.869310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:10.869310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:10.869310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:10.869310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:10.870315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:10.870315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:10.870315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:19:10.870315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:19:10.870315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:19:10.870315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:19:10.870315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:19:10.870315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:19:10.870315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 12:19:10.870315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:10.871495 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 482/982] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 19 12:19:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:10.875411 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dec6d9-36f0-4618-a097-3e9db7a05151 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:10.981519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dec6d9-36f0-4618-a097-3e9db7a05151 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:11.011578 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:11.018640 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3f4d3-d32f-43b8-8bed-4630eb8cfd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:11.019336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3f4d3-d32f-43b8-8bed-4630eb8cfd4e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:11.019614 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3f4d3-d32f-43b8-8bed-4630eb8cfd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:11.019884 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3f4d3-d32f-43b8-8bed-4630eb8cfd4e None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:11.020707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3f4d3-d32f-43b8-8bed-4630eb8cfd4e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:11.021007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3f4d3-d32f-43b8-8bed-4630eb8cfd4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:11.022425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3f4d3-d32f-43b8-8bed-4630eb8cfd4e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:11.040399 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 501/983] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Jul 19 12:19:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:11.045920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb87e11-5f9c-495d-aaaf-6d4ecc6c44aa None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:11.119473 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:11.151984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb87e11-5f9c-495d-aaaf-6d4ecc6c44aa None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:11.184917 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a86652-de78-44e6-b49e-ecdbb79179d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:11.185573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a86652-de78-44e6-b49e-ecdbb79179d3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:11.185855 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a86652-de78-44e6-b49e-ecdbb79179d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:11.186129 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a86652-de78-44e6-b49e-ecdbb79179d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:11.254841 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a86652-de78-44e6-b49e-ecdbb79179d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:11.256214 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a86652-de78-44e6-b49e-ecdbb79179d3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:11.326135 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:11.359523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 483/984] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:19:11 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 12:19:11.366131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3f4d3-d32f-43b8-8bed-4630eb8cfd4e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:11.471013 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3f4d3-d32f-43b8-8bed-4630eb8cfd4e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:11.504775 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a50592-2d6b-4d54-bea3-c2c4a4c25db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:11.505620 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a50592-2d6b-4d54-bea3-c2c4a4c25db0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:11.505840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a50592-2d6b-4d54-bea3-c2c4a4c25db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:11.506108 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a50592-2d6b-4d54-bea3-c2c4a4c25db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:11.516863 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a50592-2d6b-4d54-bea3-c2c4a4c25db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:11.518379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a50592-2d6b-4d54-bea3-c2c4a4c25db0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:11.535662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-c4a50592-2d6b-4d54-bea3-c2c4a4c25db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:11.535662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:11.535662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:11.535662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:11.535662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:11.535662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:11.535662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:11.535662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:11.535662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:11.535662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:11.535662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:11.535662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:11.535662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:19:11.535662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:19:11.535662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:19:11.536623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:19:11.536623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:11.536623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:11.536623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:11.536623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:11.536623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:11.536623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:11.536623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:11.536623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:11.536623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:11.536623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:11.536623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:11.536623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:11.536623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:11.536623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:11.536623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:11.536623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:11.537496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:19:11.537496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:19:11.537496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:11.537496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:11.538309 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 502/985] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:11.542798 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a86652-de78-44e6-b49e-ecdbb79179d3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:11.643143 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a86652-de78-44e6-b49e-ecdbb79179d3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:11.677177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f48628-15a0-48c6-ab8b-210e46b74ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:11.678158 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f48628-15a0-48c6-ab8b-210e46b74ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:11.678644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f48628-15a0-48c6-ab8b-210e46b74ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:11.679121 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f48628-15a0-48c6-ab8b-210e46b74ab0 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:11.680022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f48628-15a0-48c6-ab8b-210e46b74ab0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:11.680500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f48628-15a0-48c6-ab8b-210e46b74ab0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:11.682021 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f48628-15a0-48c6-ab8b-210e46b74ab0 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:11.706497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 484/986] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:11.707802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a50592-2d6b-4d54-bea3-c2c4a4c25db0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:11.751518 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:11.808045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a50592-2d6b-4d54-bea3-c2c4a4c25db0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:11.841806 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b231e0d-3983-42ea-ad00-086e42c02a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:11.842595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b231e0d-3983-42ea-ad00-086e42c02a5d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:11.842964 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b231e0d-3983-42ea-ad00-086e42c02a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:11.843245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b231e0d-3983-42ea-ad00-086e42c02a5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:11.850374 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b231e0d-3983-42ea-ad00-086e42c02a5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:11.851830 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b231e0d-3983-42ea-ad00-086e42c02a5d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:11.865809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6b231e0d-3983-42ea-ad00-086e42c02a5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:19:11.865809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:11.865809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:11.865809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:11.865809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:11.865809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:11.865809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:11.865809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:11.865809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:11.865809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:11.865809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:11.865809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:11.865809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:19:11.865809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:19:11.865809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:19:11.866691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:19:11.866691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:11.866691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:11.866691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:11.866691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:11.866691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:11.866691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:11.866691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:11.866691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:11.866691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:11.866691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:11.866691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:11.866691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:11.866691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:11.866691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:11.866691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:11.866691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:11.867887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:19:11.867887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:19:11.867887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:19:11.867887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:19:11.867887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:19:11.867887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:19:11.867887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:19:11.867887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:11.871055 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 503/987] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:19:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:11.872784 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f48628-15a0-48c6-ab8b-210e46b74ab0 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:11.905775 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:11.975925 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f48628-15a0-48c6-ab8b-210e46b74ab0 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:12.009047 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0648b08-b0d5-4320-9b73-7f2fcb74e06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:12.009706 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0648b08-b0d5-4320-9b73-7f2fcb74e06d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:12.009984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0648b08-b0d5-4320-9b73-7f2fcb74e06d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:12.010254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0648b08-b0d5-4320-9b73-7f2fcb74e06d None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:12.011056 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0648b08-b0d5-4320-9b73-7f2fcb74e06d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:12.011362 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0648b08-b0d5-4320-9b73-7f2fcb74e06d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:12.012763 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0648b08-b0d5-4320-9b73-7f2fcb74e06d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:12.025776 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 485/988] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:19:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:12.031518 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b231e0d-3983-42ea-ad00-086e42c02a5d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:12.132959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b231e0d-3983-42ea-ad00-086e42c02a5d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:12.134429 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:12.169029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00218221-1d5b-428c-90d2-48522e4b055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:12.169679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00218221-1d5b-428c-90d2-48522e4b055b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:12.169955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00218221-1d5b-428c-90d2-48522e4b055b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:12.170221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00218221-1d5b-428c-90d2-48522e4b055b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:12.171076 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00218221-1d5b-428c-90d2-48522e4b055b None admin] RBAC: Adding query filter params (role.id=8339ef0a95734b5e815beb576a29d631, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=18030043de1942779baf3ad94aec4071) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:12.171380 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00218221-1d5b-428c-90d2-48522e4b055b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:12.172832 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00218221-1d5b-428c-90d2-48522e4b055b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:12.178883 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 504/989] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:19:12 2022] GET /identity/v3/role_assignments?user.id=18030043de1942779baf3ad94aec4071&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=8339ef0a95734b5e815beb576a29d631 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:12.285167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf1895-45c9-47a2-afe8-8f13fb1ab6df None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:12.285498 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf1895-45c9-47a2-afe8-8f13fb1ab6df None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:12.285735 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf1895-45c9-47a2-afe8-8f13fb1ab6df None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:12.287362 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 486/990] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:12.293058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9ff7b-262d-4419-84ec-b7b8f31e8fb4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:12.293360 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9ff7b-262d-4419-84ec-b7b8f31e8fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:12.293625 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9ff7b-262d-4419-84ec-b7b8f31e8fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:12.311741 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7ce9ff7b-262d-4419-84ec-b7b8f31e8fb4 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:12.313063 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7ce9ff7b-262d-4419-84ec-b7b8f31e8fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:12.387494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 505/991] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:12.411323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf1895-45c9-47a2-afe8-8f13fb1ab6df None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:12.480095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df7fee-f4cd-4ccd-9925-ef2c49d2de8a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:12.480470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df7fee-f4cd-4ccd-9925-ef2c49d2de8a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:12.480640 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df7fee-f4cd-4ccd-9925-ef2c49d2de8a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:12.482256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 506/992] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:12.487936 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b22c22-daf8-4c23-adfd-24d881d27af3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:12.488217 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b22c22-daf8-4c23-adfd-24d881d27af3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:12.488489 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b22c22-daf8-4c23-adfd-24d881d27af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:12.505200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f2b22c22-daf8-4c23-adfd-24d881d27af3 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:12.506371 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f2b22c22-daf8-4c23-adfd-24d881d27af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:12.508804 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:12.521894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf1895-45c9-47a2-afe8-8f13fb1ab6df None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:12.557764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626cd4b-bd14-49c6-bf09-fa34bbf56904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:12.558581 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626cd4b-bd14-49c6-bf09-fa34bbf56904 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:12.558901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626cd4b-bd14-49c6-bf09-fa34bbf56904 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:12.559180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626cd4b-bd14-49c6-bf09-fa34bbf56904 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:12.559835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626cd4b-bd14-49c6-bf09-fa34bbf56904 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:12.561198 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626cd4b-bd14-49c6-bf09-fa34bbf56904 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:12.573893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-6626cd4b-bd14-49c6-bf09-fa34bbf56904 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 12:19:12.573893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:12.573893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:19:12.573893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:19:12.573893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:19:12.573893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:19:12.573893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:19:12.573893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:12.573893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 12:19:12.573893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:12.573893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:19:12.573893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:12.573893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:12.573893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:12.573893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:12.573893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:12.573893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:12.574930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:12.574930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:12.574930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:12.574930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:12.574930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:12.574930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:12.574930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:19:12.574930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:19:12.574930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:19:12.574930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:19:12.574930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:12.574930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:12.574930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:12.574930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:12.574930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:12.574930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:12.576459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:12.576459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:12.576459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:12.576459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:12.576459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:12.576459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:12.576459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:12.576459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:12.576459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:12.576459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:12.576459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:19:12.576459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:12.576459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 12:19:12.576459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:12.576459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 487/993] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Jul 19 12:19:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:12.581643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626cd4b-bd14-49c6-bf09-fa34bbf56904 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:12.584446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 507/994] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 12:19:12.607132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b22c22-daf8-4c23-adfd-24d881d27af3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:12.635371 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:12.693731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626cd4b-bd14-49c6-bf09-fa34bbf56904 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:12.717639 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b22c22-daf8-4c23-adfd-24d881d27af3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:12.731095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df00a0b-1ae6-4761-a6ee-6f1498fba8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:12.731763 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df00a0b-1ae6-4761-a6ee-6f1498fba8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:12.732040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df00a0b-1ae6-4761-a6ee-6f1498fba8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:12.732307 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df00a0b-1ae6-4761-a6ee-6f1498fba8b6 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:12.733012 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df00a0b-1ae6-4761-a6ee-6f1498fba8b6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:12.733310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df00a0b-1ae6-4761-a6ee-6f1498fba8b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:12.734657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df00a0b-1ae6-4761-a6ee-6f1498fba8b6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:12.744120 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 488/995] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 19 12:19:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:12.745268 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df00a0b-1ae6-4761-a6ee-6f1498fba8b6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:12.754902 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e199d-05ea-48d1-96c8-02280252fc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:12.755821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e199d-05ea-48d1-96c8-02280252fc4e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:12.756097 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e199d-05ea-48d1-96c8-02280252fc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:12.756368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e199d-05ea-48d1-96c8-02280252fc4e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:12.757018 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e199d-05ea-48d1-96c8-02280252fc4e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:12.758511 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e199d-05ea-48d1-96c8-02280252fc4e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:12.768544 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:12.773271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-2f9e199d-05ea-48d1-96c8-02280252fc4e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 12:19:12.773271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:12.773271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:19:12.773271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:19:12.773271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:19:12.773271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:19:12.773271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:19:12.773271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:12.773271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 12:19:12.773271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:12.773271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:19:12.773271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:12.773271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:12.773271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:12.773271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:12.773271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:12.773271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:12.774222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:12.774222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:12.774222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:12.774222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:12.774222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:12.774222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:12.774222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:19:12.774222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:19:12.774222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:19:12.774222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:19:12.774222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:12.774222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:12.774222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:12.774222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:12.774222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:12.774222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:12.775104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:12.775104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:12.775104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:12.775104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:12.775104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:12.775104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:12.775104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:12.775104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:12.775104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:12.775104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:12.775104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:19:12.775104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:12.775104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 12:19:12.775104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:12.775104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 508/996] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:19:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:12.780457 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e199d-05ea-48d1-96c8-02280252fc4e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:12.851686 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df00a0b-1ae6-4761-a6ee-6f1498fba8b6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:12.876438 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:12.887178 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e199d-05ea-48d1-96c8-02280252fc4e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:12.888206 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320078c-5ee0-4972-8197-696da451739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:12.889000 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320078c-5ee0-4972-8197-696da451739f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:12.889535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320078c-5ee0-4972-8197-696da451739f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:12.889932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320078c-5ee0-4972-8197-696da451739f None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:12.890636 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320078c-5ee0-4972-8197-696da451739f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:12.890974 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320078c-5ee0-4972-8197-696da451739f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:12.892705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320078c-5ee0-4972-8197-696da451739f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:12.902659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 489/997] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Jul 19 12:19:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:12.903678 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320078c-5ee0-4972-8197-696da451739f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:12.931563 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36661b49-4292-4251-8ebd-cc06d067f8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:12.932431 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36661b49-4292-4251-8ebd-cc06d067f8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:12.932866 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36661b49-4292-4251-8ebd-cc06d067f8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:12.933206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36661b49-4292-4251-8ebd-cc06d067f8a0 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:12.933977 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36661b49-4292-4251-8ebd-cc06d067f8a0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:12.934350 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36661b49-4292-4251-8ebd-cc06d067f8a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:12.936043 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36661b49-4292-4251-8ebd-cc06d067f8a0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:12.946877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 509/998] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 19 12:19:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:12.947863 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36661b49-4292-4251-8ebd-cc06d067f8a0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:12.996639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:13.013196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320078c-5ee0-4972-8197-696da451739f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:13.046401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfda0ec-66d2-4870-b475-f8523c9378c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:13.047182 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfda0ec-66d2-4870-b475-f8523c9378c8 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:13.048115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfda0ec-66d2-4870-b475-f8523c9378c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:13.048446 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfda0ec-66d2-4870-b475-f8523c9378c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:13.049282 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfda0ec-66d2-4870-b475-f8523c9378c8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:13.050701 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfda0ec-66d2-4870-b475-f8523c9378c8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:13.052014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36661b49-4292-4251-8ebd-cc06d067f8a0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:13.066765 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 490/999] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Jul 19 12:19:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:19:13.110593 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8452c8-771c-4c08-91a7-820150f3a11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:13.111457 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8452c8-771c-4c08-91a7-820150f3a11b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:13.111737 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8452c8-771c-4c08-91a7-820150f3a11b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:13.112003 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8452c8-771c-4c08-91a7-820150f3a11b None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:13.112714 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8452c8-771c-4c08-91a7-820150f3a11b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:13.113015 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8452c8-771c-4c08-91a7-820150f3a11b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:13.114413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8452c8-771c-4c08-91a7-820150f3a11b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:13.125214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 510/1000] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 19 12:19:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:13.127106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfda0ec-66d2-4870-b475-f8523c9378c8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:13.237587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfda0ec-66d2-4870-b475-f8523c9378c8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:13.273493 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a05b0-405e-408a-b2a4-a5d4b31104f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:13.274516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a05b0-405e-408a-b2a4-a5d4b31104f2 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:13.274998 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a05b0-405e-408a-b2a4-a5d4b31104f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:13.275415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a05b0-405e-408a-b2a4-a5d4b31104f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:13.276352 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a05b0-405e-408a-b2a4-a5d4b31104f2 None admin] RBAC: Adding query filter params (interface=public, service_id=98ffea9bd18c483da3cfcbf9e915fb9b, region_id=RegionOne) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:13.276810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a05b0-405e-408a-b2a4-a5d4b31104f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:13.278323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a05b0-405e-408a-b2a4-a5d4b31104f2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:13.284187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 491/1001] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Jul 19 12:19:13 2022] GET /identity/v3/endpoints?service_id=98ffea9bd18c483da3cfcbf9e915fb9b&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:13.289877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8452c8-771c-4c08-91a7-820150f3a11b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:13.308321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:13.397744 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8452c8-771c-4c08-91a7-820150f3a11b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:13.432298 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be956f78-96a8-4664-bdce-abce300df94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:13.432967 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be956f78-96a8-4664-bdce-abce300df94c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:13.433245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be956f78-96a8-4664-bdce-abce300df94c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:13.433515 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be956f78-96a8-4664-bdce-abce300df94c None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:13.434189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be956f78-96a8-4664-bdce-abce300df94c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:13.435567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be956f78-96a8-4664-bdce-abce300df94c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:13.442652 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 511/1002] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Jul 19 12:19:13 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:19:14.263384 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1406117-4b62-481f-af8e-f99203885b2f None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:14.263898 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1406117-4b62-481f-af8e-f99203885b2f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:14.264001 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1406117-4b62-481f-af8e-f99203885b2f None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:14.265619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 492/1003] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:14.271355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5662ac-91b1-43a2-b813-635aa707f833 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:14.271648 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5662ac-91b1-43a2-b813-635aa707f833 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:14.271923 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5662ac-91b1-43a2-b813-635aa707f833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:14.288966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1e5662ac-91b1-43a2-b813-635aa707f833 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:14.289999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1e5662ac-91b1-43a2-b813-635aa707f833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:14.357070 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 512/1004] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:14 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:14.379629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1406117-4b62-481f-af8e-f99203885b2f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:14.392190 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:14.484935 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1406117-4b62-481f-af8e-f99203885b2f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:14.520728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb9bb1-6bd3-47dc-a0ba-1dcb2b23ef98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:14.521447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb9bb1-6bd3-47dc-a0ba-1dcb2b23ef98 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:14.521728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb9bb1-6bd3-47dc-a0ba-1dcb2b23ef98 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:14.522072 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb9bb1-6bd3-47dc-a0ba-1dcb2b23ef98 None admin] PATH_INFO: `/v3/services/image` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:14.522818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb9bb1-6bd3-47dc-a0ba-1dcb2b23ef98 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:14.524204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb9bb1-6bd3-47dc-a0ba-1dcb2b23ef98 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:14.536528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-f5eb9bb1-6bd3-47dc-a0ba-1dcb2b23ef98 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 12:19:14.536528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:14.536528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:19:14.536528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:19:14.536528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:19:14.536528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:19:14.536528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:19:14.536528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:14.536528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 12:19:14.536528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:14.536528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:19:14.536528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:14.536528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:14.536528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:14.536528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:14.536528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:14.536528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:14.537596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:14.537596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:14.537596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:14.537596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:14.537596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:14.537596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:14.537596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:19:14.537596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:19:14.537596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:19:14.537596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:19:14.537596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:14.537596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:14.537596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:14.537596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:14.537596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:14.537596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:14.538490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:14.538490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:14.538490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:14.538490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:14.538490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:14.538490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:14.538490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:14.538490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:14.538490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:14.538490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:14.538490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:19:14.538490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:14.538490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 12:19:14.538490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:14.538490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 493/1005] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Jul 19 12:19:14 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:14.545635 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5662ac-91b1-43a2-b813-635aa707f833 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:14.556718 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:14.653469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5662ac-91b1-43a2-b813-635aa707f833 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:14.697924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5002c40-bb07-4446-9dd1-e6089f2a20a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:14.697924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5002c40-bb07-4446-9dd1-e6089f2a20a1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:14.697924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5002c40-bb07-4446-9dd1-e6089f2a20a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:14.697924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5002c40-bb07-4446-9dd1-e6089f2a20a1 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:14.698346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5002c40-bb07-4446-9dd1-e6089f2a20a1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:14.698346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5002c40-bb07-4446-9dd1-e6089f2a20a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:14.698692 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5002c40-bb07-4446-9dd1-e6089f2a20a1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:14.705893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 513/1006] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:14.711712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb9bb1-6bd3-47dc-a0ba-1dcb2b23ef98 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:14.786678 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:14.817815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb9bb1-6bd3-47dc-a0ba-1dcb2b23ef98 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:14.851884 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e0fe0-0eb6-4f71-8cf8-d9ef246897e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:14.852553 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e0fe0-0eb6-4f71-8cf8-d9ef246897e5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:14.852836 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e0fe0-0eb6-4f71-8cf8-d9ef246897e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:14.853111 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e0fe0-0eb6-4f71-8cf8-d9ef246897e5 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:14.853815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e0fe0-0eb6-4f71-8cf8-d9ef246897e5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:14.854119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e0fe0-0eb6-4f71-8cf8-d9ef246897e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:14.855495 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e0fe0-0eb6-4f71-8cf8-d9ef246897e5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:14.867202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 494/1007] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:14 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:15.137822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b293eed-54eb-4a43-a8f3-dcbdf645adcb None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:15.138024 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b293eed-54eb-4a43-a8f3-dcbdf645adcb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:15.138275 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b293eed-54eb-4a43-a8f3-dcbdf645adcb None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:15.140060 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 514/1008] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:15.145837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0392a-94bf-4705-b17c-e8986852b23a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:15.146121 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0392a-94bf-4705-b17c-e8986852b23a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:15.146396 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0392a-94bf-4705-b17c-e8986852b23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:15.164663 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-96a0392a-94bf-4705-b17c-e8986852b23a None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:15.165842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-96a0392a-94bf-4705-b17c-e8986852b23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:15.236208 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 495/1009] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:15 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:15.259257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b293eed-54eb-4a43-a8f3-dcbdf645adcb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:15.333258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:15.367425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b293eed-54eb-4a43-a8f3-dcbdf645adcb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:15.402562 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3a965-e7f4-4edc-8d42-784bcc5fee0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:15.403377 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3a965-e7f4-4edc-8d42-784bcc5fee0c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:15.403654 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3a965-e7f4-4edc-8d42-784bcc5fee0c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:15.403923 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3a965-e7f4-4edc-8d42-784bcc5fee0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:15.405063 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3a965-e7f4-4edc-8d42-784bcc5fee0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:15.406477 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3a965-e7f4-4edc-8d42-784bcc5fee0c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:15.408973 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 515/1010] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:15.414537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0392a-94bf-4705-b17c-e8986852b23a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:15.471639 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ec633-cded-4ad8-98fb-6f89d1b4f5b4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:15.471958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ec633-cded-4ad8-98fb-6f89d1b4f5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:15.472213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ec633-cded-4ad8-98fb-6f89d1b4f5b4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:15.474765 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 516/1011] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:15.478581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d8deb-698a-4ba2-b929-af42262e45e8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:15.478892 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d8deb-698a-4ba2-b929-af42262e45e8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:15.479166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d8deb-698a-4ba2-b929-af42262e45e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:15.479897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:15.502052 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3b3d8deb-698a-4ba2-b929-af42262e45e8 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:15.503256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3b3d8deb-698a-4ba2-b929-af42262e45e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:15.519270 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0392a-94bf-4705-b17c-e8986852b23a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:15.555355 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3b8b4-a113-4175-b72f-25a0fb0fcac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:15.556492 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3b8b4-a113-4175-b72f-25a0fb0fcac1 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:15.557098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3b8b4-a113-4175-b72f-25a0fb0fcac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:15.557470 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3b8b4-a113-4175-b72f-25a0fb0fcac1 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:15.558190 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3b8b4-a113-4175-b72f-25a0fb0fcac1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:15.559629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3b8b4-a113-4175-b72f-25a0fb0fcac1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:15.574807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 517/1012] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:15 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 12:19:15.591340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 496/1013] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 19 12:19:15 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:19:15.599008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d8deb-698a-4ba2-b929-af42262e45e8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:15.677459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:15.717662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d8deb-698a-4ba2-b929-af42262e45e8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:15.756630 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dedbed-6d51-4fca-9508-71c64ebf5cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:15.757429 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dedbed-6d51-4fca-9508-71c64ebf5cea None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:15.757707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dedbed-6d51-4fca-9508-71c64ebf5cea None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:15.757979 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dedbed-6d51-4fca-9508-71c64ebf5cea None admin] PATH_INFO: `/v3/services/compute` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:15.758700 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dedbed-6d51-4fca-9508-71c64ebf5cea None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:15.760085 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dedbed-6d51-4fca-9508-71c64ebf5cea None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:15.773106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b6dedbed-6d51-4fca-9508-71c64ebf5cea None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 12:19:15.773106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:15.773106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:19:15.773106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:19:15.773106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:19:15.773106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:19:15.773106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:19:15.773106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:15.773106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 12:19:15.773106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:15.773106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:19:15.773106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:15.773106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:15.773106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:15.773106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:15.773106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:15.773106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:15.774073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:15.774073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:15.774073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:15.774073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:15.774073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:15.774073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:15.774073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:19:15.774073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:19:15.774073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:19:15.774073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:19:15.774073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:15.774073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:15.774073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:15.774073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:15.774073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:15.774073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:15.775086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:15.775086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:15.775086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:15.775086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:15.775086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:15.775086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:15.775086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:15.775086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:15.775086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:15.775086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:15.775086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:19:15.775086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:15.775086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 12:19:15.775086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:15.775086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 518/1014] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:19:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:15.782556 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3b8b4-a113-4175-b72f-25a0fb0fcac1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:15.890356 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3b8b4-a113-4175-b72f-25a0fb0fcac1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:15.908365 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:15.926661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ce8dc-8e69-4cfd-9641-ea035c42dc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:15.927391 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ce8dc-8e69-4cfd-9641-ea035c42dc09 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:15.927723 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ce8dc-8e69-4cfd-9641-ea035c42dc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:15.927943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ce8dc-8e69-4cfd-9641-ea035c42dc09 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:15.928650 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ce8dc-8e69-4cfd-9641-ea035c42dc09 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:15.928955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ce8dc-8e69-4cfd-9641-ea035c42dc09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:15.930308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ce8dc-8e69-4cfd-9641-ea035c42dc09 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:15.939047 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 497/1015] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 19 12:19:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:15.945249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dedbed-6d51-4fca-9508-71c64ebf5cea None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:16.051573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dedbed-6d51-4fca-9508-71c64ebf5cea None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:16.085272 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cb7a7-76a7-4009-85e3-d6294b0fcdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:16.085939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cb7a7-76a7-4009-85e3-d6294b0fcdbd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:16.086215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cb7a7-76a7-4009-85e3-d6294b0fcdbd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:16.086483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cb7a7-76a7-4009-85e3-d6294b0fcdbd None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:16.087206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096cb7a7-76a7-4009-85e3-d6294b0fcdbd None admin] RBAC: Adding query filter params (type=compute) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:16.087511 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096cb7a7-76a7-4009-85e3-d6294b0fcdbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:16.088865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096cb7a7-76a7-4009-85e3-d6294b0fcdbd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:16.090090 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:16.095473 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 519/1016] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Jul 19 12:19:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:16.101473 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ce8dc-8e69-4cfd-9641-ea035c42dc09 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:16.205223 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ce8dc-8e69-4cfd-9641-ea035c42dc09 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:16.238227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6baa3-0aa6-4698-9d60-70f05b4f7537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:16.238913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6baa3-0aa6-4698-9d60-70f05b4f7537 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:16.239197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6baa3-0aa6-4698-9d60-70f05b4f7537 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:16.239468 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6baa3-0aa6-4698-9d60-70f05b4f7537 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:16.240199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6baa3-0aa6-4698-9d60-70f05b4f7537 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:16.241574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6baa3-0aa6-4698-9d60-70f05b4f7537 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:16.266772 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 498/1017] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Jul 19 12:19:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:19:16.930833 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342ffc5-1913-4c0e-94b4-e1be3c8cb0fe None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:16.931345 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342ffc5-1913-4c0e-94b4-e1be3c8cb0fe None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:16.931444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342ffc5-1913-4c0e-94b4-e1be3c8cb0fe None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:16.932871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 520/1018] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:16.937942 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd70a5-63e0-4a26-a323-41ef941c8749 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:16.938594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd70a5-63e0-4a26-a323-41ef941c8749 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:16.938594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd70a5-63e0-4a26-a323-41ef941c8749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:16.955669 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b0cd70a5-63e0-4a26-a323-41ef941c8749 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:16.956818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b0cd70a5-63e0-4a26-a323-41ef941c8749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:16.987136 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:17.034861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 499/1019] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:16 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:17.056210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342ffc5-1913-4c0e-94b4-e1be3c8cb0fe None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:17.164480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342ffc5-1913-4c0e-94b4-e1be3c8cb0fe None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:17.198237 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9fc90-101e-44d0-8fe6-95357ec326c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:17.198933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9fc90-101e-44d0-8fe6-95357ec326c7 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:17.199215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9fc90-101e-44d0-8fe6-95357ec326c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:17.199488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9fc90-101e-44d0-8fe6-95357ec326c7 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:17.200192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9fc90-101e-44d0-8fe6-95357ec326c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:17.201536 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9fc90-101e-44d0-8fe6-95357ec326c7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:17.215920 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 521/1020] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 19 12:19:17 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:19:17.723357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd339698-2d6d-4f66-800d-96c51615e174 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:17.723642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd339698-2d6d-4f66-800d-96c51615e174 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:17.723911 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd339698-2d6d-4f66-800d-96c51615e174 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:17.725437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 500/1021] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:17.730443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efe3c4-8791-4499-9324-04ca365fb93f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:17.730758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efe3c4-8791-4499-9324-04ca365fb93f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:17.731035 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efe3c4-8791-4499-9324-04ca365fb93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:17.748207 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d7efe3c4-8791-4499-9324-04ca365fb93f None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:17.749381 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d7efe3c4-8791-4499-9324-04ca365fb93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:17.805728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:17.828093 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 522/1022] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 12:19:17.852658 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd339698-2d6d-4f66-800d-96c51615e174 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:17.966932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd339698-2d6d-4f66-800d-96c51615e174 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:18.001412 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d96958-7036-4af2-b0f8-06e05806b065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:18.002209 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d96958-7036-4af2-b0f8-06e05806b065 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:18.002487 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d96958-7036-4af2-b0f8-06e05806b065 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:18.002789 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d96958-7036-4af2-b0f8-06e05806b065 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:18.003983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d96958-7036-4af2-b0f8-06e05806b065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:18.005408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d96958-7036-4af2-b0f8-06e05806b065 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:18.007226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 501/1023] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:18.012939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efe3c4-8791-4499-9324-04ca365fb93f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:18.118688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efe3c4-8791-4499-9324-04ca365fb93f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:18.152750 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a00ae5-b257-4543-8c18-65c851500b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:18.153479 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a00ae5-b257-4543-8c18-65c851500b8e None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:18.154113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a00ae5-b257-4543-8c18-65c851500b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:18.154388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a00ae5-b257-4543-8c18-65c851500b8e None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:18.155132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a00ae5-b257-4543-8c18-65c851500b8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:18.157103 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a00ae5-b257-4543-8c18-65c851500b8e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:18.186765 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 523/1024] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 19 12:19:18 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:19:18.402262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0db71e-8d94-43f5-99c9-dd7fd1dc69a8 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:18.402551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0db71e-8d94-43f5-99c9-dd7fd1dc69a8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:18.402860 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0db71e-8d94-43f5-99c9-dd7fd1dc69a8 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:18.404233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 502/1025] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:18.411110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c1ba3-02c4-4354-b04c-23ceab164b1d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:18.411398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c1ba3-02c4-4354-b04c-23ceab164b1d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:18.411666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c1ba3-02c4-4354-b04c-23ceab164b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:18.428767 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ce9c1ba3-02c4-4354-b04c-23ceab164b1d None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:18.429958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ce9c1ba3-02c4-4354-b04c-23ceab164b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:18.465251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:18.506769 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 524/1026] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:18.525738 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0db71e-8d94-43f5-99c9-dd7fd1dc69a8 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:18.558461 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:18.631295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0db71e-8d94-43f5-99c9-dd7fd1dc69a8 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:18.665456 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49cb23-496d-4e3f-a7c6-b96545e56e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:18.666201 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49cb23-496d-4e3f-a7c6-b96545e56e59 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:18.666488 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49cb23-496d-4e3f-a7c6-b96545e56e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:18.666790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49cb23-496d-4e3f-a7c6-b96545e56e59 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:18.677376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49cb23-496d-4e3f-a7c6-b96545e56e59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:19:18.686101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-af49cb23-496d-4e3f-a7c6-b96545e56e59 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 12:19:18.686101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:18.686101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:18.686101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:18.686101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:18.686101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:18.686101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:18.686101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:18.686101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:18.686101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:18.686101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:18.686101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:18.686101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:19:18.686101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:19:18.686101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:19:18.686101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:19:18.687277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:19:18.687277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:19:18.687277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:19:18.687277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:19:18.687277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:18.687277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:18.687277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:18.687277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:18.687277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:18.687277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:18.687277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:18.687277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:18.687277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:18.687277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:18.687277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:18.687277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:18.688643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:18.688643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:18.688643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:18.688643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:18.688643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:19:18.688643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:19:18.688643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:19:18.688643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:19:18.688643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:19:18.688643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:19:18.688643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 12:19:18.688643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:18.691814 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 503/1027] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Jul 19 12:19:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:18.695357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c1ba3-02c4-4354-b04c-23ceab164b1d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:18.797897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c1ba3-02c4-4354-b04c-23ceab164b1d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:18.833375 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a291ab1-f19a-4e15-b03c-dc7bbad24f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:18.834048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a291ab1-f19a-4e15-b03c-dc7bbad24f92 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:18.834329 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a291ab1-f19a-4e15-b03c-dc7bbad24f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:18.834605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a291ab1-f19a-4e15-b03c-dc7bbad24f92 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:18.835383 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a291ab1-f19a-4e15-b03c-dc7bbad24f92 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:18.835688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a291ab1-f19a-4e15-b03c-dc7bbad24f92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:18.837047 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a291ab1-f19a-4e15-b03c-dc7bbad24f92 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:18.845658 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 525/1028] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Jul 19 12:19:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:18.851171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49cb23-496d-4e3f-a7c6-b96545e56e59 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:18.946860 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:18.956774 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49cb23-496d-4e3f-a7c6-b96545e56e59 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:18.991768 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f43ef-460e-4a13-8ad0-e5ff6f856eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:18.992573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f43ef-460e-4a13-8ad0-e5ff6f856eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:18.992857 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f43ef-460e-4a13-8ad0-e5ff6f856eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:18.993133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f43ef-460e-4a13-8ad0-e5ff6f856eb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:19.004178 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f43ef-460e-4a13-8ad0-e5ff6f856eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:19.005612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f43ef-460e-4a13-8ad0-e5ff6f856eb6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:19.023595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-423f43ef-460e-4a13-8ad0-e5ff6f856eb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:19.023595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:19.023595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:19.023595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:19.023595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:19.023595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:19.023595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:19.023595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:19.023595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:19.023595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:19.023595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:19.023595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:19.023595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:19:19.023595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:19:19.023595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:19:19.024458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:19:19.024458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:19.024458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:19.024458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:19.024458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:19.024458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:19.024458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:19.024458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:19.024458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:19.024458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:19.024458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:19.024458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:19.024458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:19.024458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:19.024458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:19.024458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:19.024458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:19.025357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:19:19.025357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:19:19.025357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:19.025357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:19.026115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 504/1029] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:19.030472 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a291ab1-f19a-4e15-b03c-dc7bbad24f92 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:19.065792 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:19.137083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a291ab1-f19a-4e15-b03c-dc7bbad24f92 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:19.172763 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874626b-93fc-4a1d-9cd3-636d299ba32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:19.173604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874626b-93fc-4a1d-9cd3-636d299ba32e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:19.173884 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874626b-93fc-4a1d-9cd3-636d299ba32e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:19.174158 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874626b-93fc-4a1d-9cd3-636d299ba32e None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:19.174901 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874626b-93fc-4a1d-9cd3-636d299ba32e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:19.175209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874626b-93fc-4a1d-9cd3-636d299ba32e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:19.176569 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874626b-93fc-4a1d-9cd3-636d299ba32e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:19.193540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 526/1030] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:19.194986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f43ef-460e-4a13-8ad0-e5ff6f856eb6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:19.288574 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f0398-7163-4ce8-9858-ad30f6c27dce None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:19.288854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f0398-7163-4ce8-9858-ad30f6c27dce None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:19.289037 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f0398-7163-4ce8-9858-ad30f6c27dce None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:19.290526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 527/1031] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:19:19.295188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2758080-0612-40b3-870c-72084ec7e0ab None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:19.295474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2758080-0612-40b3-870c-72084ec7e0ab None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:19.295753 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2758080-0612-40b3-870c-72084ec7e0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:19.298335 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f43ef-460e-4a13-8ad0-e5ff6f856eb6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:19.315624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b2758080-0612-40b3-870c-72084ec7e0ab None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:19.316793 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b2758080-0612-40b3-870c-72084ec7e0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:19.333936 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34555d-12a8-486d-b975-745160b3cd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:19.334880 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34555d-12a8-486d-b975-745160b3cd23 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:19.335169 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34555d-12a8-486d-b975-745160b3cd23 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:19.335564 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34555d-12a8-486d-b975-745160b3cd23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:19.345739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34555d-12a8-486d-b975-745160b3cd23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:19.347377 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34555d-12a8-486d-b975-745160b3cd23 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:19.365612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-0c34555d-12a8-486d-b975-745160b3cd23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 12:19:19.365612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:19.365612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:19.365612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:19.365612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:19.365612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:19.365612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:19.365612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:19.365612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:19.365612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:19.365612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:19.365612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:19.365612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:19:19.365612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:19:19.365612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:19:19.365612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:19:19.366635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:19.366635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:19.366635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:19:19.366635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:19:19.366635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:19:19.366635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:19:19.366635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:19.366635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:19.366635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:19.366635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:19.366635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:19.366635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:19.366635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:19.366635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:19.366635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:19.366635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:19.366635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:19.366635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:19.367616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:19.367616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:19.367616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:19:19.367616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:19:19.367616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:19:19.367616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:19:19.367616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:19:19.367616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:19:19.367616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 12:19:19.367616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:19.367616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 505/1032] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Jul 19 12:19:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:19.372723 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34555d-12a8-486d-b975-745160b3cd23 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:19.376860 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:19.392220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 528/1033] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 12:19:19.414679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2758080-0612-40b3-870c-72084ec7e0ab None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:19.439791 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:19.480140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34555d-12a8-486d-b975-745160b3cd23 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:19.514910 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390076a4-f495-4cce-8fa1-93e80b4fe820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:19.515589 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390076a4-f495-4cce-8fa1-93e80b4fe820 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:19.515721 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2758080-0612-40b3-870c-72084ec7e0ab None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:19.515915 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390076a4-f495-4cce-8fa1-93e80b4fe820 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:19.516680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390076a4-f495-4cce-8fa1-93e80b4fe820 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:19.517926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390076a4-f495-4cce-8fa1-93e80b4fe820 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:19.518259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390076a4-f495-4cce-8fa1-93e80b4fe820 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:19.520531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390076a4-f495-4cce-8fa1-93e80b4fe820 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:19.542898 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 506/1034] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Jul 19 12:19:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:19.543644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390076a4-f495-4cce-8fa1-93e80b4fe820 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:19.552401 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a6059-882a-4327-a008-6c15524de92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:19.553187 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a6059-882a-4327-a008-6c15524de92a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:19.553460 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a6059-882a-4327-a008-6c15524de92a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:19.553720 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a6059-882a-4327-a008-6c15524de92a None admin] PATH_INFO: `/v3/services/image` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:19.554361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a6059-882a-4327-a008-6c15524de92a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:19.555738 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a6059-882a-4327-a008-6c15524de92a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:19.567986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-4f6a6059-882a-4327-a008-6c15524de92a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 12:19:19.567986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:19.567986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:19:19.567986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:19:19.567986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:19:19.567986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:19:19.567986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:19:19.567986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:19.567986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 12:19:19.567986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:19.567986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:19:19.567986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:19.567986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:19.567986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:19.567986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:19.567986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:19.567986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:19.568989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:19.568989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:19.568989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:19.568989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:19.568989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:19.568989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:19.568989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:19:19.568989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:19:19.568989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:19:19.568989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:19:19.568989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:19.568989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:19.568989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:19.568989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:19.568989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:19.568989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:19.569915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:19.569915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:19.569915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:19.569915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:19.569915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:19.569915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:19.569915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:19.569915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:19.569915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:19.569915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:19.569915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:19:19.569915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:19.569915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 12:19:19.569915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:19.569915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 529/1035] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Jul 19 12:19:19 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:19.575022 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a6059-882a-4327-a008-6c15524de92a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:19.612190 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:19.654041 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390076a4-f495-4cce-8fa1-93e80b4fe820 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:19.668939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:19.689798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a6059-882a-4327-a008-6c15524de92a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:19.692526 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706342a-38f0-4825-8c90-b33dd0320ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:19.693194 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706342a-38f0-4825-8c90-b33dd0320ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:19.693481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706342a-38f0-4825-8c90-b33dd0320ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:19.693757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706342a-38f0-4825-8c90-b33dd0320ca5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:19.727095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa2403-055b-4825-bf57-a7b2f70286aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:19.727854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa2403-055b-4825-bf57-a7b2f70286aa None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:19.728429 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa2403-055b-4825-bf57-a7b2f70286aa None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:19.728549 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa2403-055b-4825-bf57-a7b2f70286aa None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:19.729280 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa2403-055b-4825-bf57-a7b2f70286aa None admin] RBAC: Adding query filter params (name=image) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:19.729601 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa2403-055b-4825-bf57-a7b2f70286aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:19.730973 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa2403-055b-4825-bf57-a7b2f70286aa None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:19.736981 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 530/1036] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:19.742689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa2403-055b-4825-bf57-a7b2f70286aa None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:19.770026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706342a-38f0-4825-8c90-b33dd0320ca5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:19.771771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706342a-38f0-4825-8c90-b33dd0320ca5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:19.832331 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:19.852514 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa2403-055b-4825-bf57-a7b2f70286aa None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:19.879862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 507/1037] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:19:19 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 12:19:19.880990 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706342a-38f0-4825-8c90-b33dd0320ca5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:19.893271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a7685-9188-40ef-a630-b378627146dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:19.893935 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a7685-9188-40ef-a630-b378627146dc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:19.894213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a7685-9188-40ef-a630-b378627146dc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:19.894528 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a7685-9188-40ef-a630-b378627146dc None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:19.895204 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a7685-9188-40ef-a630-b378627146dc None admin] RBAC: Adding query filter params (type=image) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:19.895502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a7685-9188-40ef-a630-b378627146dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:19.896902 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a7685-9188-40ef-a630-b378627146dc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:19.902606 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 531/1038] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:19.909140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a7685-9188-40ef-a630-b378627146dc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:19.927290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:19.991988 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706342a-38f0-4825-8c90-b33dd0320ca5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:20.027191 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a7685-9188-40ef-a630-b378627146dc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:20.032436 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3e1bd-0c13-459b-bd68-02197ef95c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:20.033226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3e1bd-0c13-459b-bd68-02197ef95c2e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:20.033499 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3e1bd-0c13-459b-bd68-02197ef95c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:20.033764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3e1bd-0c13-459b-bd68-02197ef95c2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:20.044257 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3e1bd-0c13-459b-bd68-02197ef95c2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:20.045679 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3e1bd-0c13-459b-bd68-02197ef95c2e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:20.065251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-2ee3e1bd-0c13-459b-bd68-02197ef95c2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:20.065251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:20.065251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:20.065251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:20.065251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:20.065251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:20.065251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:20.065251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:20.065251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:20.065251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:20.065251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:20.065251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:20.065251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:19:20.065251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:19:20.065251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:19:20.066238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:19:20.066238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:20.066238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:20.066238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:20.066238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:20.066238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:20.066238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:20.066238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:20.066238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:20.066238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:20.066238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:20.066238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:20.066238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:20.066238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:20.066238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:20.066238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:20.066238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:20.067183 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:19:20.067183 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:19:20.067183 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:20.067183 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:20.067183 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 508/1039] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:20.069795 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d5e62-2783-4498-b248-dc992996a558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:20.070987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d5e62-2783-4498-b248-dc992996a558 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:20.071427 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d5e62-2783-4498-b248-dc992996a558 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:20.071850 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d5e62-2783-4498-b248-dc992996a558 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:20.072047 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3e1bd-0c13-459b-bd68-02197ef95c2e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:20.073050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d5e62-2783-4498-b248-dc992996a558 None admin] RBAC: Adding query filter params (interface=public, service_id=2bb1ddb5e29443a38d5d88747b72a10e, region_id=RegionOne) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:20.073529 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d5e62-2783-4498-b248-dc992996a558 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:20.075276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d5e62-2783-4498-b248-dc992996a558 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:20.082875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 532/1040] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Jul 19 12:19:19 2022] GET /identity/v3/endpoints?service_id=2bb1ddb5e29443a38d5d88747b72a10e&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:20.087650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d5e62-2783-4498-b248-dc992996a558 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:20.090921 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:20.171518 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:20.183089 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3e1bd-0c13-459b-bd68-02197ef95c2e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:20.200041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d5e62-2783-4498-b248-dc992996a558 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:20.220136 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e266d1-2c7f-4ddd-b89a-2078b06f93dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:20.221221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e266d1-2c7f-4ddd-b89a-2078b06f93dd None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:20.221697 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e266d1-2c7f-4ddd-b89a-2078b06f93dd None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:20.222163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e266d1-2c7f-4ddd-b89a-2078b06f93dd None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:20.223463 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e266d1-2c7f-4ddd-b89a-2078b06f93dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:20.223986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e266d1-2c7f-4ddd-b89a-2078b06f93dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:20.226393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e266d1-2c7f-4ddd-b89a-2078b06f93dd None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:20.236398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0359f-f0b8-4799-9773-1bfcda88d031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:20.237063 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0359f-f0b8-4799-9773-1bfcda88d031 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:20.237380 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0359f-f0b8-4799-9773-1bfcda88d031 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:20.237618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0359f-f0b8-4799-9773-1bfcda88d031 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:20.238298 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0359f-f0b8-4799-9773-1bfcda88d031 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:20.239688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0359f-f0b8-4799-9773-1bfcda88d031 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:20.241171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 509/1041] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:20.246687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e266d1-2c7f-4ddd-b89a-2078b06f93dd None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:20.246848 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 533/1042] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Jul 19 12:19:20 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:19:20.303196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556089cc-2f39-4b0f-962e-50cf5646ab99 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:20.303545 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556089cc-2f39-4b0f-962e-50cf5646ab99 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:20.303761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556089cc-2f39-4b0f-962e-50cf5646ab99 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:20.305339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 534/1043] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:19:20.310826 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c496bd2-e4aa-49b4-bf53-3dda3fcbcc73 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:20.311154 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c496bd2-e4aa-49b4-bf53-3dda3fcbcc73 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:20.311399 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c496bd2-e4aa-49b4-bf53-3dda3fcbcc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:20.330296 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6c496bd2-e4aa-49b4-bf53-3dda3fcbcc73 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:20.331608 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6c496bd2-e4aa-49b4-bf53-3dda3fcbcc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:20.338108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:20.370984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e266d1-2c7f-4ddd-b89a-2078b06f93dd None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:20.408275 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 535/1044] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 12:19:20.414215 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6eeee-bdd7-4d11-99ad-db3f4644ccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:20.415053 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6eeee-bdd7-4d11-99ad-db3f4644ccea None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:20.415338 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6eeee-bdd7-4d11-99ad-db3f4644ccea None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:20.416060 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6eeee-bdd7-4d11-99ad-db3f4644ccea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:20.424260 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6eeee-bdd7-4d11-99ad-db3f4644ccea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:20.425683 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6eeee-bdd7-4d11-99ad-db3f4644ccea None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:20.431934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c496bd2-e4aa-49b4-bf53-3dda3fcbcc73 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:20.441532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-8ae6eeee-bdd7-4d11-99ad-db3f4644ccea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:19:20.441532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:20.441532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:20.441532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:20.441532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:20.441532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:20.441532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:20.441532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:20.441532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:20.441532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:20.441532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:20.441532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:20.441532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:19:20.441532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:19:20.441532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:19:20.442448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:19:20.442448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:20.442448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:20.442448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:20.442448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:20.442448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:20.442448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:20.442448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:20.442448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:20.442448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:20.442448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:20.442448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:20.442448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:20.442448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:20.442448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:20.442448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:20.442448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:20.443408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:19:20.443408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:19:20.443408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:19:20.443408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:19:20.443408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:19:20.443408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:19:20.443408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:19:20.443408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:20.443408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 510/1045] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:19:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:20.448659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6eeee-bdd7-4d11-99ad-db3f4644ccea None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:20.508268 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:20.540977 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c496bd2-e4aa-49b4-bf53-3dda3fcbcc73 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:20.562046 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6eeee-bdd7-4d11-99ad-db3f4644ccea None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:20.580874 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be618420-4e54-47a8-81aa-48a4d689f23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:20.581676 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be618420-4e54-47a8-81aa-48a4d689f23a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:20.581957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be618420-4e54-47a8-81aa-48a4d689f23a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:20.582236 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be618420-4e54-47a8-81aa-48a4d689f23a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:20.593740 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be618420-4e54-47a8-81aa-48a4d689f23a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:19:20.596456 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd9448-1883-4b64-9819-71559be121e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:20.597117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd9448-1883-4b64-9819-71559be121e3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:20.597397 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd9448-1883-4b64-9819-71559be121e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:20.597681 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd9448-1883-4b64-9819-71559be121e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:20.598448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd9448-1883-4b64-9819-71559be121e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:20.598772 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd9448-1883-4b64-9819-71559be121e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:20.600176 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd9448-1883-4b64-9819-71559be121e3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:20.601470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-be618420-4e54-47a8-81aa-48a4d689f23a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:19:20.601470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:20.601470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:20.601470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:20.601470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:20.601470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:20.601470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:20.601470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:20.601470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:20.601470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:20.601470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:20.601470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:20.601470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:19:20.601470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:19:20.601470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:19:20.601470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:19:20.602421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:19:20.602421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:19:20.602421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:19:20.602421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:19:20.602421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:20.602421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:20.602421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:20.602421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:20.602421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:20.602421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:20.602421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:20.602421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:20.602421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:20.602421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:20.602421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:20.602421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:20.603905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:20.603905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:20.603905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:20.603905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:20.603905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:19:20.603905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:19:20.603905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:19:20.603905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:19:20.603905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:19:20.603905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:19:20.603905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:19:20.603905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:20.604546 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:20.604618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 536/1046] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:19:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:20.609533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be618420-4e54-47a8-81aa-48a4d689f23a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:20.622067 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 511/1047] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:19:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:20.623201 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd9448-1883-4b64-9819-71559be121e3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:20.723767 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be618420-4e54-47a8-81aa-48a4d689f23a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:20.737192 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd9448-1883-4b64-9819-71559be121e3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:20.757203 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:20.763589 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723efbee-dab6-4c26-b4cd-467836289d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:20.764506 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723efbee-dab6-4c26-b4cd-467836289d38 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:20.764784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723efbee-dab6-4c26-b4cd-467836289d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:20.765052 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723efbee-dab6-4c26-b4cd-467836289d38 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:20.766547 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723efbee-dab6-4c26-b4cd-467836289d38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:20.767028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723efbee-dab6-4c26-b4cd-467836289d38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:20.768415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723efbee-dab6-4c26-b4cd-467836289d38 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:20.776030 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7d669-78c2-41d4-abef-c7f314043954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:20.776694 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7d669-78c2-41d4-abef-c7f314043954 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:20.776977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7d669-78c2-41d4-abef-c7f314043954 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:20.777255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7d669-78c2-41d4-abef-c7f314043954 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:20.778295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7d669-78c2-41d4-abef-c7f314043954 None admin] RBAC: Adding query filter params (role.id=8339ef0a95734b5e815beb576a29d631, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=5d9543657e1e4a6d85632bf57f6ba6eb) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:20.778414 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 537/1048] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:19:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:20.778500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7d669-78c2-41d4-abef-c7f314043954 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:20.779832 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7d669-78c2-41d4-abef-c7f314043954 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:20.784686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723efbee-dab6-4c26-b4cd-467836289d38 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:20.787040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 512/1049] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:19:20 2022] GET /identity/v3/role_assignments?user.id=5d9543657e1e4a6d85632bf57f6ba6eb&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=8339ef0a95734b5e815beb576a29d631 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:20.902685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723efbee-dab6-4c26-b4cd-467836289d38 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:20.942021 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869879d-4d9c-45bd-8bee-aad214aee0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:20.942926 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869879d-4d9c-45bd-8bee-aad214aee0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:20.943213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869879d-4d9c-45bd-8bee-aad214aee0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:20.943483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869879d-4d9c-45bd-8bee-aad214aee0e0 None admin] PATH_INFO: `/v3/users/6c77c86ec8684d7abbbb7c7af918d6d6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:20.957801 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869879d-4d9c-45bd-8bee-aad214aee0e0 None admin] RBAC: Authorizing `identity:get_user(user_id=6c77c86ec8684d7abbbb7c7af918d6d6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:20.959288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869879d-4d9c-45bd-8bee-aad214aee0e0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:20.961205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 538/1050] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:19:20 2022] GET /identity/v3/users/6c77c86ec8684d7abbbb7c7af918d6d6 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:20.967230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7d669-78c2-41d4-abef-c7f314043954 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:21.030186 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:21.074673 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7d669-78c2-41d4-abef-c7f314043954 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:21.109199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe4dad-1f74-4c72-87ff-d35289db65c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:21.110006 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe4dad-1f74-4c72-87ff-d35289db65c1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:21.110293 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe4dad-1f74-4c72-87ff-d35289db65c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:21.110572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe4dad-1f74-4c72-87ff-d35289db65c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:21.179198 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe4dad-1f74-4c72-87ff-d35289db65c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:21.180578 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe4dad-1f74-4c72-87ff-d35289db65c1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:21.239402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:21.289284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 513/1051] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:19:20 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 12:19:21.291111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869879d-4d9c-45bd-8bee-aad214aee0e0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:21.346945 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:21.398463 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869879d-4d9c-45bd-8bee-aad214aee0e0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:21.433545 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b2563-5e8e-445b-ada5-2d82d8275185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:21.434331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b2563-5e8e-445b-ada5-2d82d8275185 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:21.434611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b2563-5e8e-445b-ada5-2d82d8275185 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:21.434916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b2563-5e8e-445b-ada5-2d82d8275185 None admin] PATH_INFO: `/v3/projects/272a04ca8e064883accc8073fbb08fd4` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:21.436088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b2563-5e8e-445b-ada5-2d82d8275185 None admin] RBAC: Authorizing `identity:get_project(project_id=272a04ca8e064883accc8073fbb08fd4)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:21.437520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b2563-5e8e-445b-ada5-2d82d8275185 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:21.439397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 539/1052] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:19:21 2022] GET /identity/v3/projects/272a04ca8e064883accc8073fbb08fd4 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:21.445684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe4dad-1f74-4c72-87ff-d35289db65c1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:21.549437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe4dad-1f74-4c72-87ff-d35289db65c1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:21.583304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408555d-ca93-49b7-bc14-8d65fa0d7433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:21.583951 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408555d-ca93-49b7-bc14-8d65fa0d7433 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:21.584230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408555d-ca93-49b7-bc14-8d65fa0d7433 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:21.584501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408555d-ca93-49b7-bc14-8d65fa0d7433 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:21.585322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408555d-ca93-49b7-bc14-8d65fa0d7433 None admin] RBAC: Adding query filter params (role.id=386cb814e8464fda8832b13c75eabdaf, scope.project.id=272a04ca8e064883accc8073fbb08fd4, user.id=6c77c86ec8684d7abbbb7c7af918d6d6) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:21.585629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408555d-ca93-49b7-bc14-8d65fa0d7433 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:21.587088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408555d-ca93-49b7-bc14-8d65fa0d7433 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:21.598825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 514/1053] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:19:21 2022] GET /identity/v3/role_assignments?user.id=6c77c86ec8684d7abbbb7c7af918d6d6&scope.project.id=272a04ca8e064883accc8073fbb08fd4&role.id=386cb814e8464fda8832b13c75eabdaf => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:22.317240 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa33d80-6c9d-44ee-95e8-e157c52feef3 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:22.317788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa33d80-6c9d-44ee-95e8-e157c52feef3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:22.317788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa33d80-6c9d-44ee-95e8-e157c52feef3 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:22.319305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 540/1054] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:22.324328 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00fd5a-0a60-4045-acfb-f00330787c13 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:22.324729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00fd5a-0a60-4045-acfb-f00330787c13 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:22.324935 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00fd5a-0a60-4045-acfb-f00330787c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:22.342134 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9b00fd5a-0a60-4045-acfb-f00330787c13 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:22.343319 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9b00fd5a-0a60-4045-acfb-f00330787c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:22.360787 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:22.414060 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 515/1055] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 12:19:22.436784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa33d80-6c9d-44ee-95e8-e157c52feef3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:22.542910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa33d80-6c9d-44ee-95e8-e157c52feef3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:22.563870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:22.579535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a2b2e-ce66-4e13-9e20-b5d159b662fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:22.580245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a2b2e-ce66-4e13-9e20-b5d159b662fe None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:22.580520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a2b2e-ce66-4e13-9e20-b5d159b662fe None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:22.580786 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a2b2e-ce66-4e13-9e20-b5d159b662fe None admin] PATH_INFO: `/v3/services/image` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:22.581423 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a2b2e-ce66-4e13-9e20-b5d159b662fe None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:22.582795 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a2b2e-ce66-4e13-9e20-b5d159b662fe None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:22.594953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b71a2b2e-ce66-4e13-9e20-b5d159b662fe None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 12:19:22.594953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:22.594953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:19:22.594953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:19:22.594953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:19:22.594953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:19:22.594953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:19:22.594953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:22.594953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 12:19:22.594953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:22.594953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:19:22.594953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:22.594953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:22.594953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:22.594953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:22.594953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:22.594953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:22.595933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:22.595933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:22.595933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:22.595933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:22.595933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:22.595933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:22.595933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:19:22.595933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:19:22.595933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:19:22.595933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:19:22.595933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:22.595933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:22.595933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:22.595933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:22.595933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:22.595933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:22.596913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:22.596913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:22.596913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:22.596913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:22.596913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:22.596913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:22.596913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:22.596913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:22.596913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:22.596913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:22.596913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:19:22.596913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:19:22.596913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 12:19:22.596913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:22.596913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 541/1056] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Jul 19 12:19:22 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:22.601982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00fd5a-0a60-4045-acfb-f00330787c13 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:22.712152 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00fd5a-0a60-4045-acfb-f00330787c13 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:22.749363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710cd3f-8459-4762-a0a3-7f907b86dda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:22.750024 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710cd3f-8459-4762-a0a3-7f907b86dda5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:22.750355 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710cd3f-8459-4762-a0a3-7f907b86dda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:22.750624 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710cd3f-8459-4762-a0a3-7f907b86dda5 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:22.751354 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710cd3f-8459-4762-a0a3-7f907b86dda5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:22.751656 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710cd3f-8459-4762-a0a3-7f907b86dda5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:22.753022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710cd3f-8459-4762-a0a3-7f907b86dda5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:22.762635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 516/1057] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:22.763650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a2b2e-ce66-4e13-9e20-b5d159b662fe None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:22.835120 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04ca36-d02e-42f4-9f7c-6d411946d726 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:22.835311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04ca36-d02e-42f4-9f7c-6d411946d726 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:22.835596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04ca36-d02e-42f4-9f7c-6d411946d726 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:22.837000 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 517/1058] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:19:22.841884 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abb3f8-9ea5-420c-9d35-7fb657881555 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:22.842634 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abb3f8-9ea5-420c-9d35-7fb657881555 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:22.842958 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abb3f8-9ea5-420c-9d35-7fb657881555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:22.860836 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-47abb3f8-9ea5-420c-9d35-7fb657881555 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:22.862017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-47abb3f8-9ea5-420c-9d35-7fb657881555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:22.868942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a2b2e-ce66-4e13-9e20-b5d159b662fe None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:22.872814 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:22.908559 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fd623-4fe5-487f-bb29-fd855fb85d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:22.909219 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fd623-4fe5-487f-bb29-fd855fb85d77 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:22.909497 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fd623-4fe5-487f-bb29-fd855fb85d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:22.909848 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fd623-4fe5-487f-bb29-fd855fb85d77 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:22.910451 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fd623-4fe5-487f-bb29-fd855fb85d77 None admin] RBAC: Adding query filter params (type=image) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:22.910775 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fd623-4fe5-487f-bb29-fd855fb85d77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:22.912137 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fd623-4fe5-487f-bb29-fd855fb85d77 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:22.917263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 542/1059] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:22.923605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fd623-4fe5-487f-bb29-fd855fb85d77 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:22.933703 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 518/1060] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:22.956932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abb3f8-9ea5-420c-9d35-7fb657881555 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:22.975810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:23.037364 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fd623-4fe5-487f-bb29-fd855fb85d77 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:23.061145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abb3f8-9ea5-420c-9d35-7fb657881555 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:23.074859 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc3a06-8a2c-4882-830d-d9b920ae5660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:23.075516 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc3a06-8a2c-4882-830d-d9b920ae5660 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:23.075802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc3a06-8a2c-4882-830d-d9b920ae5660 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:23.076064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc3a06-8a2c-4882-830d-d9b920ae5660 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:23.076791 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc3a06-8a2c-4882-830d-d9b920ae5660 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:23.078146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc3a06-8a2c-4882-830d-d9b920ae5660 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:23.097817 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf9de7-6281-4818-a5c9-a3e72b9a8222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:23.098433 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 543/1061] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Jul 19 12:19:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:19:23.099124 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf9de7-6281-4818-a5c9-a3e72b9a8222 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:23.099410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf9de7-6281-4818-a5c9-a3e72b9a8222 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:23.099682 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf9de7-6281-4818-a5c9-a3e72b9a8222 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:23.112382 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf9de7-6281-4818-a5c9-a3e72b9a8222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:19:23.121016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-edbf9de7-6281-4818-a5c9-a3e72b9a8222 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 12:19:23.121016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:23.121016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:23.121016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:23.121016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:23.121016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:23.121016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:23.121016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:23.121016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:23.121016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:23.121016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:23.121016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:23.121016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:19:23.121016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:19:23.121016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:19:23.121016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:19:23.122022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:19:23.122022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:19:23.122022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:19:23.122022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:19:23.122022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:23.122022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:23.122022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:23.122022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:23.122022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:23.122022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:23.122022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:23.122022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:23.122022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:23.122022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:23.122022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:23.122022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:23.122920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:23.122920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:23.122920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:23.122920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:23.122920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:19:23.122920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:19:23.122920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:19:23.122920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:19:23.122920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:19:23.122920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:19:23.122920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 12:19:23.122920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:23.127170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 519/1062] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Jul 19 12:19:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:23.129356 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc3a06-8a2c-4882-830d-d9b920ae5660 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:23.246316 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:23.253318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc3a06-8a2c-4882-830d-d9b920ae5660 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:23.290390 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bdfbf-8b3d-469f-9d8a-260e28aa2774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:23.291086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bdfbf-8b3d-469f-9d8a-260e28aa2774 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:23.291365 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bdfbf-8b3d-469f-9d8a-260e28aa2774 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:23.291635 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bdfbf-8b3d-469f-9d8a-260e28aa2774 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:23.292366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bdfbf-8b3d-469f-9d8a-260e28aa2774 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:23.292663 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bdfbf-8b3d-469f-9d8a-260e28aa2774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:23.294014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bdfbf-8b3d-469f-9d8a-260e28aa2774 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:23.302889 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 544/1063] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Jul 19 12:19:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:23.308764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf9de7-6281-4818-a5c9-a3e72b9a8222 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:23.319216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:23.414440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf9de7-6281-4818-a5c9-a3e72b9a8222 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:23.448438 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebdad7-4230-474a-8e52-3fa79e4a7432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:23.449236 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebdad7-4230-474a-8e52-3fa79e4a7432 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:23.449518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebdad7-4230-474a-8e52-3fa79e4a7432 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:23.449794 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebdad7-4230-474a-8e52-3fa79e4a7432 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:23.460937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebdad7-4230-474a-8e52-3fa79e4a7432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:23.462404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebdad7-4230-474a-8e52-3fa79e4a7432 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:23.482122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-cbebdad7-4230-474a-8e52-3fa79e4a7432 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:23.482122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:23.482122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:23.482122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:23.482122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:23.482122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:23.482122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:23.482122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:23.482122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:23.482122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:23.482122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:23.482122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:23.482122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:19:23.482122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:19:23.482122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:19:23.483213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:19:23.483213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:23.483213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:23.483213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:23.483213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:23.483213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:23.483213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:23.483213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:23.483213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:23.483213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:23.483213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:23.483213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:23.483213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:23.483213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:23.483213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:23.483213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:23.483213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:23.484104 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:19:23.484104 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:19:23.484104 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:23.484104 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:23.484104 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 520/1064] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:23.489843 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bdfbf-8b3d-469f-9d8a-260e28aa2774 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:23.597269 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bdfbf-8b3d-469f-9d8a-260e28aa2774 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:23.633505 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cce7b-1165-44f7-b465-62ada8c5c421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:23.634600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cce7b-1165-44f7-b465-62ada8c5c421 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:23.635140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cce7b-1165-44f7-b465-62ada8c5c421 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:23.635617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cce7b-1165-44f7-b465-62ada8c5c421 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:23.636119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f717781-ff25-41f2-b97d-fae9b3ebcf8e None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:23.636407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f717781-ff25-41f2-b97d-fae9b3ebcf8e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:23.636683 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f717781-ff25-41f2-b97d-fae9b3ebcf8e None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:23.637224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00cce7b-1165-44f7-b465-62ada8c5c421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:23.637729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00cce7b-1165-44f7-b465-62ada8c5c421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:23.639585 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00cce7b-1165-44f7-b465-62ada8c5c421 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:23.643017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 521/1065] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:19:23.644242 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdc8ef-1f05-41a3-ae49-06454ef8fe89 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:23.644525 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdc8ef-1f05-41a3-ae49-06454ef8fe89 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:23.644797 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdc8ef-1f05-41a3-ae49-06454ef8fe89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:23.661159 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 545/1066] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:23.662436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cce7b-1165-44f7-b465-62ada8c5c421 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:23.664844 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-97cdc8ef-1f05-41a3-ae49-06454ef8fe89 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:23.666124 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-97cdc8ef-1f05-41a3-ae49-06454ef8fe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:23.688761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:23.733266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:23.749470 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 522/1067] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:23.773024 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cdc8ef-1f05-41a3-ae49-06454ef8fe89 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:23.788199 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cce7b-1165-44f7-b465-62ada8c5c421 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:23.831594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e86c2a-9ad7-44fe-ae3b-0121f2670b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:23.832394 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e86c2a-9ad7-44fe-ae3b-0121f2670b1c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:23.832789 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e86c2a-9ad7-44fe-ae3b-0121f2670b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:23.833064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e86c2a-9ad7-44fe-ae3b-0121f2670b1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:23.841047 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e86c2a-9ad7-44fe-ae3b-0121f2670b1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:23.842676 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e86c2a-9ad7-44fe-ae3b-0121f2670b1c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:23.861925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-63e86c2a-9ad7-44fe-ae3b-0121f2670b1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 12:19:23.861925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:23.861925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:23.861925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:23.861925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:23.861925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:23.861925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:23.861925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:23.861925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:23.861925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:23.861925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:23.861925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:23.861925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:19:23.861925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:19:23.861925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:19:23.861925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:19:23.862960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:23.862960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:23.862960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:19:23.862960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:19:23.862960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:19:23.862960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:19:23.862960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:23.862960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:23.862960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:23.862960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:23.862960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:23.862960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:23.862960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:23.862960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:23.862960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:23.862960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:23.862960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:23.862960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:23.863897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:23.863897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:23.863897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:19:23.863897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:19:23.863897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:19:23.863897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:19:23.863897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:19:23.863897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:19:23.863897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 12:19:23.863897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:23.868092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 546/1068] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Jul 19 12:19:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:23.869122 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e86c2a-9ad7-44fe-ae3b-0121f2670b1c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:23.889575 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cdc8ef-1f05-41a3-ae49-06454ef8fe89 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:23.935579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67280b60-1b43-4df1-a87e-3b0b5c861002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:23.936332 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67280b60-1b43-4df1-a87e-3b0b5c861002 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:23.936623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67280b60-1b43-4df1-a87e-3b0b5c861002 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:23.936899 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67280b60-1b43-4df1-a87e-3b0b5c861002 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:23.949098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67280b60-1b43-4df1-a87e-3b0b5c861002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:19:23.957388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-67280b60-1b43-4df1-a87e-3b0b5c861002 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:19:23.957388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:23.957388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:23.957388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:23.957388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:23.957388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:23.957388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:23.957388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:23.957388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:23.957388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:23.957388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:23.957388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:23.957388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:19:23.957388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:19:23.957388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:19:23.957388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:19:23.958312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:19:23.958312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:19:23.958312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:19:23.958312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:19:23.958312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:23.958312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:23.958312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:23.958312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:23.958312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:23.958312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:23.958312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:23.958312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:23.958312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:23.958312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:23.958312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:23.958312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:23.959594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:23.959594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:23.959594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:23.959594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:23.959594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:19:23.959594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:19:23.959594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:19:23.959594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:19:23.959594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:19:23.959594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:19:23.959594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:19:23.959594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:23.959594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 523/1069] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:19:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:23.965721 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67280b60-1b43-4df1-a87e-3b0b5c861002 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:23.967113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:23.987984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e86c2a-9ad7-44fe-ae3b-0121f2670b1c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:24.020225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:24.025451 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b6f91-1412-4501-8efd-1e712629110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:24.026130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b6f91-1412-4501-8efd-1e712629110e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:24.026417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b6f91-1412-4501-8efd-1e712629110e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:24.026694 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b6f91-1412-4501-8efd-1e712629110e None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:24.027558 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b6f91-1412-4501-8efd-1e712629110e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:24.027865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b6f91-1412-4501-8efd-1e712629110e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:24.029306 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b6f91-1412-4501-8efd-1e712629110e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:24.051524 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 547/1070] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Jul 19 12:19:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:24.052570 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b6f91-1412-4501-8efd-1e712629110e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:24.079300 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67280b60-1b43-4df1-a87e-3b0b5c861002 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:24.113554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c5dc6-a08c-4687-bc50-be0726b3d0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:24.114225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c5dc6-a08c-4687-bc50-be0726b3d0ed None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:24.114507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c5dc6-a08c-4687-bc50-be0726b3d0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:24.114812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c5dc6-a08c-4687-bc50-be0726b3d0ed None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:24.115563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c5dc6-a08c-4687-bc50-be0726b3d0ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:24.115870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c5dc6-a08c-4687-bc50-be0726b3d0ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:24.117224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c5dc6-a08c-4687-bc50-be0726b3d0ed None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:24.132231 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 524/1071] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:19:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:24.133464 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c5dc6-a08c-4687-bc50-be0726b3d0ed None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:24.159032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b6f91-1412-4501-8efd-1e712629110e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:24.193474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ab450-152c-43c6-bf4b-c3b4e1efcd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:24.194186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ab450-152c-43c6-bf4b-c3b4e1efcd89 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:24.194463 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ab450-152c-43c6-bf4b-c3b4e1efcd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:24.194746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ab450-152c-43c6-bf4b-c3b4e1efcd89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:24.202951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:24.205132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ab450-152c-43c6-bf4b-c3b4e1efcd89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:24.207097 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ab450-152c-43c6-bf4b-c3b4e1efcd89 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:24.225650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5d4ab450-152c-43c6-bf4b-c3b4e1efcd89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:24.225650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:24.225650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:24.225650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:24.225650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:24.225650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:24.225650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:24.225650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:24.225650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:24.225650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:24.225650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:24.225650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:24.225650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:19:24.225650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:19:24.225650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:19:24.226591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:19:24.226591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:24.226591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:24.226591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:24.226591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:24.226591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:24.226591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:24.226591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:24.226591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:24.226591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:24.226591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:24.226591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:24.226591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:24.226591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:24.226591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:24.226591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:24.226591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:24.227726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:19:24.227726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:19:24.227726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:24.227726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:24.231642 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 548/1072] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:24.232408 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ab450-152c-43c6-bf4b-c3b4e1efcd89 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:24.245818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c5dc6-a08c-4687-bc50-be0726b3d0ed None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:24.257389 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:24.284826 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774f751-4ec8-4690-9744-966967547a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:24.285734 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774f751-4ec8-4690-9744-966967547a74 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:24.286017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774f751-4ec8-4690-9744-966967547a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:24.286297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774f751-4ec8-4690-9744-966967547a74 None admin] PATH_INFO: `/v3/users/6c77c86ec8684d7abbbb7c7af918d6d6` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:24.287577 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774f751-4ec8-4690-9744-966967547a74 None admin] RBAC: Authorizing `identity:get_user(user_id=6c77c86ec8684d7abbbb7c7af918d6d6)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:24.289002 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774f751-4ec8-4690-9744-966967547a74 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:24.290833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 525/1073] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:19:24 2022] GET /identity/v3/users/6c77c86ec8684d7abbbb7c7af918d6d6 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:24.296395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774f751-4ec8-4690-9744-966967547a74 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:24.339571 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ab450-152c-43c6-bf4b-c3b4e1efcd89 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:24.376132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17008d0-e2aa-47ac-873a-471602eaad52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:24.376796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17008d0-e2aa-47ac-873a-471602eaad52 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:24.377076 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17008d0-e2aa-47ac-873a-471602eaad52 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:24.377349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17008d0-e2aa-47ac-873a-471602eaad52 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:24.378067 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17008d0-e2aa-47ac-873a-471602eaad52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:24.378367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17008d0-e2aa-47ac-873a-471602eaad52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:24.379770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17008d0-e2aa-47ac-873a-471602eaad52 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:24.396428 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 549/1074] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:24.397437 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17008d0-e2aa-47ac-873a-471602eaad52 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:24.402725 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774f751-4ec8-4690-9744-966967547a74 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:24.437370 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796009e6-d8f1-4c7e-9623-9b544c2446e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:24.438361 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796009e6-d8f1-4c7e-9623-9b544c2446e6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:24.438645 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796009e6-d8f1-4c7e-9623-9b544c2446e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:24.438965 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796009e6-d8f1-4c7e-9623-9b544c2446e6 None admin] PATH_INFO: `/v3/projects/272a04ca8e064883accc8073fbb08fd4` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:24.440193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796009e6-d8f1-4c7e-9623-9b544c2446e6 None admin] RBAC: Authorizing `identity:get_project(project_id=272a04ca8e064883accc8073fbb08fd4)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:24.441642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796009e6-d8f1-4c7e-9623-9b544c2446e6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:24.443755 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 526/1075] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:19:24 2022] GET /identity/v3/projects/272a04ca8e064883accc8073fbb08fd4 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:24.449572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796009e6-d8f1-4c7e-9623-9b544c2446e6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:24.459246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:24.497369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:24.513788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17008d0-e2aa-47ac-873a-471602eaad52 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:24.551166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4c215-6556-486c-90b4-4a01a1873b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:24.551952 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4c215-6556-486c-90b4-4a01a1873b6c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:24.552228 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4c215-6556-486c-90b4-4a01a1873b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:24.552492 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4c215-6556-486c-90b4-4a01a1873b6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:24.556404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796009e6-d8f1-4c7e-9623-9b544c2446e6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:24.559309 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4c215-6556-486c-90b4-4a01a1873b6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:24.560733 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4c215-6556-486c-90b4-4a01a1873b6c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:24.575020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-52e4c215-6556-486c-90b4-4a01a1873b6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:19:24.575020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:24.575020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:24.575020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:24.575020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:24.575020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:24.575020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:24.575020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:24.575020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:24.575020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:24.575020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:24.575020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:24.575020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:19:24.575020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:19:24.575020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:19:24.575922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:19:24.575922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:24.575922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:24.575922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:24.575922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:24.575922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:24.575922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:24.575922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:24.575922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:24.575922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:24.575922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:24.575922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:24.575922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:24.575922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:24.575922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:24.575922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:24.575922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:24.576831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:19:24.576831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:19:24.576831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:19:24.576831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:19:24.576831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:19:24.576831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:19:24.576831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:19:24.576831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:24.576831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 550/1076] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:19:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:24.582448 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4c215-6556-486c-90b4-4a01a1873b6c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:24.597332 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c212072-8675-4ec2-99ff-4e19d6496f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:24.598446 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c212072-8675-4ec2-99ff-4e19d6496f46 None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:24.598921 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c212072-8675-4ec2-99ff-4e19d6496f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:24.599455 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c212072-8675-4ec2-99ff-4e19d6496f46 None admin] PATH_INFO: `/v3/projects/272a04ca8e064883accc8073fbb08fd4/users/6c77c86ec8684d7abbbb7c7af918d6d6/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:24.601763 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c212072-8675-4ec2-99ff-4e19d6496f46 None admin] RBAC: Authorizing `identity:create_grant(project_id=272a04ca8e064883accc8073fbb08fd4, user_id=6c77c86ec8684d7abbbb7c7af918d6d6, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:24.603542 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c212072-8675-4ec2-99ff-4e19d6496f46 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:24.621167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 527/1077] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:19:24 2022] PUT /identity/v3/projects/272a04ca8e064883accc8073fbb08fd4/users/6c77c86ec8684d7abbbb7c7af918d6d6/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:19:24.694191 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4c215-6556-486c-90b4-4a01a1873b6c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:24.712348 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:24.737193 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a334ab-a5cb-4400-ba47-46dec1e3c65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:24.737875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a334ab-a5cb-4400-ba47-46dec1e3c65c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:24.738160 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a334ab-a5cb-4400-ba47-46dec1e3c65c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:24.738434 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a334ab-a5cb-4400-ba47-46dec1e3c65c None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:24.739272 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a334ab-a5cb-4400-ba47-46dec1e3c65c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:24.739584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a334ab-a5cb-4400-ba47-46dec1e3c65c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:24.741048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a334ab-a5cb-4400-ba47-46dec1e3c65c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:24.761114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 551/1078] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:19:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:24.763101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c212072-8675-4ec2-99ff-4e19d6496f46 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:24.872288 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c212072-8675-4ec2-99ff-4e19d6496f46 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:24.879841 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:24.910484 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8d5a4-bfc1-419f-bf62-b75c4ed843c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:24.911427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8d5a4-bfc1-419f-bf62-b75c4ed843c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:24.911709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8d5a4-bfc1-419f-bf62-b75c4ed843c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:24.911980 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8d5a4-bfc1-419f-bf62-b75c4ed843c9 None admin] PATH_INFO: `/v3/projects/1ba395a1e22f430084089947e47a622d/users/5d9543657e1e4a6d85632bf57f6ba6eb/roles/8339ef0a95734b5e815beb576a29d631` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:24.914185 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8d5a4-bfc1-419f-bf62-b75c4ed843c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba395a1e22f430084089947e47a622d, user_id=5d9543657e1e4a6d85632bf57f6ba6eb, role_id=8339ef0a95734b5e815beb576a29d631)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:24.915629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8d5a4-bfc1-419f-bf62-b75c4ed843c9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:24.931237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 528/1079] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:19:24 2022] PUT /identity/v3/projects/1ba395a1e22f430084089947e47a622d/users/5d9543657e1e4a6d85632bf57f6ba6eb/roles/8339ef0a95734b5e815beb576a29d631 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:19:25.233343 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9aac1d-8fcd-4329-a5af-a188344fe3df None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:25.233788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9aac1d-8fcd-4329-a5af-a188344fe3df None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:25.233893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9aac1d-8fcd-4329-a5af-a188344fe3df None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:25.236363 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 552/1080] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:25.241444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fca53c-0121-4a2b-b798-171f0d412448 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:25.241742 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fca53c-0121-4a2b-b798-171f0d412448 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:25.242023 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fca53c-0121-4a2b-b798-171f0d412448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:25.259273 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b3fca53c-0121-4a2b-b798-171f0d412448 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:25.260463 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b3fca53c-0121-4a2b-b798-171f0d412448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:25.331278 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 529/1081] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:25.354218 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9aac1d-8fcd-4329-a5af-a188344fe3df None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:25.463694 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9aac1d-8fcd-4329-a5af-a188344fe3df None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:25.496205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d34036-3f43-46db-b2bf-eccbb51d17c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:25.496775 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d34036-3f43-46db-b2bf-eccbb51d17c2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:25.497049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d34036-3f43-46db-b2bf-eccbb51d17c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:25.497316 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d34036-3f43-46db-b2bf-eccbb51d17c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:25.538386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:25.567857 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d34036-3f43-46db-b2bf-eccbb51d17c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:25.569287 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d34036-3f43-46db-b2bf-eccbb51d17c2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:25.669834 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 553/1082] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:19:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 12:19:25.676151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fca53c-0121-4a2b-b798-171f0d412448 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:25.784310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:25.791630 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fca53c-0121-4a2b-b798-171f0d412448 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:25.827451 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877097f-d6d1-490d-8b5e-cb0b67ba7c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:25.828376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877097f-d6d1-490d-8b5e-cb0b67ba7c89 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:25.828770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877097f-d6d1-490d-8b5e-cb0b67ba7c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:25.829046 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877097f-d6d1-490d-8b5e-cb0b67ba7c89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:25.839309 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877097f-d6d1-490d-8b5e-cb0b67ba7c89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:25.840734 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877097f-d6d1-490d-8b5e-cb0b67ba7c89 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:25.858069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-9877097f-d6d1-490d-8b5e-cb0b67ba7c89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:25.858069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:25.858069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:25.858069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:25.858069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:25.858069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:25.858069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:25.858069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:25.858069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:25.858069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:25.858069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:25.858069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:25.858069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:19:25.858069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:19:25.858069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:19:25.859187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:19:25.859187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:25.859187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:25.859187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:25.859187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:25.859187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:25.859187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:25.859187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:25.859187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:25.859187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:25.859187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:25.859187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:25.859187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:25.859187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:25.859187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:25.859187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:25.859187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:25.865891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:19:25.865891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:19:25.865891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:25.865891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:25.865891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 530/1083] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:25.866178 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d34036-3f43-46db-b2bf-eccbb51d17c2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:25.935787 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:25.967477 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d34036-3f43-46db-b2bf-eccbb51d17c2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:26.002306 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457f33d-71dc-46fb-89c4-bc276d7d71ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:26.003341 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457f33d-71dc-46fb-89c4-bc276d7d71ac None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:26.003854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457f33d-71dc-46fb-89c4-bc276d7d71ac None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:26.004333 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457f33d-71dc-46fb-89c4-bc276d7d71ac None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:26.005253 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457f33d-71dc-46fb-89c4-bc276d7d71ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:26.005763 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457f33d-71dc-46fb-89c4-bc276d7d71ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:26.007363 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457f33d-71dc-46fb-89c4-bc276d7d71ac None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:26.026786 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 554/1084] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:26.711236 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab4e73-4c50-41f7-b4bd-c1da1065a83a None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:26.711702 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab4e73-4c50-41f7-b4bd-c1da1065a83a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:26.711950 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab4e73-4c50-41f7-b4bd-c1da1065a83a None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:26.713405 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 531/1085] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:26.718697 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca691b-534e-410d-a177-3abadbfaee21 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:26.719211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca691b-534e-410d-a177-3abadbfaee21 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:26.719435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca691b-534e-410d-a177-3abadbfaee21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:26.737157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a9ca691b-534e-410d-a177-3abadbfaee21 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:26.738333 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a9ca691b-534e-410d-a177-3abadbfaee21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:26.805174 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 555/1086] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:26.828896 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab4e73-4c50-41f7-b4bd-c1da1065a83a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:26.928254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab4e73-4c50-41f7-b4bd-c1da1065a83a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:26.960787 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d195809-9fda-487b-b606-bee1c661813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:26.961508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d195809-9fda-487b-b606-bee1c661813d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:26.961788 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d195809-9fda-487b-b606-bee1c661813d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:26.962060 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d195809-9fda-487b-b606-bee1c661813d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:26.971197 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f41822-c621-4d22-ac0c-916e9a45fb21 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:26.971552 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f41822-c621-4d22-ac0c-916e9a45fb21 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:26.971892 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f41822-c621-4d22-ac0c-916e9a45fb21 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:26.972537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d195809-9fda-487b-b606-bee1c661813d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:19:26.973395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 556/1087] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:19:26.978382 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2520a89-e1e0-4901-9acd-8fe242013930 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:26.978668 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2520a89-e1e0-4901-9acd-8fe242013930 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:26.979055 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2520a89-e1e0-4901-9acd-8fe242013930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:26.980174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-0d195809-9fda-487b-b606-bee1c661813d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:19:26.980174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:26.980174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:26.980174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:26.980174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:26.980174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:26.980174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:26.980174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:26.980174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:26.980174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:26.980174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:26.980174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:26.980174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:19:26.980174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:19:26.980174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:19:26.980174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:19:26.981079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:19:26.981079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:19:26.981079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:19:26.981079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:19:26.981079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:26.981079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:26.981079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:26.981079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:26.981079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:26.981079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:26.981079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:26.981079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:26.981079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:26.981079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:26.981079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:26.981079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:26.981983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:26.981983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:26.981983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:26.981983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:26.981983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:19:26.981983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:19:26.981983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:19:26.981983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:19:26.981983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:19:26.981983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:19:26.981983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:19:26.981983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:26.981983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 532/1088] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:19:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:26.987696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d195809-9fda-487b-b606-bee1c661813d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:26.998243 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:27.001562 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b2520a89-e1e0-4901-9acd-8fe242013930 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:27.002787 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b2520a89-e1e0-4901-9acd-8fe242013930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:27.059565 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:27.071069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 557/1089] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 12:19:27.087222 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d195809-9fda-487b-b606-bee1c661813d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:27.094910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2520a89-e1e0-4901-9acd-8fe242013930 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:27.120258 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a921df-619b-4b40-8e24-479aa7d9cd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:27.120925 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a921df-619b-4b40-8e24-479aa7d9cd15 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:27.121203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a921df-619b-4b40-8e24-479aa7d9cd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:27.121471 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a921df-619b-4b40-8e24-479aa7d9cd15 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:27.122206 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a921df-619b-4b40-8e24-479aa7d9cd15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:27.122507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a921df-619b-4b40-8e24-479aa7d9cd15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:27.123886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a921df-619b-4b40-8e24-479aa7d9cd15 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:27.132432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 533/1090] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:19:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:27.138047 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a921df-619b-4b40-8e24-479aa7d9cd15 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:27.193970 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2520a89-e1e0-4901-9acd-8fe242013930 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:27.204867 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:27.228466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4d356-cb42-41e1-9268-71cf07bafb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:27.229235 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4d356-cb42-41e1-9268-71cf07bafb8e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:27.229515 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4d356-cb42-41e1-9268-71cf07bafb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:27.229784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4d356-cb42-41e1-9268-71cf07bafb8e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:27.238391 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a921df-619b-4b40-8e24-479aa7d9cd15 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:27.240553 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4d356-cb42-41e1-9268-71cf07bafb8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:19:27.248632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-95c4d356-cb42-41e1-9268-71cf07bafb8e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 12:19:27.248632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:27.248632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:27.248632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:27.248632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:27.248632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:27.248632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:27.248632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:27.248632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:27.248632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:27.248632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:27.248632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:27.248632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:19:27.248632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:19:27.248632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:19:27.248632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:19:27.249520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:19:27.249520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:19:27.249520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:19:27.249520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:19:27.249520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:27.249520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:27.249520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:27.249520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:27.249520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:27.249520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:27.249520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:27.249520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:27.249520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:27.249520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:27.249520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:27.249520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:27.250357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:27.250357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:27.250357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:27.250357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:27.250357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:19:27.250357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:19:27.250357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:19:27.250357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:19:27.250357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:19:27.250357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:19:27.250357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 12:19:27.250357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:27.250357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 558/1091] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Jul 19 12:19:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:27.256225 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4d356-cb42-41e1-9268-71cf07bafb8e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:27.274577 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a864d7-6197-41aa-894e-37cdedba826a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:27.275566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a864d7-6197-41aa-894e-37cdedba826a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:27.275853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a864d7-6197-41aa-894e-37cdedba826a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:27.276128 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a864d7-6197-41aa-894e-37cdedba826a None admin] PATH_INFO: `/v3/users/6c77c86ec8684d7abbbb7c7af918d6d6` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:27.277330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a864d7-6197-41aa-894e-37cdedba826a None admin] RBAC: Authorizing `identity:get_user(user_id=6c77c86ec8684d7abbbb7c7af918d6d6)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:27.278768 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a864d7-6197-41aa-894e-37cdedba826a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:27.280416 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 534/1092] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:19:27 2022] GET /identity/v3/users/6c77c86ec8684d7abbbb7c7af918d6d6 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:27.286795 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a864d7-6197-41aa-894e-37cdedba826a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:27.309444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:27.356928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4d356-cb42-41e1-9268-71cf07bafb8e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:27.385869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a864d7-6197-41aa-894e-37cdedba826a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:27.389707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400e5dd-e5de-43a2-a01c-67ecd79037a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:27.390364 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400e5dd-e5de-43a2-a01c-67ecd79037a9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:27.391173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400e5dd-e5de-43a2-a01c-67ecd79037a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:27.391455 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400e5dd-e5de-43a2-a01c-67ecd79037a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:27.392183 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400e5dd-e5de-43a2-a01c-67ecd79037a9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:27.392482 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400e5dd-e5de-43a2-a01c-67ecd79037a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:27.393832 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400e5dd-e5de-43a2-a01c-67ecd79037a9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:27.406260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 559/1093] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Jul 19 12:19:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:27.407781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400e5dd-e5de-43a2-a01c-67ecd79037a9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:27.421410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab3039-53e6-407a-a4fe-40d33bc15b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:27.422361 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab3039-53e6-407a-a4fe-40d33bc15b55 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:27.422641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab3039-53e6-407a-a4fe-40d33bc15b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:27.422953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab3039-53e6-407a-a4fe-40d33bc15b55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:27.431557 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:27.492814 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab3039-53e6-407a-a4fe-40d33bc15b55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:27.494157 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab3039-53e6-407a-a4fe-40d33bc15b55 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:27.510125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400e5dd-e5de-43a2-a01c-67ecd79037a9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:27.524316 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:27.545031 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba516f-5c16-464d-b482-2fe9a42c78bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:27.545816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba516f-5c16-464d-b482-2fe9a42c78bb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:27.546096 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba516f-5c16-464d-b482-2fe9a42c78bb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:27.546366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba516f-5c16-464d-b482-2fe9a42c78bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:27.557427 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba516f-5c16-464d-b482-2fe9a42c78bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:27.558903 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba516f-5c16-464d-b482-2fe9a42c78bb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:27.576243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-51ba516f-5c16-464d-b482-2fe9a42c78bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:27.576243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:27.576243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:27.576243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:27.576243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:27.576243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:27.576243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:27.576243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:27.576243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:27.576243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:27.576243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:27.576243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:27.576243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:19:27.576243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:19:27.576243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:19:27.577425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:19:27.577425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:27.577425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:27.577425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:27.577425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:27.577425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:27.577425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:27.577425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:27.577425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:27.577425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:27.577425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:27.577425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:27.577425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:27.577425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:27.577425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:27.577425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:27.577425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:27.578479 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:19:27.578479 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:19:27.578479 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:27.578479 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:27.578479 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 560/1094] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:27.584593 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba516f-5c16-464d-b482-2fe9a42c78bb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:27.596822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 535/1095] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:19:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 12:19:27.602376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab3039-53e6-407a-a4fe-40d33bc15b55 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:27.641712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:27.687664 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba516f-5c16-464d-b482-2fe9a42c78bb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:27.707098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab3039-53e6-407a-a4fe-40d33bc15b55 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:27.721411 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4548377-af0b-4362-b84c-84eac7bab478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:27.722070 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4548377-af0b-4362-b84c-84eac7bab478 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:27.722347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4548377-af0b-4362-b84c-84eac7bab478 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:27.722622 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4548377-af0b-4362-b84c-84eac7bab478 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:27.723369 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4548377-af0b-4362-b84c-84eac7bab478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:27.723666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4548377-af0b-4362-b84c-84eac7bab478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:27.725008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4548377-af0b-4362-b84c-84eac7bab478 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:27.737186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 561/1096] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:27.741176 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4210ef8-e232-4bec-bfdb-7e698bfdd27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:27.742230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4210ef8-e232-4bec-bfdb-7e698bfdd27e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:27.742549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4210ef8-e232-4bec-bfdb-7e698bfdd27e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:27.742703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4548377-af0b-4362-b84c-84eac7bab478 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:27.742906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4210ef8-e232-4bec-bfdb-7e698bfdd27e None admin] PATH_INFO: `/v3/projects/272a04ca8e064883accc8073fbb08fd4` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:27.744025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4210ef8-e232-4bec-bfdb-7e698bfdd27e None admin] RBAC: Authorizing `identity:get_project(project_id=272a04ca8e064883accc8073fbb08fd4)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:27.745517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4210ef8-e232-4bec-bfdb-7e698bfdd27e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:27.747537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 536/1097] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:19:27 2022] GET /identity/v3/projects/272a04ca8e064883accc8073fbb08fd4 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:27.755030 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4210ef8-e232-4bec-bfdb-7e698bfdd27e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:27.770890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:27.843619 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4548377-af0b-4362-b84c-84eac7bab478 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:27.853010 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4210ef8-e232-4bec-bfdb-7e698bfdd27e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:27.860979 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:27.877943 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0678edc-3999-4731-a8cc-bf0f61728606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:27.878728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0678edc-3999-4731-a8cc-bf0f61728606 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:27.879028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0678edc-3999-4731-a8cc-bf0f61728606 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:27.879296 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0678edc-3999-4731-a8cc-bf0f61728606 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:27.886412 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0678edc-3999-4731-a8cc-bf0f61728606 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:27.887873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0678edc-3999-4731-a8cc-bf0f61728606 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:27.888623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfb996-d7f3-4f33-af38-3aad31299900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:27.889514 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfb996-d7f3-4f33-af38-3aad31299900 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:27.889800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfb996-d7f3-4f33-af38-3aad31299900 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:27.890115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfb996-d7f3-4f33-af38-3aad31299900 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:27.891517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfb996-d7f3-4f33-af38-3aad31299900 None admin] RBAC: Adding query filter params (role.id=386cb814e8464fda8832b13c75eabdaf, scope.project.id=272a04ca8e064883accc8073fbb08fd4, user.id=6c77c86ec8684d7abbbb7c7af918d6d6) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:27.891825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfb996-d7f3-4f33-af38-3aad31299900 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:27.893222 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfb996-d7f3-4f33-af38-3aad31299900 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:27.898884 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 537/1098] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:19:27 2022] GET /identity/v3/role_assignments?user.id=6c77c86ec8684d7abbbb7c7af918d6d6&scope.project.id=272a04ca8e064883accc8073fbb08fd4&role.id=386cb814e8464fda8832b13c75eabdaf => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:27.903413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-e0678edc-3999-4731-a8cc-bf0f61728606 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 12:19:27.903413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:27.903413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:27.903413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:27.903413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:27.903413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:27.903413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:27.903413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:27.903413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:27.903413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:27.903413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:27.903413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:27.903413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:19:27.903413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:19:27.903413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:19:27.903413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:19:27.904540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:27.904540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:27.904540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:19:27.904540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:19:27.904540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:19:27.904540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:19:27.904540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:27.904540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:27.904540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:27.904540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:27.904540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:27.904540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:27.904540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:27.904540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:27.904540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:27.904540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:27.904540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:27.904540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:27.905474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:27.905474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:27.905474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:19:27.905474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:19:27.905474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:19:27.905474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:19:27.905474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:19:27.905474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:19:27.905474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 12:19:27.905474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:27.905474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 562/1099] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Jul 19 12:19:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:19:27.911013 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfb996-d7f3-4f33-af38-3aad31299900 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:28.017843 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfb996-d7f3-4f33-af38-3aad31299900 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:28.052962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbbe25-1115-4177-b6cf-d454f16cb46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:28.053634 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbbe25-1115-4177-b6cf-d454f16cb46f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:28.053913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbbe25-1115-4177-b6cf-d454f16cb46f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:28.054180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbbe25-1115-4177-b6cf-d454f16cb46f None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:28.055040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbbe25-1115-4177-b6cf-d454f16cb46f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:28.056039 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbbe25-1115-4177-b6cf-d454f16cb46f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:28.056814 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbbe25-1115-4177-b6cf-d454f16cb46f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:28.075092 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 538/1100] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Jul 19 12:19:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:28.081164 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0678edc-3999-4731-a8cc-bf0f61728606 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:28.166124 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:28.182184 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0678edc-3999-4731-a8cc-bf0f61728606 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:28.215522 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278ac2b-0215-4f37-8cee-58b70224fc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:28.216162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278ac2b-0215-4f37-8cee-58b70224fc94 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:28.216436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278ac2b-0215-4f37-8cee-58b70224fc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:28.216705 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278ac2b-0215-4f37-8cee-58b70224fc94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:28.283534 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278ac2b-0215-4f37-8cee-58b70224fc94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:28.284893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278ac2b-0215-4f37-8cee-58b70224fc94 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:28.366360 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:28.382621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 563/1101] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:19:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 12:19:28.388455 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbbe25-1115-4177-b6cf-d454f16cb46f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:28.416476 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:28.488004 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbbe25-1115-4177-b6cf-d454f16cb46f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:28.521248 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a8ad4-74ad-45eb-8f57-618d4ae655a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:28.522035 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a8ad4-74ad-45eb-8f57-618d4ae655a5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:28.522309 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a8ad4-74ad-45eb-8f57-618d4ae655a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:28.522576 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a8ad4-74ad-45eb-8f57-618d4ae655a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:28.532777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a8ad4-74ad-45eb-8f57-618d4ae655a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:28.534246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a8ad4-74ad-45eb-8f57-618d4ae655a5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:28.551842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-5c6a8ad4-74ad-45eb-8f57-618d4ae655a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:28.551842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:28.551842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:28.551842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:28.551842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:28.551842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:28.551842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:28.551842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:28.551842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:28.551842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:28.551842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:28.551842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:28.551842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:19:28.551842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:19:28.551842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:19:28.552902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:19:28.552902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:28.552902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:28.552902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:28.552902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:28.552902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:28.552902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:28.552902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:28.552902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:28.552902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:28.552902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:28.552902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:28.552902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:28.552902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:28.552902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:28.552902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:28.552902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:28.554090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:19:28.554090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:19:28.554090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:19:28.554090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:28.554090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 539/1102] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:28.558806 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278ac2b-0215-4f37-8cee-58b70224fc94 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:28.654705 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278ac2b-0215-4f37-8cee-58b70224fc94 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:28.688924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd0a24-6619-4a33-ad37-a78e91df874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:28.689574 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd0a24-6619-4a33-ad37-a78e91df874f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:28.689848 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd0a24-6619-4a33-ad37-a78e91df874f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:28.690114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd0a24-6619-4a33-ad37-a78e91df874f None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:28.690853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd0a24-6619-4a33-ad37-a78e91df874f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:28.691151 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd0a24-6619-4a33-ad37-a78e91df874f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:28.692499 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd0a24-6619-4a33-ad37-a78e91df874f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:28.704245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 564/1103] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:28.709793 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a8ad4-74ad-45eb-8f57-618d4ae655a5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:28.790872 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:28.810034 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a8ad4-74ad-45eb-8f57-618d4ae655a5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:28.842755 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8162d2-644c-431d-8860-de9ec48434bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:28.843545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8162d2-644c-431d-8860-de9ec48434bd None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:28.844371 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8162d2-644c-431d-8860-de9ec48434bd None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:28.844646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8162d2-644c-431d-8860-de9ec48434bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:28.851135 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8162d2-644c-431d-8860-de9ec48434bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:28.852554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8162d2-644c-431d-8860-de9ec48434bd None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:28.866130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-2c8162d2-644c-431d-8860-de9ec48434bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:19:28.866130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:28.866130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:28.866130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:28.866130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:28.866130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:28.866130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:28.866130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:28.866130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:28.866130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:28.866130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:28.866130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:28.866130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:19:28.866130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:19:28.866130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:19:28.867212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:19:28.867212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:28.867212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:28.867212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:28.867212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:28.867212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:28.867212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:28.867212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:28.867212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:28.867212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:28.867212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:28.867212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:28.867212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:28.867212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:28.867212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:28.867212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:28.867212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:28.868535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:19:28.868535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:19:28.868535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:19:28.868535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:19:28.868535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:19:28.868535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:19:28.868535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:19:28.868535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:28.870884 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 540/1104] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:19:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:28.873017 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd0a24-6619-4a33-ad37-a78e91df874f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:28.920786 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:28.974177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd0a24-6619-4a33-ad37-a78e91df874f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:29.006689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4384b89-4644-4d9f-8d4f-035c804a5777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:29.007368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4384b89-4644-4d9f-8d4f-035c804a5777 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:29.007647 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4384b89-4644-4d9f-8d4f-035c804a5777 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:29.007917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4384b89-4644-4d9f-8d4f-035c804a5777 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:29.008688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4384b89-4644-4d9f-8d4f-035c804a5777 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:29.008990 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4384b89-4644-4d9f-8d4f-035c804a5777 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:29.010404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4384b89-4644-4d9f-8d4f-035c804a5777 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:29.023181 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 565/1105] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:19:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:29.029224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8162d2-644c-431d-8860-de9ec48434bd None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:29.129511 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8162d2-644c-431d-8860-de9ec48434bd None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:29.162109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23f426-b450-4433-b0d7-cd1641b37704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:29.162778 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23f426-b450-4433-b0d7-cd1641b37704 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:29.163067 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23f426-b450-4433-b0d7-cd1641b37704 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:29.163341 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23f426-b450-4433-b0d7-cd1641b37704 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:29.164160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23f426-b450-4433-b0d7-cd1641b37704 None admin] RBAC: Adding query filter params (role.id=8339ef0a95734b5e815beb576a29d631, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=5d9543657e1e4a6d85632bf57f6ba6eb) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:29.164466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23f426-b450-4433-b0d7-cd1641b37704 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:29.166223 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23f426-b450-4433-b0d7-cd1641b37704 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:29.182771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 541/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:19:29 2022] GET /identity/v3/role_assignments?user.id=5d9543657e1e4a6d85632bf57f6ba6eb&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=8339ef0a95734b5e815beb576a29d631 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:29.994755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba746665-3294-4ccb-bc27-eafae07d5dc4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:29.995249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba746665-3294-4ccb-bc27-eafae07d5dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:29.995249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba746665-3294-4ccb-bc27-eafae07d5dc4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:29.996570 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 566/1107] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:30.002267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec815d-e365-4e9c-8f53-7afd61d3d649 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:30.002642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec815d-e365-4e9c-8f53-7afd61d3d649 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:30.002850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec815d-e365-4e9c-8f53-7afd61d3d649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:30.008685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:30.020571 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c1ec815d-e365-4e9c-8f53-7afd61d3d649 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:30.021741 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c1ec815d-e365-4e9c-8f53-7afd61d3d649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:30.086671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 542/1108] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:30.111118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba746665-3294-4ccb-bc27-eafae07d5dc4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:30.210527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba746665-3294-4ccb-bc27-eafae07d5dc4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:30.217526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:30.243520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b99c21-3425-4bed-a150-7f0a40c31d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:30.247976 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b99c21-3425-4bed-a150-7f0a40c31d59 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:30.247976 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b99c21-3425-4bed-a150-7f0a40c31d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:30.247976 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b99c21-3425-4bed-a150-7f0a40c31d59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:30.247976 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b99c21-3425-4bed-a150-7f0a40c31d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:30.247976 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b99c21-3425-4bed-a150-7f0a40c31d59 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:30.249022 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 567/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:30.255549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec815d-e365-4e9c-8f53-7afd61d3d649 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:30.350428 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec815d-e365-4e9c-8f53-7afd61d3d649 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:30.384994 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424e37f-0a81-460a-8479-d5a0e53e4cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:30.385655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424e37f-0a81-460a-8479-d5a0e53e4cb3 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:30.385934 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424e37f-0a81-460a-8479-d5a0e53e4cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:30.386202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424e37f-0a81-460a-8479-d5a0e53e4cb3 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:30.386922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424e37f-0a81-460a-8479-d5a0e53e4cb3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:30.388362 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424e37f-0a81-460a-8479-d5a0e53e4cb3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:30.395283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:30.409304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 543/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 19 12:19:30 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:19:32.452677 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac1c19-9b69-45f6-9999-9291b0bd0c66 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:32.453303 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac1c19-9b69-45f6-9999-9291b0bd0c66 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:32.453303 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac1c19-9b69-45f6-9999-9291b0bd0c66 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:32.454727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 568/1111] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:32.460065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730c80b-ec70-4e43-a55c-72decc36d48b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:32.460473 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730c80b-ec70-4e43-a55c-72decc36d48b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:32.460626 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730c80b-ec70-4e43-a55c-72decc36d48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:32.477627 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d730c80b-ec70-4e43-a55c-72decc36d48b None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:32.478845 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d730c80b-ec70-4e43-a55c-72decc36d48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:32.545587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 544/1112] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:32.568963 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac1c19-9b69-45f6-9999-9291b0bd0c66 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:32.668505 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac1c19-9b69-45f6-9999-9291b0bd0c66 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:32.701094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe6c08-befe-4e32-af58-5d62d01296d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:32.701934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe6c08-befe-4e32-af58-5d62d01296d5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:32.702209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe6c08-befe-4e32-af58-5d62d01296d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:32.702477 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe6c08-befe-4e32-af58-5d62d01296d5 None admin] PATH_INFO: `/v3/roles/b929adc09fcc41daaf5cf39de856c1b6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:32.704576 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe6c08-befe-4e32-af58-5d62d01296d5 None admin] RBAC: Authorizing `identity:get_role(role_id=b929adc09fcc41daaf5cf39de856c1b6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:32.705865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe6c08-befe-4e32-af58-5d62d01296d5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:32.707285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 569/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:19:32 2022] GET /identity/v3/roles/b929adc09fcc41daaf5cf39de856c1b6 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:32.713060 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730c80b-ec70-4e43-a55c-72decc36d48b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:32.810197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730c80b-ec70-4e43-a55c-72decc36d48b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:32.830375 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:32.845310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af535dce-e973-486a-9855-9750d1e69cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:32.846178 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af535dce-e973-486a-9855-9750d1e69cea None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:32.846457 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af535dce-e973-486a-9855-9750d1e69cea None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:32.846728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af535dce-e973-486a-9855-9750d1e69cea None admin] PATH_INFO: `/v3/users/488b5e35fb4a464291c7ca2bed4446fc` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:32.860429 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af535dce-e973-486a-9855-9750d1e69cea None admin] RBAC: Authorizing `identity:get_user(user_id=488b5e35fb4a464291c7ca2bed4446fc)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:32.861840 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af535dce-e973-486a-9855-9750d1e69cea None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:32.863530 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 545/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:19:32 2022] GET /identity/v3/users/488b5e35fb4a464291c7ca2bed4446fc => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:32.872106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe6c08-befe-4e32-af58-5d62d01296d5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:32.916733 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:32.971789 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe6c08-befe-4e32-af58-5d62d01296d5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:33.004556 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f4119-3ad3-4be8-a712-e42c0fcc3f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:33.005186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f4119-3ad3-4be8-a712-e42c0fcc3f06 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:33.005465 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f4119-3ad3-4be8-a712-e42c0fcc3f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:33.005737 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f4119-3ad3-4be8-a712-e42c0fcc3f06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:33.070483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f4119-3ad3-4be8-a712-e42c0fcc3f06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:33.071935 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f4119-3ad3-4be8-a712-e42c0fcc3f06 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:33.112172 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:33.168305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 570/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:19:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 12:19:33.174287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af535dce-e973-486a-9855-9750d1e69cea None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:33.271337 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af535dce-e973-486a-9855-9750d1e69cea None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:33.304190 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4a64c-f32d-4e14-9311-7d3715454c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:33.305028 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4a64c-f32d-4e14-9311-7d3715454c25 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:33.305306 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4a64c-f32d-4e14-9311-7d3715454c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:33.305577 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4a64c-f32d-4e14-9311-7d3715454c25 None admin] PATH_INFO: `/v3/projects/272a04ca8e064883accc8073fbb08fd4` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:33.306758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4a64c-f32d-4e14-9311-7d3715454c25 None admin] RBAC: Authorizing `identity:get_project(project_id=272a04ca8e064883accc8073fbb08fd4)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:33.308194 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4a64c-f32d-4e14-9311-7d3715454c25 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:33.309869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 546/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:19:33 2022] GET /identity/v3/projects/272a04ca8e064883accc8073fbb08fd4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:33.315971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f4119-3ad3-4be8-a712-e42c0fcc3f06 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:33.422608 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f4119-3ad3-4be8-a712-e42c0fcc3f06 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:33.455555 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc97a6-d893-4d0a-a61e-c838b989b35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:33.456194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc97a6-d893-4d0a-a61e-c838b989b35a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:33.456464 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc97a6-d893-4d0a-a61e-c838b989b35a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:33.456729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc97a6-d893-4d0a-a61e-c838b989b35a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:33.457532 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc97a6-d893-4d0a-a61e-c838b989b35a None admin] RBAC: Adding query filter params (role.id=b929adc09fcc41daaf5cf39de856c1b6, scope.project.id=272a04ca8e064883accc8073fbb08fd4, user.id=488b5e35fb4a464291c7ca2bed4446fc) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:33.457832 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc97a6-d893-4d0a-a61e-c838b989b35a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:33.459270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc97a6-d893-4d0a-a61e-c838b989b35a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:33.464490 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 571/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:19:33 2022] GET /identity/v3/role_assignments?user.id=488b5e35fb4a464291c7ca2bed4446fc&scope.project.id=272a04ca8e064883accc8073fbb08fd4&role.id=b929adc09fcc41daaf5cf39de856c1b6 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:35.451388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea6dc4-a54a-4638-a346-0e09433e4e53 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:35.451948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea6dc4-a54a-4638-a346-0e09433e4e53 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:35.451948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea6dc4-a54a-4638-a346-0e09433e4e53 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:35.454304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 547/1118] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:35.459545 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c56cd7-c220-4098-a678-2af0649edc08 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:35.459955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c56cd7-c220-4098-a678-2af0649edc08 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:35.460087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c56cd7-c220-4098-a678-2af0649edc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:35.471109 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:35.477409 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a8c56cd7-c220-4098-a678-2af0649edc08 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:35.478577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a8c56cd7-c220-4098-a678-2af0649edc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:35.543239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 572/1119] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:35.566382 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea6dc4-a54a-4638-a346-0e09433e4e53 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:35.611907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:35.664209 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea6dc4-a54a-4638-a346-0e09433e4e53 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:35.697129 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53602b6-b25b-477a-869c-8fe02c29bef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:35.697969 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53602b6-b25b-477a-869c-8fe02c29bef3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:35.698246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53602b6-b25b-477a-869c-8fe02c29bef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:35.698515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53602b6-b25b-477a-869c-8fe02c29bef3 None admin] PATH_INFO: `/v3/roles/b929adc09fcc41daaf5cf39de856c1b6` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:35.700087 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53602b6-b25b-477a-869c-8fe02c29bef3 None admin] RBAC: Authorizing `identity:get_role(role_id=b929adc09fcc41daaf5cf39de856c1b6)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:35.701339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53602b6-b25b-477a-869c-8fe02c29bef3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:35.702772 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 548/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:19:35 2022] GET /identity/v3/roles/b929adc09fcc41daaf5cf39de856c1b6 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:35.708583 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c56cd7-c220-4098-a678-2af0649edc08 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:35.805935 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c56cd7-c220-4098-a678-2af0649edc08 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:35.839857 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edab65-ad60-4bc4-9d0e-4dab615ce4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:35.840716 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edab65-ad60-4bc4-9d0e-4dab615ce4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:35.840995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edab65-ad60-4bc4-9d0e-4dab615ce4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:35.841263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edab65-ad60-4bc4-9d0e-4dab615ce4a9 None admin] PATH_INFO: `/v3/users/488b5e35fb4a464291c7ca2bed4446fc` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:35.842443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edab65-ad60-4bc4-9d0e-4dab615ce4a9 None admin] RBAC: Authorizing `identity:get_user(user_id=488b5e35fb4a464291c7ca2bed4446fc)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:35.844002 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edab65-ad60-4bc4-9d0e-4dab615ce4a9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:35.845604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 573/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:19:35 2022] GET /identity/v3/users/488b5e35fb4a464291c7ca2bed4446fc => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:35.851241 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53602b6-b25b-477a-869c-8fe02c29bef3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:35.946501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53602b6-b25b-477a-869c-8fe02c29bef3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:35.959914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:35.980016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c14750-4386-4d43-925d-0299eb388d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:35.980858 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c14750-4386-4d43-925d-0299eb388d47 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:35.981136 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c14750-4386-4d43-925d-0299eb388d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:35.981404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c14750-4386-4d43-925d-0299eb388d47 None admin] PATH_INFO: `/v3/projects/272a04ca8e064883accc8073fbb08fd4` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:35.982559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c14750-4386-4d43-925d-0299eb388d47 None admin] RBAC: Authorizing `identity:get_project(project_id=272a04ca8e064883accc8073fbb08fd4)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:35.983985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c14750-4386-4d43-925d-0299eb388d47 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:35.985885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 549/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:19:35 2022] GET /identity/v3/projects/272a04ca8e064883accc8073fbb08fd4 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:35.991862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edab65-ad60-4bc4-9d0e-4dab615ce4a9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:35.995576 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:36.094966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edab65-ad60-4bc4-9d0e-4dab615ce4a9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:36.128533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0ced0-aa23-4f76-a027-73c961c903eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:36.129417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0ced0-aa23-4f76-a027-73c961c903eb None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:36.129697 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0ced0-aa23-4f76-a027-73c961c903eb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:36.129971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0ced0-aa23-4f76-a027-73c961c903eb None admin] PATH_INFO: `/v3/projects/272a04ca8e064883accc8073fbb08fd4/users/488b5e35fb4a464291c7ca2bed4446fc/roles/b929adc09fcc41daaf5cf39de856c1b6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:36.132896 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0ced0-aa23-4f76-a027-73c961c903eb None admin] RBAC: Authorizing `identity:create_grant(project_id=272a04ca8e064883accc8073fbb08fd4, user_id=488b5e35fb4a464291c7ca2bed4446fc, role_id=b929adc09fcc41daaf5cf39de856c1b6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:36.134318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0ced0-aa23-4f76-a027-73c961c903eb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:36.148593 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 574/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:19:35 2022] PUT /identity/v3/projects/272a04ca8e064883accc8073fbb08fd4/users/488b5e35fb4a464291c7ca2bed4446fc/roles/b929adc09fcc41daaf5cf39de856c1b6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:19:38.155285 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8e952-bce9-4530-993d-55e0965f9dc4 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:38.155806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8e952-bce9-4530-993d-55e0965f9dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:38.155907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8e952-bce9-4530-993d-55e0965f9dc4 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:38.157703 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 550/1124] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:38.162754 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1680c-6c49-469f-8d6f-88a5d576f3f2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:38.163148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1680c-6c49-469f-8d6f-88a5d576f3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:38.163310 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1680c-6c49-469f-8d6f-88a5d576f3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:38.180644 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d7c1680c-6c49-469f-8d6f-88a5d576f3f2 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:38.181811 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d7c1680c-6c49-469f-8d6f-88a5d576f3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:38.239608 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:38.248604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 575/1125] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:38.271984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8e952-bce9-4530-993d-55e0965f9dc4 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:38.370594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8e952-bce9-4530-993d-55e0965f9dc4 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:38.403005 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a4c2b-e7f2-428c-b292-e481a684875a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:38.403837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a4c2b-e7f2-428c-b292-e481a684875a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:38.404112 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a4c2b-e7f2-428c-b292-e481a684875a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:38.404377 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a4c2b-e7f2-428c-b292-e481a684875a None admin] PATH_INFO: `/v3/roles/b929adc09fcc41daaf5cf39de856c1b6` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:38.405889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a4c2b-e7f2-428c-b292-e481a684875a None admin] RBAC: Authorizing `identity:get_role(role_id=b929adc09fcc41daaf5cf39de856c1b6)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:38.407868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a4c2b-e7f2-428c-b292-e481a684875a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:38.409212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 551/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:19:38 2022] GET /identity/v3/roles/b929adc09fcc41daaf5cf39de856c1b6 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:38.414985 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1680c-6c49-469f-8d6f-88a5d576f3f2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:38.511933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1680c-6c49-469f-8d6f-88a5d576f3f2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:38.545610 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d6ef3-c29b-4e51-8fa0-4e72bdbebc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:38.546477 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6ef3-c29b-4e51-8fa0-4e72bdbebc38 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:38.546850 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6ef3-c29b-4e51-8fa0-4e72bdbebc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:38.547295 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6ef3-c29b-4e51-8fa0-4e72bdbebc38 None admin] PATH_INFO: `/v3/users/488b5e35fb4a464291c7ca2bed4446fc` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:38.548486 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d6ef3-c29b-4e51-8fa0-4e72bdbebc38 None admin] RBAC: Authorizing `identity:get_user(user_id=488b5e35fb4a464291c7ca2bed4446fc)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:38.549912 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d6ef3-c29b-4e51-8fa0-4e72bdbebc38 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:38.551552 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 576/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:19:38 2022] GET /identity/v3/users/488b5e35fb4a464291c7ca2bed4446fc => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:38.557318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a4c2b-e7f2-428c-b292-e481a684875a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:38.607422 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:38.655766 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a4c2b-e7f2-428c-b292-e481a684875a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:38.689148 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa66427-6bfb-40c2-bffe-2d32338388bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:38.689739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa66427-6bfb-40c2-bffe-2d32338388bd None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:38.690025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa66427-6bfb-40c2-bffe-2d32338388bd None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:38.690302 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa66427-6bfb-40c2-bffe-2d32338388bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:38.755651 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa66427-6bfb-40c2-bffe-2d32338388bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:38.757085 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa66427-6bfb-40c2-bffe-2d32338388bd None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:38.804693 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:38.854211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 552/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:19:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 12:19:38.860136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d6ef3-c29b-4e51-8fa0-4e72bdbebc38 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:38.923499 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:38.961537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d6ef3-c29b-4e51-8fa0-4e72bdbebc38 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:38.993328 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4a375-d91b-45bc-8c66-e63c4bbfe25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:38.994163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4a375-d91b-45bc-8c66-e63c4bbfe25a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:38.994437 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4a375-d91b-45bc-8c66-e63c4bbfe25a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:38.994704 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4a375-d91b-45bc-8c66-e63c4bbfe25a None admin] PATH_INFO: `/v3/projects/272a04ca8e064883accc8073fbb08fd4` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:38.995877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4a375-d91b-45bc-8c66-e63c4bbfe25a None admin] RBAC: Authorizing `identity:get_project(project_id=272a04ca8e064883accc8073fbb08fd4)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:38.997288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4a375-d91b-45bc-8c66-e63c4bbfe25a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:38.998964 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 577/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:19:38 2022] GET /identity/v3/projects/272a04ca8e064883accc8073fbb08fd4 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:39.005923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa66427-6bfb-40c2-bffe-2d32338388bd None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:39.101903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa66427-6bfb-40c2-bffe-2d32338388bd None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:39.134482 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e552499-ffa6-48b9-ba1c-17f50dc25cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:39.135143 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e552499-ffa6-48b9-ba1c-17f50dc25cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:39.135423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e552499-ffa6-48b9-ba1c-17f50dc25cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:39.135692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e552499-ffa6-48b9-ba1c-17f50dc25cb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:39.136504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e552499-ffa6-48b9-ba1c-17f50dc25cb0 None admin] RBAC: Adding query filter params (role.id=b929adc09fcc41daaf5cf39de856c1b6, scope.project.id=272a04ca8e064883accc8073fbb08fd4, user.id=488b5e35fb4a464291c7ca2bed4446fc) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:39.136807 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e552499-ffa6-48b9-ba1c-17f50dc25cb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:39.138218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e552499-ffa6-48b9-ba1c-17f50dc25cb0 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:39.144783 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 553/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:19:39 2022] GET /identity/v3/role_assignments?user.id=488b5e35fb4a464291c7ca2bed4446fc&scope.project.id=272a04ca8e064883accc8073fbb08fd4&role.id=b929adc09fcc41daaf5cf39de856c1b6 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:41.173846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa548992-fc40-4dda-a1ce-9095069936d4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:41.174358 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa548992-fc40-4dda-a1ce-9095069936d4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:41.174358 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa548992-fc40-4dda-a1ce-9095069936d4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:41.175819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 578/1131] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:41.180896 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132ce38-8e4d-44e5-9524-c59c660b7f5e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:41.181634 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132ce38-8e4d-44e5-9524-c59c660b7f5e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:41.181915 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132ce38-8e4d-44e5-9524-c59c660b7f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:41.198487 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7132ce38-8e4d-44e5-9524-c59c660b7f5e None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:41.199695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7132ce38-8e4d-44e5-9524-c59c660b7f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:41.209054 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:41.266372 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 554/1132] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:41.289697 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa548992-fc40-4dda-a1ce-9095069936d4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:41.389729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa548992-fc40-4dda-a1ce-9095069936d4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:41.418120 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:41.424834 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb59c3c-cf78-4dd5-890e-8c7099c24f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:41.425552 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb59c3c-cf78-4dd5-890e-8c7099c24f51 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:41.425834 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb59c3c-cf78-4dd5-890e-8c7099c24f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:41.426107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb59c3c-cf78-4dd5-890e-8c7099c24f51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:41.427304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb59c3c-cf78-4dd5-890e-8c7099c24f51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:41.428728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb59c3c-cf78-4dd5-890e-8c7099c24f51 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:41.430319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 579/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:41.436092 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132ce38-8e4d-44e5-9524-c59c660b7f5e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:41.532625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132ce38-8e4d-44e5-9524-c59c660b7f5e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:41.564647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b46094-7c53-464e-b708-50cde8da4794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:41.565296 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b46094-7c53-464e-b708-50cde8da4794 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:41.565579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b46094-7c53-464e-b708-50cde8da4794 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:41.565855 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b46094-7c53-464e-b708-50cde8da4794 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:41.566552 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b46094-7c53-464e-b708-50cde8da4794 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:41.568004 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b46094-7c53-464e-b708-50cde8da4794 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:41.581706 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:41.593842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 555/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 19 12:19:41 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:19:43.616128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ea6ee-c3c1-4a35-9045-5943fa5816b1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:43.616659 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ea6ee-c3c1-4a35-9045-5943fa5816b1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:43.616659 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ea6ee-c3c1-4a35-9045-5943fa5816b1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:43.618041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 580/1135] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:43.623143 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a35b9-6a62-402b-8534-d8adade281be None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:43.623519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a35b9-6a62-402b-8534-d8adade281be None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:43.623685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a35b9-6a62-402b-8534-d8adade281be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:43.640260 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9c1a35b9-6a62-402b-8534-d8adade281be None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:43.641428 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9c1a35b9-6a62-402b-8534-d8adade281be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:43.705918 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 556/1136] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:43.730391 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ea6ee-c3c1-4a35-9045-5943fa5816b1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:43.830253 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ea6ee-c3c1-4a35-9045-5943fa5816b1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:43.862741 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802f0a7-2ba3-496d-aff9-8fe0738836e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:43.863525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802f0a7-2ba3-496d-aff9-8fe0738836e7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:43.863798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802f0a7-2ba3-496d-aff9-8fe0738836e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:43.864062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802f0a7-2ba3-496d-aff9-8fe0738836e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:43.865231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802f0a7-2ba3-496d-aff9-8fe0738836e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:43.866718 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802f0a7-2ba3-496d-aff9-8fe0738836e7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:43.868253 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 581/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:19:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:43.873866 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a35b9-6a62-402b-8534-d8adade281be None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:43.972024 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a35b9-6a62-402b-8534-d8adade281be None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:43.996794 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:44.005828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04958cb2-5a04-450c-8445-5e2163d6004b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:44.006489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04958cb2-5a04-450c-8445-5e2163d6004b None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:44.006801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04958cb2-5a04-450c-8445-5e2163d6004b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:44.007076 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04958cb2-5a04-450c-8445-5e2163d6004b None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:44.007773 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04958cb2-5a04-450c-8445-5e2163d6004b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:44.009187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04958cb2-5a04-450c-8445-5e2163d6004b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:44.029658 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 557/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 19 12:19:43 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:19:46.088703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee6833-40a8-4c57-8d4f-640353f9fbd1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:46.089216 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee6833-40a8-4c57-8d4f-640353f9fbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:46.089216 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee6833-40a8-4c57-8d4f-640353f9fbd1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:46.090498 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 582/1139] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:46.096313 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8df61f-42fb-40fc-8615-be0e73fb9a99 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:46.096702 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8df61f-42fb-40fc-8615-be0e73fb9a99 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:46.096862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8df61f-42fb-40fc-8615-be0e73fb9a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:46.114060 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-1f8df61f-42fb-40fc-8615-be0e73fb9a99 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:46.115254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1f8df61f-42fb-40fc-8615-be0e73fb9a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:46.180541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 558/1140] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:46.204203 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee6833-40a8-4c57-8d4f-640353f9fbd1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:46.270490 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:46.305914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee6833-40a8-4c57-8d4f-640353f9fbd1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:46.338983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9932f-f158-45ff-9790-a7294d1dd658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:46.339701 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9932f-f158-45ff-9790-a7294d1dd658 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:46.339983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9932f-f158-45ff-9790-a7294d1dd658 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:46.340259 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9932f-f158-45ff-9790-a7294d1dd658 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:46.350458 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9932f-f158-45ff-9790-a7294d1dd658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:19:46.358104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-93e9932f-f158-45ff-9790-a7294d1dd658 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:19:46.358104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:46.358104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:46.358104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:46.358104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:46.358104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:46.358104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:46.358104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:46.358104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:46.358104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:46.358104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:46.358104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:46.358104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:19:46.358104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:19:46.358104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:19:46.358104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:19:46.359905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:19:46.359905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:19:46.359905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:19:46.359905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:19:46.359905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:46.359905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:46.359905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:46.359905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:46.359905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:46.359905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:46.359905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:46.359905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:46.359905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:46.359905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:46.359905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:46.359905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:46.360797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:46.360797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:46.360797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:46.360797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:46.360797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:19:46.360797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:19:46.360797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:19:46.360797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:19:46.360797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:19:46.360797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:19:46.360797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:19:46.360797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:46.360797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 583/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:19:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:46.366111 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8df61f-42fb-40fc-8615-be0e73fb9a99 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:46.461676 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8df61f-42fb-40fc-8615-be0e73fb9a99 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:46.475212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:46.496966 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600f098-9051-42c0-9db0-0ff94bb2438f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:46.497627 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600f098-9051-42c0-9db0-0ff94bb2438f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:46.497912 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600f098-9051-42c0-9db0-0ff94bb2438f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:46.498193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600f098-9051-42c0-9db0-0ff94bb2438f None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:46.498960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600f098-9051-42c0-9db0-0ff94bb2438f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:46.499265 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600f098-9051-42c0-9db0-0ff94bb2438f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:46.500665 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600f098-9051-42c0-9db0-0ff94bb2438f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:46.508479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 559/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:19:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:46.514163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9932f-f158-45ff-9790-a7294d1dd658 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:46.611783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9932f-f158-45ff-9790-a7294d1dd658 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:46.636065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:46.645919 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24602025-81ca-4a68-ab5c-51334dab8ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:46.646793 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24602025-81ca-4a68-ab5c-51334dab8ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:46.647072 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24602025-81ca-4a68-ab5c-51334dab8ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:46.647339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24602025-81ca-4a68-ab5c-51334dab8ba6 None admin] PATH_INFO: `/v3/users/86cf828f745447bfb96fd0d84bdd92af` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:46.660083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24602025-81ca-4a68-ab5c-51334dab8ba6 None admin] RBAC: Authorizing `identity:get_user(user_id=86cf828f745447bfb96fd0d84bdd92af)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:46.661504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24602025-81ca-4a68-ab5c-51334dab8ba6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:46.663121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 584/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:19:46 2022] GET /identity/v3/users/86cf828f745447bfb96fd0d84bdd92af => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:46.668735 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600f098-9051-42c0-9db0-0ff94bb2438f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:46.765811 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600f098-9051-42c0-9db0-0ff94bb2438f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:46.798149 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528d787-149f-4de5-a17d-8449b8b799b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:46.798812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528d787-149f-4de5-a17d-8449b8b799b1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:46.799095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528d787-149f-4de5-a17d-8449b8b799b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:46.799367 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528d787-149f-4de5-a17d-8449b8b799b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:46.839649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:46.864903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528d787-149f-4de5-a17d-8449b8b799b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:46.866261 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528d787-149f-4de5-a17d-8449b8b799b1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:46.961568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 560/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:19:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 12:19:46.967508 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24602025-81ca-4a68-ab5c-51334dab8ba6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:47.064826 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24602025-81ca-4a68-ab5c-51334dab8ba6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:47.098755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2d205-c837-4462-b980-7f8eda8d46a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:47.099594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2d205-c837-4462-b980-7f8eda8d46a5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:47.099872 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2d205-c837-4462-b980-7f8eda8d46a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:47.100143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2d205-c837-4462-b980-7f8eda8d46a5 None admin] PATH_INFO: `/v3/projects/a1a3de4827e74f58aba48aedd16e78e3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:47.101318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2d205-c837-4462-b980-7f8eda8d46a5 None admin] RBAC: Authorizing `identity:get_project(project_id=a1a3de4827e74f58aba48aedd16e78e3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:47.102757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2d205-c837-4462-b980-7f8eda8d46a5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:47.104434 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 585/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:19:46 2022] GET /identity/v3/projects/a1a3de4827e74f58aba48aedd16e78e3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:47.111138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528d787-149f-4de5-a17d-8449b8b799b1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:47.184312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:47.209156 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528d787-149f-4de5-a17d-8449b8b799b1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:47.242897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971557dc-ef2d-4e4e-81e9-eb0467c09e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:47.243543 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971557dc-ef2d-4e4e-81e9-eb0467c09e92 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:47.243826 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971557dc-ef2d-4e4e-81e9-eb0467c09e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:47.244099 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971557dc-ef2d-4e4e-81e9-eb0467c09e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:47.244927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971557dc-ef2d-4e4e-81e9-eb0467c09e92 None admin] RBAC: Adding query filter params (role.id=386cb814e8464fda8832b13c75eabdaf, scope.project.id=a1a3de4827e74f58aba48aedd16e78e3, user.id=86cf828f745447bfb96fd0d84bdd92af) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:47.245239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971557dc-ef2d-4e4e-81e9-eb0467c09e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:47.246670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971557dc-ef2d-4e4e-81e9-eb0467c09e92 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:47.252005 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 561/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:19:47 2022] GET /identity/v3/role_assignments?user.id=86cf828f745447bfb96fd0d84bdd92af&scope.project.id=a1a3de4827e74f58aba48aedd16e78e3&role.id=386cb814e8464fda8832b13c75eabdaf => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:49.380604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e50e1d-5114-4aee-b9d4-ff09eeeb44d1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:49.381155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e50e1d-5114-4aee-b9d4-ff09eeeb44d1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:49.381155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e50e1d-5114-4aee-b9d4-ff09eeeb44d1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:49.382493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 586/1147] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:49.387703 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75ac6a-f5d7-4f03-85f0-d153e817d346 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:49.388129 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75ac6a-f5d7-4f03-85f0-d153e817d346 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:49.388263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75ac6a-f5d7-4f03-85f0-d153e817d346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:49.405547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0c75ac6a-f5d7-4f03-85f0-d153e817d346 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:49.407529 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0c75ac6a-f5d7-4f03-85f0-d153e817d346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:49.473792 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 562/1148] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:49.496332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e50e1d-5114-4aee-b9d4-ff09eeeb44d1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:49.549565 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:49.596240 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e50e1d-5114-4aee-b9d4-ff09eeeb44d1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:49.629235 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146b987-9c57-482d-82f7-ffdf5a0a4bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:49.630004 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146b987-9c57-482d-82f7-ffdf5a0a4bfb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:49.630285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146b987-9c57-482d-82f7-ffdf5a0a4bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:49.630554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146b987-9c57-482d-82f7-ffdf5a0a4bfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:49.640673 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146b987-9c57-482d-82f7-ffdf5a0a4bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:19:49.648186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-4146b987-9c57-482d-82f7-ffdf5a0a4bfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:19:49.648186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:49.648186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:49.648186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:49.648186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:49.648186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:49.648186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:49.648186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:49.648186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:49.648186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:49.648186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:49.648186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:49.648186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:19:49.648186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:19:49.648186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:19:49.648186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:19:49.649252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:19:49.649252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:19:49.649252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:19:49.649252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:19:49.649252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:49.649252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:49.649252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:49.649252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:49.649252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:49.649252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:49.649252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:49.649252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:49.649252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:49.649252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:49.649252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:49.649252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:49.650256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:49.650256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:49.650256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:49.650256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:49.650256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:19:49.650256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:19:49.650256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:19:49.650256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:19:49.650256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:19:49.650256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:19:49.650256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:19:49.650256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:49.650256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 587/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:19:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:49.655353 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75ac6a-f5d7-4f03-85f0-d153e817d346 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:49.720368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:49.752981 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75ac6a-f5d7-4f03-85f0-d153e817d346 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:49.785687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d88060-e884-4882-85e2-22d8a41174cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:49.786340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88060-e884-4882-85e2-22d8a41174cc None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:49.786619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88060-e884-4882-85e2-22d8a41174cc None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:49.786921 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88060-e884-4882-85e2-22d8a41174cc None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:49.787651 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d88060-e884-4882-85e2-22d8a41174cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:49.787949 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d88060-e884-4882-85e2-22d8a41174cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:49.789296 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d88060-e884-4882-85e2-22d8a41174cc None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:49.797732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 563/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:19:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:19:49.803604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146b987-9c57-482d-82f7-ffdf5a0a4bfb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:49.900259 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146b987-9c57-482d-82f7-ffdf5a0a4bfb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:49.912664 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:49.934109 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcbab9-ab8c-4a0e-bb51-ba619918672a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:49.934987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcbab9-ab8c-4a0e-bb51-ba619918672a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:49.935259 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcbab9-ab8c-4a0e-bb51-ba619918672a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:49.935524 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcbab9-ab8c-4a0e-bb51-ba619918672a None admin] PATH_INFO: `/v3/users/86cf828f745447bfb96fd0d84bdd92af` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:49.936686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fcbab9-ab8c-4a0e-bb51-ba619918672a None admin] RBAC: Authorizing `identity:get_user(user_id=86cf828f745447bfb96fd0d84bdd92af)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:49.938915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fcbab9-ab8c-4a0e-bb51-ba619918672a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:49.940501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 588/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:19:49 2022] GET /identity/v3/users/86cf828f745447bfb96fd0d84bdd92af => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:49.946210 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d88060-e884-4882-85e2-22d8a41174cc None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:50.040809 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d88060-e884-4882-85e2-22d8a41174cc None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:50.068114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:50.074277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a84b1-e909-4462-9bcb-c5e1fb8a629b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:50.075152 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a84b1-e909-4462-9bcb-c5e1fb8a629b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:50.075433 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a84b1-e909-4462-9bcb-c5e1fb8a629b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:50.075708 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a84b1-e909-4462-9bcb-c5e1fb8a629b None admin] PATH_INFO: `/v3/projects/a1a3de4827e74f58aba48aedd16e78e3` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:50.076867 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a84b1-e909-4462-9bcb-c5e1fb8a629b None admin] RBAC: Authorizing `identity:get_project(project_id=a1a3de4827e74f58aba48aedd16e78e3)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:50.078395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a84b1-e909-4462-9bcb-c5e1fb8a629b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:50.080094 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 564/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:19:49 2022] GET /identity/v3/projects/a1a3de4827e74f58aba48aedd16e78e3 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:50.086758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcbab9-ab8c-4a0e-bb51-ba619918672a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:50.185431 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcbab9-ab8c-4a0e-bb51-ba619918672a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:50.219595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6bf37-a65d-4203-b33e-413c633966de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:50.220469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6bf37-a65d-4203-b33e-413c633966de None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:50.220750 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6bf37-a65d-4203-b33e-413c633966de None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:50.221023 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6bf37-a65d-4203-b33e-413c633966de None admin] PATH_INFO: `/v3/projects/a1a3de4827e74f58aba48aedd16e78e3/users/86cf828f745447bfb96fd0d84bdd92af/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:50.223021 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6bf37-a65d-4203-b33e-413c633966de None admin] RBAC: Authorizing `identity:create_grant(project_id=a1a3de4827e74f58aba48aedd16e78e3, user_id=86cf828f745447bfb96fd0d84bdd92af, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:50.224439 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6bf37-a65d-4203-b33e-413c633966de None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:50.236923 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 589/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:19:50 2022] PUT /identity/v3/projects/a1a3de4827e74f58aba48aedd16e78e3/users/86cf828f745447bfb96fd0d84bdd92af/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:19:52.229828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b3057-c99f-44fa-92f4-838acfe685b4 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:52.230374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b3057-c99f-44fa-92f4-838acfe685b4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:52.230374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b3057-c99f-44fa-92f4-838acfe685b4 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:52.231787 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 565/1154] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:52.237520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518cec3-efe1-44ff-8f45-cdd1c9c8a194 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:52.237928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518cec3-efe1-44ff-8f45-cdd1c9c8a194 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:52.238060 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518cec3-efe1-44ff-8f45-cdd1c9c8a194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:52.254972 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5518cec3-efe1-44ff-8f45-cdd1c9c8a194 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:52.256136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5518cec3-efe1-44ff-8f45-cdd1c9c8a194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:52.289224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:52.323095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 590/1155] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:52.346075 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b3057-c99f-44fa-92f4-838acfe685b4 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:52.446340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b3057-c99f-44fa-92f4-838acfe685b4 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:52.479468 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e68d6d-82ce-43db-bf6c-b2953c74f652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:52.480294 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e68d6d-82ce-43db-bf6c-b2953c74f652 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:52.480529 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e68d6d-82ce-43db-bf6c-b2953c74f652 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:52.480803 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e68d6d-82ce-43db-bf6c-b2953c74f652 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:52.491929 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e68d6d-82ce-43db-bf6c-b2953c74f652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:19:52.499720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-e7e68d6d-82ce-43db-bf6c-b2953c74f652 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:19:52.499720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:52.499720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:52.499720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:52.499720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:52.499720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:52.499720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:52.499720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:52.499720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:52.499720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:52.499720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:52.499720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:52.499720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:19:52.499720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:19:52.499720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:19:52.499720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:19:52.500790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:19:52.500790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:19:52.500790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:19:52.500790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:19:52.500790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:52.500790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:52.500790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:52.500790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:52.500790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:52.500790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:52.500790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:52.500790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:52.500790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:52.500790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:52.500790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:52.500790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:52.501827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:52.501827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:52.501827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:52.501827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:52.501827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:19:52.501827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:19:52.501827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:19:52.501827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:19:52.501827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:19:52.501827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:19:52.501827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:19:52.501827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:19:52.501827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 566/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:19:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:52.507080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518cec3-efe1-44ff-8f45-cdd1c9c8a194 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:52.606162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518cec3-efe1-44ff-8f45-cdd1c9c8a194 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:52.640024 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94753114-f4e6-429e-ae5b-8c99c6cb347e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:52.640681 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94753114-f4e6-429e-ae5b-8c99c6cb347e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:52.640955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94753114-f4e6-429e-ae5b-8c99c6cb347e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:52.641224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94753114-f4e6-429e-ae5b-8c99c6cb347e None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:52.641952 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94753114-f4e6-429e-ae5b-8c99c6cb347e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:52.642251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94753114-f4e6-429e-ae5b-8c99c6cb347e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:52.643621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94753114-f4e6-429e-ae5b-8c99c6cb347e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:52.651390 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 591/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:19:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:52.657757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e68d6d-82ce-43db-bf6c-b2953c74f652 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:52.713963 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:52.754976 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e68d6d-82ce-43db-bf6c-b2953c74f652 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:52.787966 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7dd39-00d2-4d58-8eb9-1e8c113e2555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:52.788823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7dd39-00d2-4d58-8eb9-1e8c113e2555 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:52.789102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7dd39-00d2-4d58-8eb9-1e8c113e2555 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:52.789369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7dd39-00d2-4d58-8eb9-1e8c113e2555 None admin] PATH_INFO: `/v3/users/86cf828f745447bfb96fd0d84bdd92af` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:52.790531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7dd39-00d2-4d58-8eb9-1e8c113e2555 None admin] RBAC: Authorizing `identity:get_user(user_id=86cf828f745447bfb96fd0d84bdd92af)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:52.791974 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7dd39-00d2-4d58-8eb9-1e8c113e2555 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:52.793575 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 567/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:19:52 2022] GET /identity/v3/users/86cf828f745447bfb96fd0d84bdd92af => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:52.799459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94753114-f4e6-429e-ae5b-8c99c6cb347e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:52.830683 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:52.898698 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94753114-f4e6-429e-ae5b-8c99c6cb347e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:52.931250 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eddff6-586a-4f33-82f9-5117872e898e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:52.931927 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eddff6-586a-4f33-82f9-5117872e898e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:52.932205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eddff6-586a-4f33-82f9-5117872e898e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:52.932472 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eddff6-586a-4f33-82f9-5117872e898e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:52.997177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eddff6-586a-4f33-82f9-5117872e898e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:52.998584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eddff6-586a-4f33-82f9-5117872e898e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:53.027600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:53.094916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 592/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:19:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 12:19:53.100789 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7dd39-00d2-4d58-8eb9-1e8c113e2555 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:53.197383 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7dd39-00d2-4d58-8eb9-1e8c113e2555 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:53.222839 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:53.231865 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ae687-7ab2-48df-ab05-203caa5bb051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:53.232716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ae687-7ab2-48df-ab05-203caa5bb051 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:53.232997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ae687-7ab2-48df-ab05-203caa5bb051 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:53.233268 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ae687-7ab2-48df-ab05-203caa5bb051 None admin] PATH_INFO: `/v3/projects/a1a3de4827e74f58aba48aedd16e78e3` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:53.235071 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ae687-7ab2-48df-ab05-203caa5bb051 None admin] RBAC: Authorizing `identity:get_project(project_id=a1a3de4827e74f58aba48aedd16e78e3)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:53.236498 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ae687-7ab2-48df-ab05-203caa5bb051 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:53.238172 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 568/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:19:53 2022] GET /identity/v3/projects/a1a3de4827e74f58aba48aedd16e78e3 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:53.244205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eddff6-586a-4f33-82f9-5117872e898e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:53.339888 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eddff6-586a-4f33-82f9-5117872e898e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:53.369015 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:53.374220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abd19c-d977-4467-ba68-fc4db7e51509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:53.375088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abd19c-d977-4467-ba68-fc4db7e51509 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:53.375361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abd19c-d977-4467-ba68-fc4db7e51509 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:53.375631 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abd19c-d977-4467-ba68-fc4db7e51509 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:53.376447 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abd19c-d977-4467-ba68-fc4db7e51509 None admin] RBAC: Adding query filter params (role.id=386cb814e8464fda8832b13c75eabdaf, scope.project.id=a1a3de4827e74f58aba48aedd16e78e3, user.id=86cf828f745447bfb96fd0d84bdd92af) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:53.376756 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abd19c-d977-4467-ba68-fc4db7e51509 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:53.378163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abd19c-d977-4467-ba68-fc4db7e51509 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:53.383889 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 593/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:19:53 2022] GET /identity/v3/role_assignments?user.id=86cf828f745447bfb96fd0d84bdd92af&scope.project.id=a1a3de4827e74f58aba48aedd16e78e3&role.id=386cb814e8464fda8832b13c75eabdaf => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:55.430700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331b2a6-fe49-4e16-89a8-8ea400563bf5 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:55.431248 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331b2a6-fe49-4e16-89a8-8ea400563bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:55.431339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331b2a6-fe49-4e16-89a8-8ea400563bf5 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:55.432670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 569/1162] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:55.437788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef6a31-7879-4f01-b729-e31cc093e89f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:55.438231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef6a31-7879-4f01-b729-e31cc093e89f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:55.438335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef6a31-7879-4f01-b729-e31cc093e89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:55.454882 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9eef6a31-7879-4f01-b729-e31cc093e89f None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:55.456041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9eef6a31-7879-4f01-b729-e31cc093e89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:55.522014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 594/1163] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:55.543796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331b2a6-fe49-4e16-89a8-8ea400563bf5 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:55.642271 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331b2a6-fe49-4e16-89a8-8ea400563bf5 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:55.673956 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860df1e-499d-4d77-afcf-b78ccb8d745c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:55.674585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860df1e-499d-4d77-afcf-b78ccb8d745c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:55.674961 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860df1e-499d-4d77-afcf-b78ccb8d745c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:55.675233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860df1e-499d-4d77-afcf-b78ccb8d745c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:55.734681 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:55.742434 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860df1e-499d-4d77-afcf-b78ccb8d745c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:55.743930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860df1e-499d-4d77-afcf-b78ccb8d745c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:55.838740 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 570/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:19:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 12:19:55.844701 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef6a31-7879-4f01-b729-e31cc093e89f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:55.940824 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef6a31-7879-4f01-b729-e31cc093e89f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:55.965259 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:55.974394 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2f86b-b8d6-4723-b82b-01605b0aaf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:55.975215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2f86b-b8d6-4723-b82b-01605b0aaf78 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:55.975494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2f86b-b8d6-4723-b82b-01605b0aaf78 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:55.975762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2f86b-b8d6-4723-b82b-01605b0aaf78 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:55.982258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2f86b-b8d6-4723-b82b-01605b0aaf78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:55.984251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2f86b-b8d6-4723-b82b-01605b0aaf78 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:55.997961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f9b2f86b-b8d6-4723-b82b-01605b0aaf78 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 19 12:19:55.997961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:55.997961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 12:19:55.997961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 12:19:55.997961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:19:55.997961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:19:55.997961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:19:55.997961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:19:55.997961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 19 12:19:55.997961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:55.997961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:19:55.997961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:55.997961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:19:55.997961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:19:55.997961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:19:55.997961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:19:55.997961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:19:55.999194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:19:55.999194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:19:55.999194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:19:55.999194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:19:55.999194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:19:55.999194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:19:55.999194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:19:55.999194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:19:55.999194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:19:55.999194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:19:55.999194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:19:55.999194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:19:55.999194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:19:55.999194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:19:55.999194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:19:55.999194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:19:56.000759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:19:56.000759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:19:56.000759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:19:56.000759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:19:56.000759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:19:56.000759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:19:56.000759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:19:56.000759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:19:56.000759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:19:56.000759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:19:56.000759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 12:19:56.000759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:19:56.000759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 19 12:19:56.000759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:19:56.000759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 595/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 19 12:19:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:19:56.005656 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860df1e-499d-4d77-afcf-b78ccb8d745c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:56.094945 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:56.102007 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860df1e-499d-4d77-afcf-b78ccb8d745c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:56.140701 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e067e7-5ad1-43e7-aae1-b730318447cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:56.141357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e067e7-5ad1-43e7-aae1-b730318447cf None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:56.141637 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e067e7-5ad1-43e7-aae1-b730318447cf None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:56.141906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e067e7-5ad1-43e7-aae1-b730318447cf None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:56.142616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e067e7-5ad1-43e7-aae1-b730318447cf None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:19:56.142948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e067e7-5ad1-43e7-aae1-b730318447cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:56.144294 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e067e7-5ad1-43e7-aae1-b730318447cf None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:56.151286 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 571/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Jul 19 12:19:56 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:19:58.156279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3df0c2-8a4d-4016-a215-d4a7e2cd728d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:58.156816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3df0c2-8a4d-4016-a215-d4a7e2cd728d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:58.156816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3df0c2-8a4d-4016-a215-d4a7e2cd728d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:58.158166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 596/1167] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:19:58.163642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b44d53-3856-40d1-aef9-d4d2fbd4c583 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:58.164042 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b44d53-3856-40d1-aef9-d4d2fbd4c583 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:58.164225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b44d53-3856-40d1-aef9-d4d2fbd4c583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:58.180773 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-26b44d53-3856-40d1-aef9-d4d2fbd4c583 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:19:58.181954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-26b44d53-3856-40d1-aef9-d4d2fbd4c583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:58.250315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 572/1168] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:19:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:19:58.273336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3df0c2-8a4d-4016-a215-d4a7e2cd728d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:58.372158 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3df0c2-8a4d-4016-a215-d4a7e2cd728d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:58.404689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c117d87-b0c8-4a41-9756-55661ade715f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:58.405325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c117d87-b0c8-4a41-9756-55661ade715f None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:58.405655 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c117d87-b0c8-4a41-9756-55661ade715f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:58.405920 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c117d87-b0c8-4a41-9756-55661ade715f None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:58.406694 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c117d87-b0c8-4a41-9756-55661ade715f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:58.408025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c117d87-b0c8-4a41-9756-55661ade715f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:58.422015 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 597/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Tue Jul 19 12:19:58 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:20:00.463801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b4566-bee3-463b-9c75-6e83a2e0469d None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:00.464330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b4566-bee3-463b-9c75-6e83a2e0469d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:00.464330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b4566-bee3-463b-9c75-6e83a2e0469d None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:00.465704 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 573/1170] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:20:00.471438 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b51dc9-7e49-45b8-9f15-0065a6b0c926 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:00.471849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b51dc9-7e49-45b8-9f15-0065a6b0c926 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:00.471993 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b51dc9-7e49-45b8-9f15-0065a6b0c926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:00.489066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-26b51dc9-7e49-45b8-9f15-0065a6b0c926 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:20:00.490244 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-26b51dc9-7e49-45b8-9f15-0065a6b0c926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:00.531638 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:00.556163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 598/1171] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:20:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:20:00.579865 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b4566-bee3-463b-9c75-6e83a2e0469d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:00.665007 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:00.678277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b4566-bee3-463b-9c75-6e83a2e0469d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:00.712360 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efa44f-893b-4e8f-a393-957071884e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:00.713213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efa44f-893b-4e8f-a393-957071884e48 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:00.713491 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efa44f-893b-4e8f-a393-957071884e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:00.713761 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efa44f-893b-4e8f-a393-957071884e48 None admin] PATH_INFO: `/v3/domains/c0a31fa2e7d948e19f460780315a5a71` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:00.724025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efa44f-893b-4e8f-a393-957071884e48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c0a31fa2e7d948e19f460780315a5a71)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:00.725380 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efa44f-893b-4e8f-a393-957071884e48 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:00.727035 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 574/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Jul 19 12:20:00 2022] GET /identity/v3/domains/c0a31fa2e7d948e19f460780315a5a71 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:20:00.732861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b51dc9-7e49-45b8-9f15-0065a6b0c926 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:00.830278 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b51dc9-7e49-45b8-9f15-0065a6b0c926 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:00.862713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b082db-fb8c-4bd4-ba75-304f6deb8677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:00.863392 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b082db-fb8c-4bd4-ba75-304f6deb8677 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:00.863675 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b082db-fb8c-4bd4-ba75-304f6deb8677 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:00.863950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b082db-fb8c-4bd4-ba75-304f6deb8677 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:00.864651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b082db-fb8c-4bd4-ba75-304f6deb8677 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:00.866073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b082db-fb8c-4bd4-ba75-304f6deb8677 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:00.892250 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 599/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 19 12:20:00 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:20:02.934949 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836f837-cbd1-457b-8086-2a2b4bff9669 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:02.935466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836f837-cbd1-457b-8086-2a2b4bff9669 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:02.935587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836f837-cbd1-457b-8086-2a2b4bff9669 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:02.937487 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 575/1174] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:20:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:20:02.942723 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd7d91-e286-4582-bd6d-79b041318f89 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:02.943119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd7d91-e286-4582-bd6d-79b041318f89 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:02.943311 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd7d91-e286-4582-bd6d-79b041318f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:02.960449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8abd7d91-e286-4582-bd6d-79b041318f89 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:20:02.961575 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8abd7d91-e286-4582-bd6d-79b041318f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:02.983784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:03.028509 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 600/1175] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:20:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:20:03.052585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836f837-cbd1-457b-8086-2a2b4bff9669 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:03.151528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836f837-cbd1-457b-8086-2a2b4bff9669 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:03.183721 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d511bd7-25bb-437b-9b2c-dc4685ac0785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:03.184559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d511bd7-25bb-437b-9b2c-dc4685ac0785 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:03.184832 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d511bd7-25bb-437b-9b2c-dc4685ac0785 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:03.185098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d511bd7-25bb-437b-9b2c-dc4685ac0785 None admin] PATH_INFO: `/v3/domains/c0a31fa2e7d948e19f460780315a5a71` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:03.186257 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d511bd7-25bb-437b-9b2c-dc4685ac0785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c0a31fa2e7d948e19f460780315a5a71)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:03.188329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d511bd7-25bb-437b-9b2c-dc4685ac0785 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:03.189899 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 576/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Jul 19 12:20:03 2022] GET /identity/v3/domains/c0a31fa2e7d948e19f460780315a5a71 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:20:03.195527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd7d91-e286-4582-bd6d-79b041318f89 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:03.291853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd7d91-e286-4582-bd6d-79b041318f89 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:03.325281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cb84b-4cbc-40c6-87d4-18de0512987e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:03.325933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cb84b-4cbc-40c6-87d4-18de0512987e None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:03.326216 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cb84b-4cbc-40c6-87d4-18de0512987e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:03.326489 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cb84b-4cbc-40c6-87d4-18de0512987e None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:03.327250 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cb84b-4cbc-40c6-87d4-18de0512987e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:03.328672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cb84b-4cbc-40c6-87d4-18de0512987e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:03.347792 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 601/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 19 12:20:03 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:20:05.398516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d0e9b-232e-4f6a-9bc3-05389bb62f4f None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:05.399160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d0e9b-232e-4f6a-9bc3-05389bb62f4f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:05.399160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d0e9b-232e-4f6a-9bc3-05389bb62f4f None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:05.400471 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 577/1178] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:20:05.406187 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16991c1-58c5-4d71-893a-9176fa666dcd None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:05.406630 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16991c1-58c5-4d71-893a-9176fa666dcd None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:05.406917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16991c1-58c5-4d71-893a-9176fa666dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:05.424238 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b16991c1-58c5-4d71-893a-9176fa666dcd None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:20:05.425402 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b16991c1-58c5-4d71-893a-9176fa666dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:05.434333 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:05.492341 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 602/1179] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:20:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:20:05.516304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d0e9b-232e-4f6a-9bc3-05389bb62f4f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:05.535134 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:05.615153 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d0e9b-232e-4f6a-9bc3-05389bb62f4f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:05.647000 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cc247-8f8b-4939-90ab-f4a3671ee2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:05.647779 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cc247-8f8b-4939-90ab-f4a3671ee2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:05.648054 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cc247-8f8b-4939-90ab-f4a3671ee2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:05.648320 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cc247-8f8b-4939-90ab-f4a3671ee2a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:05.658959 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cc247-8f8b-4939-90ab-f4a3671ee2a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:20:05.666402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-ef3cc247-8f8b-4939-90ab-f4a3671ee2a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:20:05.666402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:20:05.666402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:20:05.666402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:20:05.666402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:20:05.666402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:20:05.666402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:20:05.666402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:20:05.666402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:20:05.666402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:20:05.666402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:20:05.666402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:20:05.666402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:20:05.666402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:20:05.666402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:20:05.666402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:20:05.667644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:20:05.667644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:20:05.667644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:20:05.667644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:20:05.667644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:20:05.667644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:20:05.667644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:20:05.667644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:20:05.667644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:20:05.667644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:20:05.667644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:20:05.667644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:20:05.667644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:20:05.667644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:20:05.667644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:20:05.667644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:20:05.668540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:20:05.668540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:20:05.668540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:20:05.668540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:20:05.668540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:20:05.668540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:20:05.668540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:20:05.668540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:20:05.668540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:20:05.668540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:20:05.668540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:20:05.668540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:20:05.668540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 578/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:20:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:20:05.673816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16991c1-58c5-4d71-893a-9176fa666dcd None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:05.772687 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16991c1-58c5-4d71-893a-9176fa666dcd None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:05.806077 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828c358-061b-470f-ae9a-373d0b22c0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:05.806755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828c358-061b-470f-ae9a-373d0b22c0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:05.807035 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828c358-061b-470f-ae9a-373d0b22c0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:05.807303 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828c358-061b-470f-ae9a-373d0b22c0f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:05.808029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828c358-061b-470f-ae9a-373d0b22c0f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:20:05.808327 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828c358-061b-470f-ae9a-373d0b22c0f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:05.809672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828c358-061b-470f-ae9a-373d0b22c0f9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:05.818341 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 603/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:20:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:20:05.824144 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cc247-8f8b-4939-90ab-f4a3671ee2a8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:05.898305 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:05.920985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cc247-8f8b-4939-90ab-f4a3671ee2a8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:05.954255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff02f9a-f6ef-4a1c-a1ff-642280a1e51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:05.955132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff02f9a-f6ef-4a1c-a1ff-642280a1e51c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:05.955411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff02f9a-f6ef-4a1c-a1ff-642280a1e51c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:05.955683 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff02f9a-f6ef-4a1c-a1ff-642280a1e51c None admin] PATH_INFO: `/v3/users/eb05ee5d30b540798ac1683d7f9602d3` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:05.968234 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff02f9a-f6ef-4a1c-a1ff-642280a1e51c None admin] RBAC: Authorizing `identity:get_user(user_id=eb05ee5d30b540798ac1683d7f9602d3)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:05.969653 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff02f9a-f6ef-4a1c-a1ff-642280a1e51c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:05.971318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 579/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:20:05 2022] GET /identity/v3/users/eb05ee5d30b540798ac1683d7f9602d3 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:20:05.976977 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828c358-061b-470f-ae9a-373d0b22c0f9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:05.986748 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:06.075630 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828c358-061b-470f-ae9a-373d0b22c0f9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:06.108136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3230e-33a0-4442-be8b-890e97f330ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:06.108928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3230e-33a0-4442-be8b-890e97f330ed None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:06.109203 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3230e-33a0-4442-be8b-890e97f330ed None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:06.109470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3230e-33a0-4442-be8b-890e97f330ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:06.174329 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3230e-33a0-4442-be8b-890e97f330ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:06.175705 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3230e-33a0-4442-be8b-890e97f330ed None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:06.182891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:06.271499 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 604/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:20:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 12:20:06.277370 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff02f9a-f6ef-4a1c-a1ff-642280a1e51c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:06.372944 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff02f9a-f6ef-4a1c-a1ff-642280a1e51c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:06.405552 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8623c-6390-4372-91fe-b947025400b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:06.406526 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8623c-6390-4372-91fe-b947025400b1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:06.406831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8623c-6390-4372-91fe-b947025400b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:06.407101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8623c-6390-4372-91fe-b947025400b1 None admin] PATH_INFO: `/v3/projects/a0912ca1b4a94dd487a7113b6f5497c6` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:06.408269 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8623c-6390-4372-91fe-b947025400b1 None admin] RBAC: Authorizing `identity:get_project(project_id=a0912ca1b4a94dd487a7113b6f5497c6)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:06.409666 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8623c-6390-4372-91fe-b947025400b1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:06.411339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 580/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:20:06 2022] GET /identity/v3/projects/a0912ca1b4a94dd487a7113b6f5497c6 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:20:06.417391 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3230e-33a0-4442-be8b-890e97f330ed None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:06.514177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3230e-33a0-4442-be8b-890e97f330ed None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:06.521592 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:06.548585 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840aa88-f3f5-4eb3-b1db-8e77db688e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:06.549222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840aa88-f3f5-4eb3-b1db-8e77db688e64 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:06.549501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840aa88-f3f5-4eb3-b1db-8e77db688e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:06.549774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840aa88-f3f5-4eb3-b1db-8e77db688e64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:06.550586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840aa88-f3f5-4eb3-b1db-8e77db688e64 None admin] RBAC: Adding query filter params (role.id=386cb814e8464fda8832b13c75eabdaf, scope.project.id=a0912ca1b4a94dd487a7113b6f5497c6, user.id=eb05ee5d30b540798ac1683d7f9602d3) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:20:06.550928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840aa88-f3f5-4eb3-b1db-8e77db688e64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:06.552336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840aa88-f3f5-4eb3-b1db-8e77db688e64 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:06.557645 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 605/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:20:06 2022] GET /identity/v3/role_assignments?user.id=eb05ee5d30b540798ac1683d7f9602d3&scope.project.id=a0912ca1b4a94dd487a7113b6f5497c6&role.id=386cb814e8464fda8832b13c75eabdaf => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:20:08.544619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e16b0-1da8-4f9a-bfec-5d6e96e3b621 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:08.545170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e16b0-1da8-4f9a-bfec-5d6e96e3b621 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:08.545170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e16b0-1da8-4f9a-bfec-5d6e96e3b621 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:08.547272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 581/1186] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:20:08.552349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82682516-69ba-49c4-a4b0-fbaaf8c13640 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:08.552765 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82682516-69ba-49c4-a4b0-fbaaf8c13640 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:08.552900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82682516-69ba-49c4-a4b0-fbaaf8c13640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:08.570133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-82682516-69ba-49c4-a4b0-fbaaf8c13640 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:20:08.571346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-82682516-69ba-49c4-a4b0-fbaaf8c13640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:08.641395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 606/1187] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:20:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:20:08.663686 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e16b0-1da8-4f9a-bfec-5d6e96e3b621 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:08.666536 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:08.763444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e16b0-1da8-4f9a-bfec-5d6e96e3b621 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:08.795515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a748cb-774d-4934-ae64-38fb1b947ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:08.796823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a748cb-774d-4934-ae64-38fb1b947ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:08.797020 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a748cb-774d-4934-ae64-38fb1b947ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:08.797290 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a748cb-774d-4934-ae64-38fb1b947ce9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:08.806947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a748cb-774d-4934-ae64-38fb1b947ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:20:08.815132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-36a748cb-774d-4934-ae64-38fb1b947ce9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:20:08.815132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:20:08.815132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:20:08.815132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:20:08.815132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:20:08.815132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:20:08.815132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:20:08.815132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:20:08.815132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:20:08.815132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:20:08.815132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:20:08.815132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:20:08.815132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:20:08.815132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:20:08.815132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:20:08.815132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:20:08.816221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:20:08.816221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:20:08.816221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:20:08.816221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:20:08.816221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:20:08.816221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:20:08.816221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:20:08.816221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:20:08.816221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:20:08.816221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:20:08.816221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:20:08.816221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:20:08.816221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:20:08.816221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:20:08.816221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:20:08.816221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:20:08.817263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:20:08.817263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:20:08.817263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:20:08.817263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:20:08.817263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:20:08.817263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:20:08.817263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:20:08.817263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:20:08.817263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:20:08.817263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:20:08.817263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:20:08.817263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:20:08.817263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 582/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:20:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:20:08.822320 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82682516-69ba-49c4-a4b0-fbaaf8c13640 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:08.916260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:08.919457 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82682516-69ba-49c4-a4b0-fbaaf8c13640 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:08.953477 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f51631-16ab-47a9-b566-ae532a0c8da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:08.954130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51631-16ab-47a9-b566-ae532a0c8da5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:08.954407 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51631-16ab-47a9-b566-ae532a0c8da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:08.954674 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51631-16ab-47a9-b566-ae532a0c8da5 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:08.955480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f51631-16ab-47a9-b566-ae532a0c8da5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:20:08.955783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f51631-16ab-47a9-b566-ae532a0c8da5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:08.957125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f51631-16ab-47a9-b566-ae532a0c8da5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:08.964893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 607/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:20:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:20:08.970714 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a748cb-774d-4934-ae64-38fb1b947ce9 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:09.029181 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:09.067813 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a748cb-774d-4934-ae64-38fb1b947ce9 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:09.100385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca8a85-f1ac-4939-a1e7-07e12a803e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:09.101228 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca8a85-f1ac-4939-a1e7-07e12a803e94 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:09.101504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca8a85-f1ac-4939-a1e7-07e12a803e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:09.101772 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca8a85-f1ac-4939-a1e7-07e12a803e94 None admin] PATH_INFO: `/v3/users/eb05ee5d30b540798ac1683d7f9602d3` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:09.102954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca8a85-f1ac-4939-a1e7-07e12a803e94 None admin] RBAC: Authorizing `identity:get_user(user_id=eb05ee5d30b540798ac1683d7f9602d3)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:09.104378 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca8a85-f1ac-4939-a1e7-07e12a803e94 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:09.105957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 583/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:20:08 2022] GET /identity/v3/users/eb05ee5d30b540798ac1683d7f9602d3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:20:09.112294 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f51631-16ab-47a9-b566-ae532a0c8da5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:09.210090 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f51631-16ab-47a9-b566-ae532a0c8da5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:09.243252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba5335-eb0b-4727-a04d-b35487e08470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:09.244092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba5335-eb0b-4727-a04d-b35487e08470 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:09.244371 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba5335-eb0b-4727-a04d-b35487e08470 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:09.244645 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba5335-eb0b-4727-a04d-b35487e08470 None admin] PATH_INFO: `/v3/projects/a0912ca1b4a94dd487a7113b6f5497c6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:09.245810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba5335-eb0b-4727-a04d-b35487e08470 None admin] RBAC: Authorizing `identity:get_project(project_id=a0912ca1b4a94dd487a7113b6f5497c6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:09.247281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba5335-eb0b-4727-a04d-b35487e08470 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:09.248977 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 608/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:20:09 2022] GET /identity/v3/projects/a0912ca1b4a94dd487a7113b6f5497c6 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:20:09.255007 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca8a85-f1ac-4939-a1e7-07e12a803e94 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:09.351730 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca8a85-f1ac-4939-a1e7-07e12a803e94 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:09.378887 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:09.385048 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769d21d-3a5b-4262-9220-c2ebfb53f4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:09.385919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769d21d-3a5b-4262-9220-c2ebfb53f4cc None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:09.386195 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769d21d-3a5b-4262-9220-c2ebfb53f4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:09.386465 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769d21d-3a5b-4262-9220-c2ebfb53f4cc None admin] PATH_INFO: `/v3/projects/a0912ca1b4a94dd487a7113b6f5497c6/users/eb05ee5d30b540798ac1683d7f9602d3/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:09.388406 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769d21d-3a5b-4262-9220-c2ebfb53f4cc None admin] RBAC: Authorizing `identity:create_grant(project_id=a0912ca1b4a94dd487a7113b6f5497c6, user_id=eb05ee5d30b540798ac1683d7f9602d3, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:09.390347 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769d21d-3a5b-4262-9220-c2ebfb53f4cc None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:09.402472 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 584/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:20:09 2022] PUT /identity/v3/projects/a0912ca1b4a94dd487a7113b6f5497c6/users/eb05ee5d30b540798ac1683d7f9602d3/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:20:11.398607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb0423-bc5f-48a2-9bb3-e6ff333ec96c None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:11.399177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb0423-bc5f-48a2-9bb3-e6ff333ec96c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:11.399177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb0423-bc5f-48a2-9bb3-e6ff333ec96c None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:11.400517 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 609/1193] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:20:11.406428 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb00d2-532d-4346-a5aa-bbbad737870a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:11.406834 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb00d2-532d-4346-a5aa-bbbad737870a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:11.406996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb00d2-532d-4346-a5aa-bbbad737870a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:11.423760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a3fb00d2-532d-4346-a5aa-bbbad737870a None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:20:11.424926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a3fb00d2-532d-4346-a5aa-bbbad737870a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:11.488831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 585/1194] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:20:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:20:11.511905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb0423-bc5f-48a2-9bb3-e6ff333ec96c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:11.542994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:11.613106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb0423-bc5f-48a2-9bb3-e6ff333ec96c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:11.645390 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1975e7f-c55e-410b-b6fc-ebd1a3227877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:11.646160 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1975e7f-c55e-410b-b6fc-ebd1a3227877 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:11.646433 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1975e7f-c55e-410b-b6fc-ebd1a3227877 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:11.646699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1975e7f-c55e-410b-b6fc-ebd1a3227877 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:11.657494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1975e7f-c55e-410b-b6fc-ebd1a3227877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:20:11.664931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f1975e7f-c55e-410b-b6fc-ebd1a3227877 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:20:11.664931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:20:11.664931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:20:11.664931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:20:11.664931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:20:11.664931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:20:11.664931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:20:11.664931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:20:11.664931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:20:11.664931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:20:11.664931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:20:11.664931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:20:11.664931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:20:11.664931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:20:11.664931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:20:11.664931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:20:11.666033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:20:11.666033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:20:11.666033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:20:11.666033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:20:11.666033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:20:11.666033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:20:11.666033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:20:11.666033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:20:11.666033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:20:11.666033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:20:11.666033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:20:11.666033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:20:11.666033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:20:11.666033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:20:11.666033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:20:11.666033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:20:11.667114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:20:11.667114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:20:11.667114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:20:11.667114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:20:11.667114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:20:11.667114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:20:11.667114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:20:11.667114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:20:11.667114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:20:11.667114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:20:11.667114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:20:11.667114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:20:11.667114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 610/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:20:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:20:11.672164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb00d2-532d-4346-a5aa-bbbad737870a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:11.767877 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb00d2-532d-4346-a5aa-bbbad737870a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:11.787307 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:11.801513 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bd3f6-7144-4c67-b7fd-aaef7ca03d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:11.802170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bd3f6-7144-4c67-b7fd-aaef7ca03d45 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:11.802447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bd3f6-7144-4c67-b7fd-aaef7ca03d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:11.802713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bd3f6-7144-4c67-b7fd-aaef7ca03d45 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:11.803475 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bd3f6-7144-4c67-b7fd-aaef7ca03d45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:20:11.803777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bd3f6-7144-4c67-b7fd-aaef7ca03d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:11.805115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bd3f6-7144-4c67-b7fd-aaef7ca03d45 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:11.812931 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 586/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:20:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:20:11.818671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1975e7f-c55e-410b-b6fc-ebd1a3227877 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:11.908246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:11.917881 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1975e7f-c55e-410b-b6fc-ebd1a3227877 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:11.950583 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b105b-6356-4e9d-9972-5eab5141f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:11.951455 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b105b-6356-4e9d-9972-5eab5141f5cb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:11.951729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b105b-6356-4e9d-9972-5eab5141f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:11.951996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b105b-6356-4e9d-9972-5eab5141f5cb None admin] PATH_INFO: `/v3/users/eb05ee5d30b540798ac1683d7f9602d3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:11.953752 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b105b-6356-4e9d-9972-5eab5141f5cb None admin] RBAC: Authorizing `identity:get_user(user_id=eb05ee5d30b540798ac1683d7f9602d3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:11.955200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b105b-6356-4e9d-9972-5eab5141f5cb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:11.956779 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 611/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Jul 19 12:20:11 2022] GET /identity/v3/users/eb05ee5d30b540798ac1683d7f9602d3 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:20:11.962372 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bd3f6-7144-4c67-b7fd-aaef7ca03d45 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:12.057236 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bd3f6-7144-4c67-b7fd-aaef7ca03d45 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:12.089700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d448d-bf8e-474b-8c0c-b2bd39baedca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:12.090328 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d448d-bf8e-474b-8c0c-b2bd39baedca None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:12.090605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d448d-bf8e-474b-8c0c-b2bd39baedca None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:12.090904 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d448d-bf8e-474b-8c0c-b2bd39baedca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:12.137132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:12.156011 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d448d-bf8e-474b-8c0c-b2bd39baedca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:12.157428 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d448d-bf8e-474b-8c0c-b2bd39baedca None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:12.250763 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 587/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:20:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 12:20:12.256604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b105b-6356-4e9d-9972-5eab5141f5cb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:12.354997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b105b-6356-4e9d-9972-5eab5141f5cb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:12.389030 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da955ee8-cdfc-4ff3-9822-5207848bf4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:12.390207 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da955ee8-cdfc-4ff3-9822-5207848bf4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:12.390481 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da955ee8-cdfc-4ff3-9822-5207848bf4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:12.390772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da955ee8-cdfc-4ff3-9822-5207848bf4b0 None admin] PATH_INFO: `/v3/projects/a0912ca1b4a94dd487a7113b6f5497c6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:12.391948 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da955ee8-cdfc-4ff3-9822-5207848bf4b0 None admin] RBAC: Authorizing `identity:get_project(project_id=a0912ca1b4a94dd487a7113b6f5497c6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:12.393373 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da955ee8-cdfc-4ff3-9822-5207848bf4b0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:12.395125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 612/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Jul 19 12:20:12 2022] GET /identity/v3/projects/a0912ca1b4a94dd487a7113b6f5497c6 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:20:12.401297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d448d-bf8e-474b-8c0c-b2bd39baedca None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:12.486113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:12.504760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d448d-bf8e-474b-8c0c-b2bd39baedca None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:12.537267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56de7f-401b-47db-9deb-b7479c5e06d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:12.537912 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56de7f-401b-47db-9deb-b7479c5e06d4 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:12.538194 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56de7f-401b-47db-9deb-b7479c5e06d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:12.538467 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56de7f-401b-47db-9deb-b7479c5e06d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:12.539324 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56de7f-401b-47db-9deb-b7479c5e06d4 None admin] RBAC: Adding query filter params (role.id=386cb814e8464fda8832b13c75eabdaf, scope.project.id=a0912ca1b4a94dd487a7113b6f5497c6, user.id=eb05ee5d30b540798ac1683d7f9602d3) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:20:12.539630 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56de7f-401b-47db-9deb-b7479c5e06d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:12.541056 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56de7f-401b-47db-9deb-b7479c5e06d4 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:12.547369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 588/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:20:12 2022] GET /identity/v3/role_assignments?user.id=eb05ee5d30b540798ac1683d7f9602d3&scope.project.id=a0912ca1b4a94dd487a7113b6f5497c6&role.id=386cb814e8464fda8832b13c75eabdaf => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:20:22.384931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=87 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:22.544101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=27 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:08.103791 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d064af7-2ea9-4cae-8ab5-d7cbe24f7ee8 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:08.103791 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d064af7-2ea9-4cae-8ab5-d7cbe24f7ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:08.103791 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d064af7-2ea9-4cae-8ab5-d7cbe24f7ee8 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:08.104929 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 613/1201] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:21:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:21:08.110394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c2dd0-6822-4f25-9583-4eb8d52c1d97 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:08.110931 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c2dd0-6822-4f25-9583-4eb8d52c1d97 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:08.111032 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c2dd0-6822-4f25-9583-4eb8d52c1d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:08.129606 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ab9c2dd0-6822-4f25-9583-4eb8d52c1d97 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:21:08.131027 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ab9c2dd0-6822-4f25-9583-4eb8d52c1d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:21:08.229535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 589/1202] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:21:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:21:08.255026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d064af7-2ea9-4cae-8ab5-d7cbe24f7ee8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:08.377762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d064af7-2ea9-4cae-8ab5-d7cbe24f7ee8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:08.427878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75bea7-2352-440a-ab2a-cb27ca691270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:08.428929 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75bea7-2352-440a-ab2a-cb27ca691270 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:08.429336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75bea7-2352-440a-ab2a-cb27ca691270 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:08.429620 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75bea7-2352-440a-ab2a-cb27ca691270 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:08.446970 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75bea7-2352-440a-ab2a-cb27ca691270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:08.448427 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75bea7-2352-440a-ab2a-cb27ca691270 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:08.475195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-1a75bea7-2352-440a-ab2a-cb27ca691270 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:08.475195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:08.475195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:08.475195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:08.475195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:08.475195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:08.475195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:08.475195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:08.475195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:08.475195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:08.475195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:08.475195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:08.475195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:21:08.475195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:21:08.475195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:21:08.476258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:21:08.476258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:08.476258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:08.476258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:08.476258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:08.476258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:08.476258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:08.476258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:08.476258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:08.476258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:08.476258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:08.476258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:08.476258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:08.476258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:08.476258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:08.476258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:08.476258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:08.483319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:21:08.483319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:21:08.483319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:08.483319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:21:08.483319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 614/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:08.483629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c2dd0-6822-4f25-9583-4eb8d52c1d97 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:08.627870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c2dd0-6822-4f25-9583-4eb8d52c1d97 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:08.671663 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:08.678959 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9537e-69e5-4d8d-9c89-526b0d3c704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:08.679896 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9537e-69e5-4d8d-9c89-526b0d3c704f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:08.680573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9537e-69e5-4d8d-9c89-526b0d3c704f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:08.681672 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9537e-69e5-4d8d-9c89-526b0d3c704f None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:08.682139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9537e-69e5-4d8d-9c89-526b0d3c704f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:08.682444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9537e-69e5-4d8d-9c89-526b0d3c704f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:08.685828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9537e-69e5-4d8d-9c89-526b0d3c704f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:08.712740 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 590/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:08.719707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75bea7-2352-440a-ab2a-cb27ca691270 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:08.796674 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:08.869238 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75bea7-2352-440a-ab2a-cb27ca691270 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:08.918988 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20356e-b65a-4cf8-bdb0-bfe206c1ff8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:08.920103 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20356e-b65a-4cf8-bdb0-bfe206c1ff8b None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:08.920386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20356e-b65a-4cf8-bdb0-bfe206c1ff8b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:08.920750 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20356e-b65a-4cf8-bdb0-bfe206c1ff8b None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:08.921670 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20356e-b65a-4cf8-bdb0-bfe206c1ff8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:08.923456 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20356e-b65a-4cf8-bdb0-bfe206c1ff8b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:08.953784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 615/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Jul 19 12:21:08 2022] POST /identity/v3/users => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:21:11.242677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887febd-77d4-4b53-8800-6cbd9dec2f09 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:11.243273 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887febd-77d4-4b53-8800-6cbd9dec2f09 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:11.243273 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887febd-77d4-4b53-8800-6cbd9dec2f09 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:11.246409 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 591/1206] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:21:11.250858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d26623-8939-4ec7-afba-69b80834bba5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:11.251406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d26623-8939-4ec7-afba-69b80834bba5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:11.251406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d26623-8939-4ec7-afba-69b80834bba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:11.269632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-50d26623-8939-4ec7-afba-69b80834bba5 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:21:11.272539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-50d26623-8939-4ec7-afba-69b80834bba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:21:11.349185 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 616/1207] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:21:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:21:11.373294 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887febd-77d4-4b53-8800-6cbd9dec2f09 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:11.492463 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887febd-77d4-4b53-8800-6cbd9dec2f09 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:11.533605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3bba0-0c1b-4d94-94c4-5aa0280e5118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:11.534304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3bba0-0c1b-4d94-94c4-5aa0280e5118 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:11.534593 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3bba0-0c1b-4d94-94c4-5aa0280e5118 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:11.534897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3bba0-0c1b-4d94-94c4-5aa0280e5118 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:11.548490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3bba0-0c1b-4d94-94c4-5aa0280e5118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:21:11.556848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-19c3bba0-0c1b-4d94-94c4-5aa0280e5118 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:21:11.556848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:11.556848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:11.556848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:11.556848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:11.556848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:11.556848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:11.556848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:11.556848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:11.556848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:11.556848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:11.556848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:11.556848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:21:11.556848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:21:11.556848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:21:11.556848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:21:11.558088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:21:11.558088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:21:11.558088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:21:11.558088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:21:11.558088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:11.558088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:11.558088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:11.558088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:11.558088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:11.558088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:11.558088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:11.558088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:11.558088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:11.558088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:11.558088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:11.558088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:11.559108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:11.559108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:11.559108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:11.559108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:11.559108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:21:11.559108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:21:11.559108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:21:11.559108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:21:11.559108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:21:11.559108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:21:11.559108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:21:11.559108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:11.559108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 592/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:21:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:21:11.564562 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d26623-8939-4ec7-afba-69b80834bba5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:11.609558 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:11.681764 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d26623-8939-4ec7-afba-69b80834bba5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:11.724376 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bc659-73dd-4b66-9b2a-cfe66dfb0ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:11.725399 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bc659-73dd-4b66-9b2a-cfe66dfb0ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:11.725530 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bc659-73dd-4b66-9b2a-cfe66dfb0ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:11.725855 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bc659-73dd-4b66-9b2a-cfe66dfb0ae2 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:11.726614 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bc659-73dd-4b66-9b2a-cfe66dfb0ae2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:11.727019 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bc659-73dd-4b66-9b2a-cfe66dfb0ae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:11.728441 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bc659-73dd-4b66-9b2a-cfe66dfb0ae2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:11.737733 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 617/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:21:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:11.744060 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3bba0-0c1b-4d94-94c4-5aa0280e5118 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:11.798539 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:11.857600 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3bba0-0c1b-4d94-94c4-5aa0280e5118 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:11.904896 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d67d94-5ca2-4e89-a4a3-a9a2ce044aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:11.905764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d67d94-5ca2-4e89-a4a3-a9a2ce044aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:11.906076 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d67d94-5ca2-4e89-a4a3-a9a2ce044aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:11.906354 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d67d94-5ca2-4e89-a4a3-a9a2ce044aa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:11.921064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d67d94-5ca2-4e89-a4a3-a9a2ce044aa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:11.922605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d67d94-5ca2-4e89-a4a3-a9a2ce044aa3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:11.943394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-37d67d94-5ca2-4e89-a4a3-a9a2ce044aa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:11.943394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:11.943394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:11.943394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:11.943394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:11.943394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:11.943394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:11.943394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:11.943394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:11.943394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:11.943394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:11.943394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:11.943394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:21:11.943394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:21:11.943394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:21:11.944563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:21:11.944563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:11.944563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:11.944563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:11.944563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:11.944563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:11.944563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:11.944563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:11.944563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:11.944563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:11.944563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:11.944563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:11.944563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:11.944563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:11.944563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:11.944563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:11.944563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:11.945675 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:21:11.945675 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:21:11.945675 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:11.945675 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:11.947445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 593/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:11.953766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bc659-73dd-4b66-9b2a-cfe66dfb0ae2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:12.077358 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:12.080413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bc659-73dd-4b66-9b2a-cfe66dfb0ae2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:12.120201 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94014fb5-7f05-418a-a1c1-1a02d7b1e380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:12.121246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94014fb5-7f05-418a-a1c1-1a02d7b1e380 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:12.121246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94014fb5-7f05-418a-a1c1-1a02d7b1e380 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:12.121630 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94014fb5-7f05-418a-a1c1-1a02d7b1e380 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:12.123010 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94014fb5-7f05-418a-a1c1-1a02d7b1e380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:12.123387 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94014fb5-7f05-418a-a1c1-1a02d7b1e380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:12.124890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94014fb5-7f05-418a-a1c1-1a02d7b1e380 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:12.137568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 618/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:12.145269 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d67d94-5ca2-4e89-a4a3-a9a2ce044aa3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:12.264470 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d67d94-5ca2-4e89-a4a3-a9a2ce044aa3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:12.266571 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:12.306812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d484f-dc41-4c57-a8e6-bc64c5581295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:12.307688 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d484f-dc41-4c57-a8e6-bc64c5581295 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:12.307968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d484f-dc41-4c57-a8e6-bc64c5581295 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:12.308238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d484f-dc41-4c57-a8e6-bc64c5581295 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:12.316861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d484f-dc41-4c57-a8e6-bc64c5581295 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:12.318501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d484f-dc41-4c57-a8e6-bc64c5581295 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:12.339225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-3c6d484f-dc41-4c57-a8e6-bc64c5581295 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 12:21:12.339225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:12.339225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:12.339225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:12.339225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:12.339225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:12.339225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:12.339225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:12.339225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:12.339225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:12.339225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:12.339225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:12.339225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:21:12.339225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:21:12.339225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:21:12.339225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:21:12.340414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:12.340414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:12.340414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:21:12.340414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:21:12.340414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:21:12.340414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:21:12.340414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:12.340414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:12.340414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:12.340414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:12.340414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:12.340414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:12.340414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:12.340414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:12.340414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:12.340414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:12.340414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:12.340414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:12.342180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:12.342180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:12.342180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:21:12.342180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:21:12.342180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:21:12.342180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:21:12.342180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:21:12.342180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:21:12.342180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 12:21:12.342180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:12.342180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 594/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:21:12.349924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94014fb5-7f05-418a-a1c1-1a02d7b1e380 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:12.470977 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94014fb5-7f05-418a-a1c1-1a02d7b1e380 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:12.512217 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31b283-7382-45a5-9724-d277f2eb2a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:12.513100 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31b283-7382-45a5-9724-d277f2eb2a05 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:12.513578 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31b283-7382-45a5-9724-d277f2eb2a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:12.514070 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31b283-7382-45a5-9724-d277f2eb2a05 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:12.515125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31b283-7382-45a5-9724-d277f2eb2a05 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:12.515699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31b283-7382-45a5-9724-d277f2eb2a05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:12.517335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31b283-7382-45a5-9724-d277f2eb2a05 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:12.537631 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 619/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Jul 19 12:21:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:12.543069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d484f-dc41-4c57-a8e6-bc64c5581295 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:12.655609 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d484f-dc41-4c57-a8e6-bc64c5581295 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:12.706715 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe8082-66fa-4f6e-a482-63fab830521b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:12.707403 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe8082-66fa-4f6e-a482-63fab830521b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:12.707683 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe8082-66fa-4f6e-a482-63fab830521b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:12.707949 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe8082-66fa-4f6e-a482-63fab830521b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:12.743262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:12.801107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe8082-66fa-4f6e-a482-63fab830521b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:12.802535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe8082-66fa-4f6e-a482-63fab830521b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:12.932255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 595/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:21:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 12:21:12.938606 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31b283-7382-45a5-9724-d277f2eb2a05 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:12.959951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:13.050497 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31b283-7382-45a5-9724-d277f2eb2a05 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:13.092846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd526d-569e-496e-a5bc-4369a1d76b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:13.093814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd526d-569e-496e-a5bc-4369a1d76b24 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:13.094231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd526d-569e-496e-a5bc-4369a1d76b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:13.094602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd526d-569e-496e-a5bc-4369a1d76b24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:13.105806 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd526d-569e-496e-a5bc-4369a1d76b24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:13.108321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd526d-569e-496e-a5bc-4369a1d76b24 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:13.127998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-05bd526d-569e-496e-a5bc-4369a1d76b24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:13.127998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:13.127998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:13.127998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:13.127998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:13.127998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:13.127998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:13.127998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:13.127998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:13.127998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:13.127998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:13.127998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:13.127998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:21:13.127998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:21:13.127998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:21:13.128934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:21:13.128934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:13.128934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:13.128934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:13.128934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:13.128934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:13.128934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:13.128934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:13.128934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:13.128934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:13.128934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:13.128934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:13.128934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:13.128934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:13.128934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:13.128934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:13.128934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:13.129854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:21:13.129854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:21:13.129854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:13.129854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:21:13.129854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 620/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:13.134912 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe8082-66fa-4f6e-a482-63fab830521b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:13.204671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:13.250219 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe8082-66fa-4f6e-a482-63fab830521b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:13.292993 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411af985-dbb7-4540-a4d8-08f1b8547a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:13.294008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411af985-dbb7-4540-a4d8-08f1b8547a40 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:13.294621 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411af985-dbb7-4540-a4d8-08f1b8547a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:13.295098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411af985-dbb7-4540-a4d8-08f1b8547a40 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:13.295993 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411af985-dbb7-4540-a4d8-08f1b8547a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:13.296302 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411af985-dbb7-4540-a4d8-08f1b8547a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:13.298068 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411af985-dbb7-4540-a4d8-08f1b8547a40 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:13.313061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 596/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:13.319383 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd526d-569e-496e-a5bc-4369a1d76b24 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:13.418329 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:13.458785 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd526d-569e-496e-a5bc-4369a1d76b24 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:13.500529 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491411a-5c1e-4edd-b84c-e5e5c830895b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:13.501408 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491411a-5c1e-4edd-b84c-e5e5c830895b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:13.501688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491411a-5c1e-4edd-b84c-e5e5c830895b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:13.501964 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491411a-5c1e-4edd-b84c-e5e5c830895b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:13.510607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491411a-5c1e-4edd-b84c-e5e5c830895b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:13.512257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491411a-5c1e-4edd-b84c-e5e5c830895b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:13.528270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-0491411a-5c1e-4edd-b84c-e5e5c830895b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:21:13.528270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:13.528270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:13.528270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:13.528270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:13.528270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:13.528270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:13.528270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:13.528270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:13.528270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:13.528270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:13.528270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:13.528270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:21:13.528270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:21:13.528270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:21:13.529525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:21:13.529525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:13.529525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:13.529525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:13.529525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:13.529525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:13.529525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:13.529525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:13.529525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:13.529525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:13.529525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:13.529525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:13.529525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:13.529525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:13.529525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:13.529525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:13.529525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:13.531136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:21:13.531136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:21:13.531136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:21:13.531136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:21:13.531136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:21:13.531136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:21:13.531136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:21:13.531136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:21:13.531136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 621/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:21:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:13.536237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411af985-dbb7-4540-a4d8-08f1b8547a40 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:13.677992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411af985-dbb7-4540-a4d8-08f1b8547a40 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:13.713087 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:13.727031 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5767ef-98fa-4b09-b53b-61bd07780288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:13.727647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5767ef-98fa-4b09-b53b-61bd07780288 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:13.727932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5767ef-98fa-4b09-b53b-61bd07780288 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:13.728198 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5767ef-98fa-4b09-b53b-61bd07780288 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:13.729033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5767ef-98fa-4b09-b53b-61bd07780288 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:13.729291 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5767ef-98fa-4b09-b53b-61bd07780288 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:13.730780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5767ef-98fa-4b09-b53b-61bd07780288 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:13.745760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 597/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:21:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:13.753087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491411a-5c1e-4edd-b84c-e5e5c830895b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:13.875509 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491411a-5c1e-4edd-b84c-e5e5c830895b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:13.919809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:13.927340 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfac57-a2d6-492a-af9b-b2a07a56b245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:13.928005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfac57-a2d6-492a-af9b-b2a07a56b245 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:13.928285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfac57-a2d6-492a-af9b-b2a07a56b245 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:13.928574 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfac57-a2d6-492a-af9b-b2a07a56b245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:13.929403 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfac57-a2d6-492a-af9b-b2a07a56b245 None admin] RBAC: Adding query filter params (role.id=42cae330d9ab456c8212ca146daf9322, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=11a51c42a4094d9b97eb636c57225dd9) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:13.929730 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfac57-a2d6-492a-af9b-b2a07a56b245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:13.931163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfac57-a2d6-492a-af9b-b2a07a56b245 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:13.937181 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 622/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:21:13 2022] GET /identity/v3/role_assignments?user.id=11a51c42a4094d9b97eb636c57225dd9&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=42cae330d9ab456c8212ca146daf9322 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:16.337930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d055-43ef-472c-99d8-af31070104b3 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:16.338467 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d055-43ef-472c-99d8-af31070104b3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:16.338687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d055-43ef-472c-99d8-af31070104b3 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:16.340228 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 598/1220] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:21:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:21:16.347060 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd22f6-8142-4459-8ada-3dd160b9b4a3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:16.347489 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd22f6-8142-4459-8ada-3dd160b9b4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:16.347644 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd22f6-8142-4459-8ada-3dd160b9b4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:16.364939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-dcdd22f6-8142-4459-8ada-3dd160b9b4a3 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:21:16.366121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dcdd22f6-8142-4459-8ada-3dd160b9b4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:21:16.450805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 623/1221] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:21:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:21:16.476722 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217d055-43ef-472c-99d8-af31070104b3 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:16.587478 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217d055-43ef-472c-99d8-af31070104b3 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:16.630336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb0c4a-2c4c-410f-8b3e-7d6b6f773ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:16.631134 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb0c4a-2c4c-410f-8b3e-7d6b6f773ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:16.631626 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb0c4a-2c4c-410f-8b3e-7d6b6f773ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:16.631982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb0c4a-2c4c-410f-8b3e-7d6b6f773ff7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:16.644315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb0c4a-2c4c-410f-8b3e-7d6b6f773ff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:21:16.653947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-70cb0c4a-2c4c-410f-8b3e-7d6b6f773ff7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:21:16.653947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:16.653947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:16.653947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:16.653947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:16.653947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:16.653947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:16.653947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:16.653947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:16.653947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:16.653947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:16.653947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:16.653947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:21:16.653947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:21:16.653947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:21:16.653947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:21:16.655914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:21:16.655914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:21:16.655914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:21:16.655914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:21:16.655914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:16.655914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:16.655914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:16.655914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:16.655914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:16.655914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:16.655914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:16.655914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:16.655914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:16.655914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:16.655914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:16.655914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:16.657573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:16.657573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:16.657573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:16.657573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:16.657573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:21:16.657573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:21:16.657573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:21:16.657573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:21:16.657573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:21:16.657573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:21:16.657573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:21:16.657573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:16.657573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 599/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:21:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:16.661965 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd22f6-8142-4459-8ada-3dd160b9b4a3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:16.788335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd22f6-8142-4459-8ada-3dd160b9b4a3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:16.814047 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:16.828974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74ce20-2dce-43f6-a4c9-b27185060404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:16.829806 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74ce20-2dce-43f6-a4c9-b27185060404 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:16.830137 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74ce20-2dce-43f6-a4c9-b27185060404 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:16.830454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74ce20-2dce-43f6-a4c9-b27185060404 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:16.831374 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74ce20-2dce-43f6-a4c9-b27185060404 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:16.831682 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74ce20-2dce-43f6-a4c9-b27185060404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:16.833669 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74ce20-2dce-43f6-a4c9-b27185060404 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:16.844651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 624/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:21:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:16.850554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb0c4a-2c4c-410f-8b3e-7d6b6f773ff7 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:16.907296 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:16.971668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb0c4a-2c4c-410f-8b3e-7d6b6f773ff7 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:17.008624 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27897122-99ae-4a47-9809-90aba80cf3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:17.009423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27897122-99ae-4a47-9809-90aba80cf3ec None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:17.009701 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27897122-99ae-4a47-9809-90aba80cf3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:17.009970 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27897122-99ae-4a47-9809-90aba80cf3ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:17.023528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27897122-99ae-4a47-9809-90aba80cf3ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:17.024979 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27897122-99ae-4a47-9809-90aba80cf3ec None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:17.045284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-27897122-99ae-4a47-9809-90aba80cf3ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:17.045284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:17.045284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:17.045284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:17.045284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:17.045284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:17.045284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:17.045284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:17.045284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:17.045284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:17.045284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:17.045284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:17.045284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:21:17.045284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:21:17.045284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:21:17.046385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:21:17.046385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:17.046385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:17.046385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:17.046385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:17.046385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:17.046385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:17.046385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:17.046385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:17.046385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:17.046385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:17.046385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:17.046385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:17.046385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:17.046385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:17.046385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:17.046385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:17.052259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:21:17.052259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:21:17.052259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:17.052259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:17.052259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 600/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:17.052664 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74ce20-2dce-43f6-a4c9-b27185060404 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:17.169091 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74ce20-2dce-43f6-a4c9-b27185060404 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:17.212820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e464d-57e5-4f30-bccd-2786a4888184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:17.213479 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e464d-57e5-4f30-bccd-2786a4888184 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:17.213759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e464d-57e5-4f30-bccd-2786a4888184 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:17.214024 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e464d-57e5-4f30-bccd-2786a4888184 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:17.214726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e464d-57e5-4f30-bccd-2786a4888184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:17.215051 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e464d-57e5-4f30-bccd-2786a4888184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:17.216458 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e464d-57e5-4f30-bccd-2786a4888184 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:17.231705 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 625/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:21:17.239070 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27897122-99ae-4a47-9809-90aba80cf3ec None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:17.344172 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:17.351268 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27897122-99ae-4a47-9809-90aba80cf3ec None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:17.392002 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1d4b4-23ef-4497-b25d-be9ecc88b29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:17.392931 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d4b4-23ef-4497-b25d-be9ecc88b29a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:17.393296 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d4b4-23ef-4497-b25d-be9ecc88b29a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:17.393676 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1d4b4-23ef-4497-b25d-be9ecc88b29a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:17.404080 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1d4b4-23ef-4497-b25d-be9ecc88b29a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:17.406491 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1d4b4-23ef-4497-b25d-be9ecc88b29a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:17.423955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-7ce1d4b4-23ef-4497-b25d-be9ecc88b29a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 12:21:17.423955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:17.423955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:17.423955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:17.423955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:17.423955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:17.423955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:17.423955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:17.423955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:17.423955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:17.423955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:17.423955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:17.423955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:21:17.423955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:21:17.423955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:21:17.423955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:21:17.425150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:17.425150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:17.425150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:21:17.425150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:21:17.425150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:21:17.425150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:21:17.425150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:17.425150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:17.425150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:17.425150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:17.425150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:17.425150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:17.425150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:17.425150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:17.425150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:17.425150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:17.425150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:17.425150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:17.426376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:17.426376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:17.426376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:21:17.426376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:21:17.426376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:21:17.426376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:21:17.426376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:21:17.426376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:21:17.426376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 12:21:17.426376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:17.430081 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 601/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:17.431110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e464d-57e5-4f30-bccd-2786a4888184 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:17.483027 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:17.550917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e464d-57e5-4f30-bccd-2786a4888184 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:17.588247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57156648-f21b-468c-a991-58cfb015ae16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:17.589028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57156648-f21b-468c-a991-58cfb015ae16 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:17.589344 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57156648-f21b-468c-a991-58cfb015ae16 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:17.589706 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57156648-f21b-468c-a991-58cfb015ae16 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:17.590604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57156648-f21b-468c-a991-58cfb015ae16 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:17.591055 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57156648-f21b-468c-a991-58cfb015ae16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:17.592798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57156648-f21b-468c-a991-58cfb015ae16 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:17.612780 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 626/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Jul 19 12:21:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:17.618939 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1d4b4-23ef-4497-b25d-be9ecc88b29a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:17.749803 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1d4b4-23ef-4497-b25d-be9ecc88b29a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:17.790745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6a53f-3bbd-4f9c-93ba-2511d08fe407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:17.791568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6a53f-3bbd-4f9c-93ba-2511d08fe407 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:17.791847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6a53f-3bbd-4f9c-93ba-2511d08fe407 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:17.792133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6a53f-3bbd-4f9c-93ba-2511d08fe407 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:17.807253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6a53f-3bbd-4f9c-93ba-2511d08fe407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:17.808702 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6a53f-3bbd-4f9c-93ba-2511d08fe407 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:17.827806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-5ca6a53f-3bbd-4f9c-93ba-2511d08fe407 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:17.827806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:17.827806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:17.827806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:17.827806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:17.827806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:17.827806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:17.827806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:17.827806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:17.827806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:17.827806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:17.827806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:17.827806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:21:17.827806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:21:17.827806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:21:17.828919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:21:17.828919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:17.828919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:17.828919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:17.828919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:17.828919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:17.828919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:17.828919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:17.828919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:17.828919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:17.828919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:17.828919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:17.828919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:17.828919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:17.828919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:17.828919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:17.828919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:17.829842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:21:17.829842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:21:17.829842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:17.829842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:17.829842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 602/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:21:17.837297 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57156648-f21b-468c-a991-58cfb015ae16 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:17.949777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57156648-f21b-468c-a991-58cfb015ae16 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:17.952762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:17.987510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af1ec8-2c3b-4d3d-8797-ee0354cce8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:17.988168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af1ec8-2c3b-4d3d-8797-ee0354cce8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:17.988452 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af1ec8-2c3b-4d3d-8797-ee0354cce8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:17.988724 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af1ec8-2c3b-4d3d-8797-ee0354cce8c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:17.989434 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af1ec8-2c3b-4d3d-8797-ee0354cce8c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:17.989735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af1ec8-2c3b-4d3d-8797-ee0354cce8c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:17.991137 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af1ec8-2c3b-4d3d-8797-ee0354cce8c5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:18.003448 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 627/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:18.009745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6a53f-3bbd-4f9c-93ba-2511d08fe407 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:18.023774 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:18.131057 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6a53f-3bbd-4f9c-93ba-2511d08fe407 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:18.170051 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1f4e7-1f8d-49de-b008-65c067b6f5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:18.170972 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1f4e7-1f8d-49de-b008-65c067b6f5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:18.171253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1f4e7-1f8d-49de-b008-65c067b6f5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:18.171529 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1f4e7-1f8d-49de-b008-65c067b6f5c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:18.178393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1f4e7-1f8d-49de-b008-65c067b6f5c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:18.179987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1f4e7-1f8d-49de-b008-65c067b6f5c9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:18.195304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-fee1f4e7-1f8d-49de-b008-65c067b6f5c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:21:18.195304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:18.195304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:18.195304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:18.195304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:18.195304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:18.195304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:18.195304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:18.195304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:18.195304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:18.195304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:18.195304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:18.195304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:21:18.195304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:21:18.195304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:21:18.202369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:21:18.202369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:18.202369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:18.202369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:18.202369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:18.202369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:18.202369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:18.202369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:18.202369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:18.202369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:18.202369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:18.202369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:18.202369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:18.202369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:18.202369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:18.202369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:18.202369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:18.203654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:21:18.203654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:21:18.203654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:21:18.203654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:21:18.203654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:21:18.203654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:21:18.203654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:21:18.203654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:18.203654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 603/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:21:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:21:18.204256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af1ec8-2c3b-4d3d-8797-ee0354cce8c5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:18.316980 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af1ec8-2c3b-4d3d-8797-ee0354cce8c5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:18.354784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b9a23-a5a1-4022-9beb-97c2baa22b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:18.355491 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b9a23-a5a1-4022-9beb-97c2baa22b34 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:18.355766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b9a23-a5a1-4022-9beb-97c2baa22b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:18.356034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b9a23-a5a1-4022-9beb-97c2baa22b34 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:18.356840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b9a23-a5a1-4022-9beb-97c2baa22b34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:18.357196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b9a23-a5a1-4022-9beb-97c2baa22b34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:18.358686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b9a23-a5a1-4022-9beb-97c2baa22b34 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:18.372370 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 628/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:21:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:21:18.378467 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1f4e7-1f8d-49de-b008-65c067b6f5c9 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:18.454245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:18.495603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1f4e7-1f8d-49de-b008-65c067b6f5c9 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:18.542176 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbdb5c-df3a-40dc-9a18-cf79113e945c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:18.543090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbdb5c-df3a-40dc-9a18-cf79113e945c None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:18.543367 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbdb5c-df3a-40dc-9a18-cf79113e945c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:18.543633 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbdb5c-df3a-40dc-9a18-cf79113e945c None admin] PATH_INFO: `/v3/projects/1ba395a1e22f430084089947e47a622d/users/11a51c42a4094d9b97eb636c57225dd9/roles/42cae330d9ab456c8212ca146daf9322` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:18.560011 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbdb5c-df3a-40dc-9a18-cf79113e945c None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba395a1e22f430084089947e47a622d, user_id=11a51c42a4094d9b97eb636c57225dd9, role_id=42cae330d9ab456c8212ca146daf9322)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:18.561785 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbdb5c-df3a-40dc-9a18-cf79113e945c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:18.577496 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 604/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:21:18 2022] PUT /identity/v3/projects/1ba395a1e22f430084089947e47a622d/users/11a51c42a4094d9b97eb636c57225dd9/roles/42cae330d9ab456c8212ca146daf9322 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:21:20.775597 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e8270-a9b1-4284-be72-a5cb1f2e952f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:20.776153 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e8270-a9b1-4284-be72-a5cb1f2e952f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:20.776153 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e8270-a9b1-4284-be72-a5cb1f2e952f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:20.777545 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 629/1233] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:21:20.783992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f02bf-1925-4b5b-9bc0-b3b1a801f55a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:20.784428 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f02bf-1925-4b5b-9bc0-b3b1a801f55a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:20.784561 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f02bf-1925-4b5b-9bc0-b3b1a801f55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:20.801474 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-053f02bf-1925-4b5b-9bc0-b3b1a801f55a None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:21:20.802656 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-053f02bf-1925-4b5b-9bc0-b3b1a801f55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:21:20.894806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 605/1234] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:21:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:21:20.915267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e8270-a9b1-4284-be72-a5cb1f2e952f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:20.943712 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:21.041864 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e8270-a9b1-4284-be72-a5cb1f2e952f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:21.079651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01eeca-da43-4360-8240-198df2780dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:21.080569 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01eeca-da43-4360-8240-198df2780dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:21.080910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01eeca-da43-4360-8240-198df2780dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:21.081251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01eeca-da43-4360-8240-198df2780dc4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:21.094076 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01eeca-da43-4360-8240-198df2780dc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:21:21.102330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-0e01eeca-da43-4360-8240-198df2780dc4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:21:21.102330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:21.102330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:21.102330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:21.102330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:21.102330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:21.102330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:21.102330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:21.102330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:21.102330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:21.102330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:21.102330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:21.102330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:21:21.102330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:21:21.102330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:21:21.102330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:21:21.103537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:21:21.103537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:21:21.103537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:21:21.103537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:21:21.103537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:21.103537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:21.103537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:21.103537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:21.103537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:21.103537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:21.103537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:21.103537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:21.103537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:21.103537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:21.103537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:21.103537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:21.104810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:21.104810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:21.104810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:21.104810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:21.104810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:21:21.104810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:21:21.104810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:21:21.104810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:21:21.104810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:21:21.104810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:21:21.104810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 12:21:21.104810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:21:21.104810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 630/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Jul 19 12:21:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 12:21:21.110522 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f02bf-1925-4b5b-9bc0-b3b1a801f55a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:21.160641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:21.218181 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f02bf-1925-4b5b-9bc0-b3b1a801f55a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:21.259544 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51507a-e5a1-47d5-9bcf-751b8211635b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:21.260226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51507a-e5a1-47d5-9bcf-751b8211635b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:21.260502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51507a-e5a1-47d5-9bcf-751b8211635b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:21.260776 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51507a-e5a1-47d5-9bcf-751b8211635b None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:21.261597 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51507a-e5a1-47d5-9bcf-751b8211635b None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:21.262045 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51507a-e5a1-47d5-9bcf-751b8211635b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:21.264409 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51507a-e5a1-47d5-9bcf-751b8211635b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:21.273929 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 606/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Jul 19 12:21:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:21.280265 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01eeca-da43-4360-8240-198df2780dc4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:21.389770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:21.419978 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01eeca-da43-4360-8240-198df2780dc4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:21.462167 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f57c3a-bba3-45ab-8c92-b683f526a457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:21.463086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f57c3a-bba3-45ab-8c92-b683f526a457 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:21.463333 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f57c3a-bba3-45ab-8c92-b683f526a457 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:21.463709 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f57c3a-bba3-45ab-8c92-b683f526a457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:21.475599 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f57c3a-bba3-45ab-8c92-b683f526a457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:21.477205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f57c3a-bba3-45ab-8c92-b683f526a457 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:21.499476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b0f57c3a-bba3-45ab-8c92-b683f526a457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:21.499476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:21.499476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:21.499476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:21.499476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:21.499476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:21.499476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:21.499476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:21.499476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:21.499476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:21.499476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:21.499476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:21.499476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:21:21.499476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:21:21.499476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:21:21.500653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:21:21.500653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:21.500653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:21.500653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:21.500653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:21.500653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:21.500653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:21.500653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:21.500653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:21.500653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:21.500653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:21.500653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:21.500653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:21.500653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:21.500653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:21.500653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:21.500653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:21.501734 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:21:21.501734 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:21:21.501734 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:21.501734 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:21:21.505555 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 631/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:21.506941 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51507a-e5a1-47d5-9bcf-751b8211635b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:21.627055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51507a-e5a1-47d5-9bcf-751b8211635b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:21.638092 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:21.669784 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c581fdf-40bc-49b8-8f2f-4c2bb19bfbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:21.670563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c581fdf-40bc-49b8-8f2f-4c2bb19bfbb7 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:21.670893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c581fdf-40bc-49b8-8f2f-4c2bb19bfbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:21.671193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c581fdf-40bc-49b8-8f2f-4c2bb19bfbb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:21.671995 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c581fdf-40bc-49b8-8f2f-4c2bb19bfbb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:21.672334 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c581fdf-40bc-49b8-8f2f-4c2bb19bfbb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:21.673980 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c581fdf-40bc-49b8-8f2f-4c2bb19bfbb7 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:21.687315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 607/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:21.693657 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f57c3a-bba3-45ab-8c92-b683f526a457 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:21.806542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f57c3a-bba3-45ab-8c92-b683f526a457 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:21.843950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87483c92-105d-4a05-9de7-89fc9fe3e778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:21.844830 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87483c92-105d-4a05-9de7-89fc9fe3e778 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:21.845172 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87483c92-105d-4a05-9de7-89fc9fe3e778 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:21.845536 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87483c92-105d-4a05-9de7-89fc9fe3e778 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:21.848672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:21.853981 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87483c92-105d-4a05-9de7-89fc9fe3e778 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:21.855738 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87483c92-105d-4a05-9de7-89fc9fe3e778 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:21.871924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-87483c92-105d-4a05-9de7-89fc9fe3e778 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 12:21:21.871924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:21.871924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:21.871924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:21.871924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:21.871924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:21.871924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:21.871924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:21.871924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:21.871924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:21.871924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:21.871924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:21.871924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:21:21.871924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:21:21.871924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:21:21.871924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:21:21.874346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:21.874346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:21.874346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:21:21.874346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:21:21.874346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:21:21.874346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:21:21.874346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:21.874346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:21.874346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:21.874346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:21.874346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:21.874346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:21.874346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:21.874346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:21.874346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:21.874346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:21.874346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:21.874346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:21.875324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:21.875324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:21.875324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:21:21.875324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:21:21.875324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:21:21.875324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:21:21.875324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:21:21.875324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:21:21.875324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 12:21:21.875324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:21:21.875324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 632/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:21.880084 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c581fdf-40bc-49b8-8f2f-4c2bb19bfbb7 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:21.988192 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c581fdf-40bc-49b8-8f2f-4c2bb19bfbb7 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:22.028384 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17d978-d19d-4e8e-8be6-9e9a9f419f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:22.029345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17d978-d19d-4e8e-8be6-9e9a9f419f63 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:22.029631 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17d978-d19d-4e8e-8be6-9e9a9f419f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:22.029901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17d978-d19d-4e8e-8be6-9e9a9f419f63 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:22.030802 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17d978-d19d-4e8e-8be6-9e9a9f419f63 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:22.031109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17d978-d19d-4e8e-8be6-9e9a9f419f63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:22.032547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17d978-d19d-4e8e-8be6-9e9a9f419f63 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:22.053326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 608/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Jul 19 12:21:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:21:22.060215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87483c92-105d-4a05-9de7-89fc9fe3e778 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:22.174432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87483c92-105d-4a05-9de7-89fc9fe3e778 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:22.215599 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288c932-52de-4b2f-8bda-ea529ae690f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:22.216334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288c932-52de-4b2f-8bda-ea529ae690f5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:22.216737 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288c932-52de-4b2f-8bda-ea529ae690f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:22.216863 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288c932-52de-4b2f-8bda-ea529ae690f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:22.292802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:22.301404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288c932-52de-4b2f-8bda-ea529ae690f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:22.302937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288c932-52de-4b2f-8bda-ea529ae690f5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:22.423768 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 633/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:21:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 12:21:22.430815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17d978-d19d-4e8e-8be6-9e9a9f419f63 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:22.467075 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:22.550139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17d978-d19d-4e8e-8be6-9e9a9f419f63 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:22.590388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd31f88-11e8-4129-9ac3-712fe658420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:22.591743 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd31f88-11e8-4129-9ac3-712fe658420e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:22.592025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd31f88-11e8-4129-9ac3-712fe658420e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:22.592295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd31f88-11e8-4129-9ac3-712fe658420e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:22.605753 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd31f88-11e8-4129-9ac3-712fe658420e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:22.608003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd31f88-11e8-4129-9ac3-712fe658420e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:22.627230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-0fd31f88-11e8-4129-9ac3-712fe658420e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:22.627230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:22.627230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:22.627230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:22.627230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:22.627230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:22.627230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:22.627230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:22.627230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:22.627230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:22.627230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:22.627230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:22.627230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:21:22.627230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:21:22.627230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:21:22.628275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:21:22.628275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:22.628275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:22.628275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:22.628275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:22.628275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:22.628275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:22.628275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:22.628275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:22.628275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:22.628275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:22.628275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:22.628275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:22.628275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:22.628275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:22.628275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:22.628275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:22.629188 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:21:22.629188 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:21:22.629188 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:22.629188 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:22.629188 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 609/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:22.636178 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288c932-52de-4b2f-8bda-ea529ae690f5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:22.745267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:22.753418 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288c932-52de-4b2f-8bda-ea529ae690f5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:22.791956 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4c71c-8302-47bb-95a5-28a022baabff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:22.792617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4c71c-8302-47bb-95a5-28a022baabff None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:22.792897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4c71c-8302-47bb-95a5-28a022baabff None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:22.793169 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4c71c-8302-47bb-95a5-28a022baabff None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:22.794388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4c71c-8302-47bb-95a5-28a022baabff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:22.795296 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4c71c-8302-47bb-95a5-28a022baabff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:22.796803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4c71c-8302-47bb-95a5-28a022baabff None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:22.815186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 634/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:22.816255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd31f88-11e8-4129-9ac3-712fe658420e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:22.908969 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:22.933871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd31f88-11e8-4129-9ac3-712fe658420e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:22.971939 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec387c-1b67-4ec3-8bad-ce4bab27db69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:22.972767 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec387c-1b67-4ec3-8bad-ce4bab27db69 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:22.973080 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec387c-1b67-4ec3-8bad-ce4bab27db69 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:22.973435 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec387c-1b67-4ec3-8bad-ce4bab27db69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:22.980945 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec387c-1b67-4ec3-8bad-ce4bab27db69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:22.983572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec387c-1b67-4ec3-8bad-ce4bab27db69 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:22.999554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-e8ec387c-1b67-4ec3-8bad-ce4bab27db69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:21:22.999554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:22.999554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:22.999554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:22.999554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:22.999554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:22.999554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:22.999554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:22.999554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:22.999554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:22.999554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:22.999554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:22.999554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:21:22.999554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:21:22.999554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:21:23.000731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:21:23.000731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:23.000731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:23.000731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:23.000731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:23.000731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:23.000731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:23.000731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:23.000731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:23.000731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:23.000731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:23.000731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:23.000731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:23.000731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:23.000731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:23.000731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:23.000731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:23.001642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:21:23.001642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:21:23.001642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:21:23.001642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:21:23.001642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:21:23.001642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:21:23.001642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:21:23.001642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:23.001642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 610/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:21:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:23.007062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4c71c-8302-47bb-95a5-28a022baabff None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:23.124579 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4c71c-8302-47bb-95a5-28a022baabff None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:23.164390 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b7194-ac37-4e6b-a4bc-ddb8c331af39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:23.165045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b7194-ac37-4e6b-a4bc-ddb8c331af39 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:23.165322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b7194-ac37-4e6b-a4bc-ddb8c331af39 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:23.165598 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b7194-ac37-4e6b-a4bc-ddb8c331af39 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:23.166369 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b7194-ac37-4e6b-a4bc-ddb8c331af39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:23.166674 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b7194-ac37-4e6b-a4bc-ddb8c331af39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:23.168127 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b7194-ac37-4e6b-a4bc-ddb8c331af39 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:23.180572 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 635/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:21:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:23.187870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec387c-1b67-4ec3-8bad-ce4bab27db69 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:23.309090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec387c-1b67-4ec3-8bad-ce4bab27db69 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:23.356795 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0a19f-488c-44f1-9a99-5ee6172a3ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:23.357475 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0a19f-488c-44f1-9a99-5ee6172a3ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:23.357735 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0a19f-488c-44f1-9a99-5ee6172a3ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:23.357996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0a19f-488c-44f1-9a99-5ee6172a3ca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:23.359072 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0a19f-488c-44f1-9a99-5ee6172a3ca0 None admin] RBAC: Adding query filter params (role.id=42cae330d9ab456c8212ca146daf9322, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=11a51c42a4094d9b97eb636c57225dd9) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:23.359414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0a19f-488c-44f1-9a99-5ee6172a3ca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:23.360779 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0a19f-488c-44f1-9a99-5ee6172a3ca0 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:23.366924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 611/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:21:23 2022] GET /identity/v3/role_assignments?user.id=11a51c42a4094d9b97eb636c57225dd9&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=42cae330d9ab456c8212ca146daf9322 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:25.531302 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d41be6-8ce3-4cc5-88bb-1b2b47c703ee None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:25.531853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d41be6-8ce3-4cc5-88bb-1b2b47c703ee None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:25.531853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d41be6-8ce3-4cc5-88bb-1b2b47c703ee None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:25.533702 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 636/1247] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:21:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:21:25.539858 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb959ef-5efb-4581-8c9e-4bf6a8b2a6b1 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:25.540376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb959ef-5efb-4581-8c9e-4bf6a8b2a6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:25.540489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb959ef-5efb-4581-8c9e-4bf6a8b2a6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:25.547069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:25.563827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3bb959ef-5efb-4581-8c9e-4bf6a8b2a6b1 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:21:25.565544 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3bb959ef-5efb-4581-8c9e-4bf6a8b2a6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:21:25.645271 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 612/1248] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:21:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:21:25.671365 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d41be6-8ce3-4cc5-88bb-1b2b47c703ee None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:25.692656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:25.797718 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d41be6-8ce3-4cc5-88bb-1b2b47c703ee None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:25.837162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4cd9a-054f-48ca-8b5b-9974968ad29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:25.838059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4cd9a-054f-48ca-8b5b-9974968ad29c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:25.838376 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4cd9a-054f-48ca-8b5b-9974968ad29c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:25.838644 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4cd9a-054f-48ca-8b5b-9974968ad29c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:25.849981 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4cd9a-054f-48ca-8b5b-9974968ad29c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:21:25.858261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-33b4cd9a-054f-48ca-8b5b-9974968ad29c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:21:25.858261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:25.858261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:25.858261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:25.858261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:25.858261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:25.858261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:25.858261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:25.858261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:25.858261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:25.858261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:25.858261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:25.858261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:21:25.858261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:21:25.858261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:21:25.858261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:21:25.859454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:21:25.859454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:21:25.859454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:21:25.859454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:21:25.859454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:25.859454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:25.859454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:25.859454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:25.859454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:25.859454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:25.859454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:25.859454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:25.859454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:25.859454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:25.859454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:25.859454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:25.860618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:25.860618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:25.860618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:25.860618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:25.860618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:21:25.860618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:21:25.860618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:21:25.860618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:21:25.860618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:21:25.860618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:21:25.860618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:21:25.860618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:21:25.860618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 637/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:21:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:25.866517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb959ef-5efb-4581-8c9e-4bf6a8b2a6b1 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:25.986312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb959ef-5efb-4581-8c9e-4bf6a8b2a6b1 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:26.025173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:26.032241 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d39d6-d1cb-4907-ab5b-2199efc6397e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:26.032917 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d39d6-d1cb-4907-ab5b-2199efc6397e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:26.033197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d39d6-d1cb-4907-ab5b-2199efc6397e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:26.033469 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d39d6-d1cb-4907-ab5b-2199efc6397e None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:26.034267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d39d6-d1cb-4907-ab5b-2199efc6397e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:26.034568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d39d6-d1cb-4907-ab5b-2199efc6397e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:26.035963 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d39d6-d1cb-4907-ab5b-2199efc6397e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:26.045205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 613/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:21:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:26.052400 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4cd9a-054f-48ca-8b5b-9974968ad29c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:26.146362 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:26.171190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4cd9a-054f-48ca-8b5b-9974968ad29c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:26.205735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f13d2-219e-45c7-8c56-dc52126e1814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:26.206648 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f13d2-219e-45c7-8c56-dc52126e1814 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:26.206962 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f13d2-219e-45c7-8c56-dc52126e1814 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:26.207243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f13d2-219e-45c7-8c56-dc52126e1814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:26.221334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f13d2-219e-45c7-8c56-dc52126e1814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:26.222780 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f13d2-219e-45c7-8c56-dc52126e1814 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:26.241526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-401f13d2-219e-45c7-8c56-dc52126e1814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:26.241526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:26.241526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:26.241526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:26.241526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:26.241526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:26.241526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:26.241526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:26.241526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:26.241526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:26.241526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:26.241526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:26.241526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:21:26.241526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:21:26.241526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:21:26.242478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:21:26.242478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:26.242478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:26.242478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:26.242478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:26.242478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:26.242478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:26.242478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:26.242478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:26.242478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:26.242478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:26.242478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:26.242478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:26.242478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:26.242478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:26.242478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:26.242478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:26.243432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:21:26.243432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:21:26.243432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:26.243432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:21:26.243432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 638/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:26.248856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d39d6-d1cb-4907-ab5b-2199efc6397e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:26.358239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d39d6-d1cb-4907-ab5b-2199efc6397e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:26.395574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90433ce5-1f90-4a0a-abad-0779542eeee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:26.396313 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90433ce5-1f90-4a0a-abad-0779542eeee3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:26.396666 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90433ce5-1f90-4a0a-abad-0779542eeee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:26.397107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90433ce5-1f90-4a0a-abad-0779542eeee3 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:26.398054 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90433ce5-1f90-4a0a-abad-0779542eeee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:26.398494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90433ce5-1f90-4a0a-abad-0779542eeee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:26.400189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90433ce5-1f90-4a0a-abad-0779542eeee3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:26.416763 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 614/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:26.424055 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f13d2-219e-45c7-8c56-dc52126e1814 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:26.543956 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f13d2-219e-45c7-8c56-dc52126e1814 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:26.573545 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:26.583136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e206d0-5fa6-4661-bf9e-938e57c6f05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:26.584159 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e206d0-5fa6-4661-bf9e-938e57c6f05f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:26.584435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e206d0-5fa6-4661-bf9e-938e57c6f05f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:26.584705 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e206d0-5fa6-4661-bf9e-938e57c6f05f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:26.594129 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e206d0-5fa6-4661-bf9e-938e57c6f05f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:26.596030 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e206d0-5fa6-4661-bf9e-938e57c6f05f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:26.612568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-48e206d0-5fa6-4661-bf9e-938e57c6f05f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 12:21:26.612568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:26.612568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:26.612568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:26.612568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:26.612568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:26.612568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:26.612568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:26.612568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:26.612568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:26.612568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:26.612568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:26.612568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:21:26.612568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:21:26.612568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:21:26.612568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:21:26.613773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:26.613773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:26.613773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:21:26.613773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:21:26.613773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:21:26.613773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:21:26.613773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:26.613773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:26.613773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:26.613773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:26.613773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:26.613773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:26.613773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:26.613773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:26.613773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:26.613773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:26.613773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:26.613773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:26.614873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:26.614873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:26.614873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:21:26.614873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:21:26.614873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:21:26.614873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:21:26.614873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:21:26.614873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:21:26.614873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 12:21:26.614873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:21:26.614873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 639/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:26.620799 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90433ce5-1f90-4a0a-abad-0779542eeee3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:26.683664 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:26.735306 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90433ce5-1f90-4a0a-abad-0779542eeee3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:26.775053 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7dc22-cd27-4731-a5e6-af696c4056a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:26.775738 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7dc22-cd27-4731-a5e6-af696c4056a4 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:26.776021 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7dc22-cd27-4731-a5e6-af696c4056a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:26.776308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7dc22-cd27-4731-a5e6-af696c4056a4 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:26.777138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7dc22-cd27-4731-a5e6-af696c4056a4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:26.777446 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7dc22-cd27-4731-a5e6-af696c4056a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:26.779018 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7dc22-cd27-4731-a5e6-af696c4056a4 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:26.803311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 615/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Jul 19 12:21:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:21:26.810598 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e206d0-5fa6-4661-bf9e-938e57c6f05f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:26.929523 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e206d0-5fa6-4661-bf9e-938e57c6f05f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:26.970192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802bf71-9f12-4729-8346-3f3d4d5117e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:26.970906 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802bf71-9f12-4729-8346-3f3d4d5117e6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:26.971190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802bf71-9f12-4729-8346-3f3d4d5117e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:26.971476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802bf71-9f12-4729-8346-3f3d4d5117e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:27.036679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:27.049849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802bf71-9f12-4729-8346-3f3d4d5117e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:27.051353 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802bf71-9f12-4729-8346-3f3d4d5117e6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:27.156388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 640/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:21:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 12:21:27.162725 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7dc22-cd27-4731-a5e6-af696c4056a4 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:27.266275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7dc22-cd27-4731-a5e6-af696c4056a4 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:27.279979 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:27.302289 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaa7b5-60e7-4e36-81af-944a816fe5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:27.303129 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaa7b5-60e7-4e36-81af-944a816fe5fe None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:27.303408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaa7b5-60e7-4e36-81af-944a816fe5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:27.303677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaa7b5-60e7-4e36-81af-944a816fe5fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:27.316287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baaa7b5-60e7-4e36-81af-944a816fe5fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:27.317751 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baaa7b5-60e7-4e36-81af-944a816fe5fe None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:27.336644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-5baaa7b5-60e7-4e36-81af-944a816fe5fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:27.336644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:27.336644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:27.336644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:27.336644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:27.336644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:27.336644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:27.336644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:27.336644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:27.336644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:27.336644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:27.336644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:27.336644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:21:27.336644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:21:27.336644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:21:27.337603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:21:27.337603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:27.337603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:27.337603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:27.337603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:27.337603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:27.337603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:27.337603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:27.337603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:27.337603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:27.337603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:27.337603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:27.337603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:27.337603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:27.337603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:27.337603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:27.337603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:27.338667 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:21:27.338667 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:21:27.338667 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:27.338667 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:27.338667 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 616/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:27.344139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802bf71-9f12-4729-8346-3f3d4d5117e6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:27.453346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:27.467117 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802bf71-9f12-4729-8346-3f3d4d5117e6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:27.501559 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818cd37-9606-4a7c-95ac-d687e21d8e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:27.502233 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818cd37-9606-4a7c-95ac-d687e21d8e9c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:27.502513 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818cd37-9606-4a7c-95ac-d687e21d8e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:27.502813 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818cd37-9606-4a7c-95ac-d687e21d8e9c None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:27.503529 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818cd37-9606-4a7c-95ac-d687e21d8e9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:27.503860 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818cd37-9606-4a7c-95ac-d687e21d8e9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:27.505227 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818cd37-9606-4a7c-95ac-d687e21d8e9c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:27.517750 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 641/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:27.523595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaa7b5-60e7-4e36-81af-944a816fe5fe None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:27.628967 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaa7b5-60e7-4e36-81af-944a816fe5fe None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:27.664666 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c4489-b923-4af7-b3c1-5a92aeb44b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:27.665459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c4489-b923-4af7-b3c1-5a92aeb44b8f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:27.665738 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c4489-b923-4af7-b3c1-5a92aeb44b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:27.666009 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c4489-b923-4af7-b3c1-5a92aeb44b8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:27.672807 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c4489-b923-4af7-b3c1-5a92aeb44b8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:27.674239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c4489-b923-4af7-b3c1-5a92aeb44b8f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:27.688203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-ad2c4489-b923-4af7-b3c1-5a92aeb44b8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:21:27.688203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:27.688203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:27.688203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:27.688203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:27.688203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:27.688203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:27.688203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:27.688203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:27.688203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:27.688203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:27.688203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:27.688203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:21:27.688203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:21:27.688203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:21:27.689297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:21:27.689297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:27.689297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:27.689297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:27.689297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:27.689297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:27.689297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:27.689297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:27.689297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:27.689297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:27.689297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:27.689297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:27.689297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:27.689297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:27.689297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:27.689297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:27.689297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:27.690497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:21:27.690497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:21:27.690497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:21:27.690497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:21:27.690497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:21:27.690497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:21:27.690497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:21:27.690497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:27.690497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 617/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:21:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:27.697028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818cd37-9606-4a7c-95ac-d687e21d8e9c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:27.796512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818cd37-9606-4a7c-95ac-d687e21d8e9c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:27.829849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030a1a9-4a67-47bf-b645-77668165bc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:27.830499 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030a1a9-4a67-47bf-b645-77668165bc63 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:27.830807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030a1a9-4a67-47bf-b645-77668165bc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:27.831087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030a1a9-4a67-47bf-b645-77668165bc63 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:27.831860 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030a1a9-4a67-47bf-b645-77668165bc63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:27.832169 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030a1a9-4a67-47bf-b645-77668165bc63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:27.833583 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030a1a9-4a67-47bf-b645-77668165bc63 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:27.845486 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 642/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:21:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:27.851588 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c4489-b923-4af7-b3c1-5a92aeb44b8f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:27.876983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:27.948220 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c4489-b923-4af7-b3c1-5a92aeb44b8f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:27.980121 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4e663-ecf8-43fb-9b0f-f1c5b0c8e345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:27.980752 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4e663-ecf8-43fb-9b0f-f1c5b0c8e345 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:27.981027 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4e663-ecf8-43fb-9b0f-f1c5b0c8e345 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:27.981326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4e663-ecf8-43fb-9b0f-f1c5b0c8e345 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:27.982138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4e663-ecf8-43fb-9b0f-f1c5b0c8e345 None admin] RBAC: Adding query filter params (role.id=386cb814e8464fda8832b13c75eabdaf, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=11a51c42a4094d9b97eb636c57225dd9) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:27.982440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4e663-ecf8-43fb-9b0f-f1c5b0c8e345 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:27.983886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4e663-ecf8-43fb-9b0f-f1c5b0c8e345 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:27.989295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 618/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:21:27 2022] GET /identity/v3/role_assignments?user.id=11a51c42a4094d9b97eb636c57225dd9&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=386cb814e8464fda8832b13c75eabdaf => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:30.009511 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e6c83-2bbf-415e-a1f6-2a795091fcd7 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:30.010009 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e6c83-2bbf-415e-a1f6-2a795091fcd7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:30.010009 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e6c83-2bbf-415e-a1f6-2a795091fcd7 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:30.011358 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 643/1261] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:21:30.017157 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56609359-74a7-4e6f-92b2-d94fe2f7fd19 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:30.017585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56609359-74a7-4e6f-92b2-d94fe2f7fd19 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:30.017702 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56609359-74a7-4e6f-92b2-d94fe2f7fd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:30.034327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-56609359-74a7-4e6f-92b2-d94fe2f7fd19 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:21:30.035546 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-56609359-74a7-4e6f-92b2-d94fe2f7fd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:21:30.100406 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 619/1262] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:21:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:21:30.123025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e6c83-2bbf-415e-a1f6-2a795091fcd7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:30.133674 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:30.222549 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e6c83-2bbf-415e-a1f6-2a795091fcd7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:30.255944 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315cf13-fe52-433b-9620-5efd6bcaa8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:30.256721 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315cf13-fe52-433b-9620-5efd6bcaa8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:30.256999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315cf13-fe52-433b-9620-5efd6bcaa8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:30.257272 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315cf13-fe52-433b-9620-5efd6bcaa8e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:30.268598 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315cf13-fe52-433b-9620-5efd6bcaa8e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:21:30.276098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-0315cf13-fe52-433b-9620-5efd6bcaa8e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:21:30.276098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:30.276098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:30.276098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:30.276098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:30.276098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:30.276098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:30.276098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:30.276098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:30.276098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:30.276098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:30.276098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:30.276098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:21:30.276098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:21:30.276098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:21:30.276098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:21:30.277163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:21:30.277163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:21:30.277163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:21:30.277163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:21:30.277163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:30.277163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:30.277163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:30.277163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:30.277163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:30.277163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:30.277163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:30.277163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:30.277163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:30.277163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:30.277163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:30.277163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:30.278196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:30.278196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:30.278196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:30.278196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:30.278196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:21:30.278196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:21:30.278196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:21:30.278196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:21:30.278196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:21:30.278196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:21:30.278196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:21:30.278196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:21:30.278196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 644/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:21:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:30.283336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56609359-74a7-4e6f-92b2-d94fe2f7fd19 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:30.302074 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:30.383551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56609359-74a7-4e6f-92b2-d94fe2f7fd19 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:30.421688 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744a678-e8a0-426e-80ad-00f32c37e497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:30.422404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744a678-e8a0-426e-80ad-00f32c37e497 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:30.422810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744a678-e8a0-426e-80ad-00f32c37e497 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:30.423092 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744a678-e8a0-426e-80ad-00f32c37e497 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:30.424221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744a678-e8a0-426e-80ad-00f32c37e497 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:30.424398 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744a678-e8a0-426e-80ad-00f32c37e497 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:30.426038 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744a678-e8a0-426e-80ad-00f32c37e497 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:30.436066 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 620/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:21:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:30.442203 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315cf13-fe52-433b-9620-5efd6bcaa8e4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:30.512593 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:30.547599 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315cf13-fe52-433b-9620-5efd6bcaa8e4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:30.579994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4df63d-1791-4830-b0d0-980575791967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:30.580768 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4df63d-1791-4830-b0d0-980575791967 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:30.581042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4df63d-1791-4830-b0d0-980575791967 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:30.581309 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4df63d-1791-4830-b0d0-980575791967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:30.591597 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4df63d-1791-4830-b0d0-980575791967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:30.593007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4df63d-1791-4830-b0d0-980575791967 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:30.609891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6b4df63d-1791-4830-b0d0-980575791967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:30.609891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:30.609891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:30.609891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:30.609891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:30.609891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:30.609891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:30.609891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:30.609891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:30.609891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:30.609891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:30.609891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:30.609891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:21:30.609891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:21:30.609891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:21:30.610984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:21:30.610984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:30.610984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:30.610984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:30.610984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:30.610984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:30.610984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:30.610984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:30.610984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:30.610984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:30.610984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:30.610984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:30.610984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:30.610984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:30.610984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:30.610984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:30.610984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:30.612025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:21:30.612025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:21:30.612025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:30.612025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:21:30.612025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 645/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:30.616972 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744a678-e8a0-426e-80ad-00f32c37e497 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:30.697001 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:30.716553 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744a678-e8a0-426e-80ad-00f32c37e497 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:30.749431 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6c937-bf08-4be4-96fe-a73ac64b1e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:30.750086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6c937-bf08-4be4-96fe-a73ac64b1e11 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:30.750367 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6c937-bf08-4be4-96fe-a73ac64b1e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:30.750641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6c937-bf08-4be4-96fe-a73ac64b1e11 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:30.751391 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6c937-bf08-4be4-96fe-a73ac64b1e11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:30.751695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6c937-bf08-4be4-96fe-a73ac64b1e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:30.753073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6c937-bf08-4be4-96fe-a73ac64b1e11 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:30.764452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 621/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:30.770326 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4df63d-1791-4830-b0d0-980575791967 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:30.870345 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4df63d-1791-4830-b0d0-980575791967 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:30.888858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:30.903903 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c2f6b-5858-451c-984d-73ddb165cc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:30.904688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c2f6b-5858-451c-984d-73ddb165cc68 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:30.904960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c2f6b-5858-451c-984d-73ddb165cc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:30.905225 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c2f6b-5858-451c-984d-73ddb165cc68 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:30.912621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c2f6b-5858-451c-984d-73ddb165cc68 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:30.914038 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c2f6b-5858-451c-984d-73ddb165cc68 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:30.928480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-0e6c2f6b-5858-451c-984d-73ddb165cc68 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 12:21:30.928480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:30.928480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:30.928480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:30.928480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:30.928480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:30.928480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:30.928480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:30.928480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:30.928480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:30.928480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:30.928480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:30.928480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:21:30.928480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:21:30.928480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:21:30.928480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:21:30.929379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:30.929379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:30.929379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:21:30.929379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:21:30.929379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:21:30.929379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:21:30.929379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:30.929379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:30.929379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:30.929379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:30.929379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:30.929379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:30.929379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:30.929379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:30.929379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:30.929379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:30.929379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:30.929379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:30.930357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:30.930357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:30.930357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:21:30.930357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:21:30.930357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:21:30.930357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:21:30.930357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:21:30.930357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:21:30.930357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 12:21:30.930357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:21:30.930357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 646/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:30.935785 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6c937-bf08-4be4-96fe-a73ac64b1e11 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:31.033859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6c937-bf08-4be4-96fe-a73ac64b1e11 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:31.066307 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4df77-dcbd-4585-badc-57c4379ce507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:31.066999 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4df77-dcbd-4585-badc-57c4379ce507 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:31.067283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4df77-dcbd-4585-badc-57c4379ce507 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:31.067559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4df77-dcbd-4585-badc-57c4379ce507 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:31.068392 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4df77-dcbd-4585-badc-57c4379ce507 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:31.068698 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4df77-dcbd-4585-badc-57c4379ce507 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:31.070106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4df77-dcbd-4585-badc-57c4379ce507 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:31.079081 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:31.088157 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 622/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Jul 19 12:21:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:31.094298 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c2f6b-5858-451c-984d-73ddb165cc68 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:31.192010 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c2f6b-5858-451c-984d-73ddb165cc68 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:31.224917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b115c-fa52-4a2d-bbce-3c6ae9f06b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:31.225693 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b115c-fa52-4a2d-bbce-3c6ae9f06b3f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:31.225975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b115c-fa52-4a2d-bbce-3c6ae9f06b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:31.226248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b115c-fa52-4a2d-bbce-3c6ae9f06b3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:31.236592 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b115c-fa52-4a2d-bbce-3c6ae9f06b3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:31.238010 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b115c-fa52-4a2d-bbce-3c6ae9f06b3f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:31.254950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a15b115c-fa52-4a2d-bbce-3c6ae9f06b3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:31.254950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:31.254950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:31.254950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:31.254950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:31.254950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:31.254950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:31.254950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:31.254950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:31.254950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:31.254950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:31.254950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:31.254950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:21:31.254950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:21:31.254950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:21:31.256029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:21:31.256029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:31.256029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:31.256029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:31.256029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:31.256029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:31.256029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:31.256029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:31.256029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:31.256029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:31.256029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:31.256029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:31.256029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:31.256029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:31.256029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:31.256029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:31.256029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:31.257154 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:21:31.257154 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:21:31.257154 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:31.257154 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:21:31.257154 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 647/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:31.261645 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4df77-dcbd-4585-badc-57c4379ce507 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:31.359245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4df77-dcbd-4585-badc-57c4379ce507 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:31.397307 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7ec29-2f14-4f33-87c0-7a3571a7c699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:31.398004 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7ec29-2f14-4f33-87c0-7a3571a7c699 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:31.398286 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7ec29-2f14-4f33-87c0-7a3571a7c699 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:31.398560 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7ec29-2f14-4f33-87c0-7a3571a7c699 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:31.399420 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7ec29-2f14-4f33-87c0-7a3571a7c699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:31.399737 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7ec29-2f14-4f33-87c0-7a3571a7c699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:31.401114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7ec29-2f14-4f33-87c0-7a3571a7c699 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:31.413395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 623/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:31.419885 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b115c-fa52-4a2d-bbce-3c6ae9f06b3f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:31.456942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:31.524331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b115c-fa52-4a2d-bbce-3c6ae9f06b3f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:31.556991 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab830dc-d6d4-42ae-ad37-8fecd9a92d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:31.557766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab830dc-d6d4-42ae-ad37-8fecd9a92d4d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:31.558049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab830dc-d6d4-42ae-ad37-8fecd9a92d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:31.558316 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab830dc-d6d4-42ae-ad37-8fecd9a92d4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:31.564763 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab830dc-d6d4-42ae-ad37-8fecd9a92d4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:31.566174 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab830dc-d6d4-42ae-ad37-8fecd9a92d4d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:31.580054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-fab830dc-d6d4-42ae-ad37-8fecd9a92d4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:21:31.580054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:31.580054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:31.580054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:31.580054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:31.580054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:31.580054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:31.580054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:31.580054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:31.580054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:31.580054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:31.580054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:31.580054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:21:31.580054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:21:31.580054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:21:31.580916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:21:31.580916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:31.580916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:31.580916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:31.580916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:31.580916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:31.580916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:31.580916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:31.580916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:31.580916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:31.580916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:31.580916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:31.580916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:31.580916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:31.580916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:31.580916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:31.580916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:31.581816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:21:31.581816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:21:31.581816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:21:31.581816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:21:31.581816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:21:31.581816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:21:31.581816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:21:31.581816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:21:31.581816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 648/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:21:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:31.587003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7ec29-2f14-4f33-87c0-7a3571a7c699 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:31.644043 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:31.685097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7ec29-2f14-4f33-87c0-7a3571a7c699 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:31.718511 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fa7b3-1c0a-4c6a-8719-2bba287bd867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:31.719146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fa7b3-1c0a-4c6a-8719-2bba287bd867 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:31.719428 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fa7b3-1c0a-4c6a-8719-2bba287bd867 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:31.719703 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fa7b3-1c0a-4c6a-8719-2bba287bd867 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:31.720485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7fa7b3-1c0a-4c6a-8719-2bba287bd867 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:31.720794 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7fa7b3-1c0a-4c6a-8719-2bba287bd867 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:31.722208 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7fa7b3-1c0a-4c6a-8719-2bba287bd867 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:31.734668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 624/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:21:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:31.740732 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab830dc-d6d4-42ae-ad37-8fecd9a92d4d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:31.831381 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:31.840290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab830dc-d6d4-42ae-ad37-8fecd9a92d4d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:31.874281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4ec5e-d233-46a7-a143-4bb451f2ea3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:31.875185 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4ec5e-d233-46a7-a143-4bb451f2ea3a None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:31.875461 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4ec5e-d233-46a7-a143-4bb451f2ea3a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:31.875728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4ec5e-d233-46a7-a143-4bb451f2ea3a None admin] PATH_INFO: `/v3/projects/1ba395a1e22f430084089947e47a622d/users/11a51c42a4094d9b97eb636c57225dd9/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:31.877651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4ec5e-d233-46a7-a143-4bb451f2ea3a None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba395a1e22f430084089947e47a622d, user_id=11a51c42a4094d9b97eb636c57225dd9, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:31.879091 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4ec5e-d233-46a7-a143-4bb451f2ea3a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:31.891971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 649/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Jul 19 12:21:31 2022] PUT /identity/v3/projects/1ba395a1e22f430084089947e47a622d/users/11a51c42a4094d9b97eb636c57225dd9/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:21:33.891984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3eb2d-1aaa-415f-a4e6-5a237b842ba2 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:33.892531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3eb2d-1aaa-415f-a4e6-5a237b842ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:33.892531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3eb2d-1aaa-415f-a4e6-5a237b842ba2 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:33.893882 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 625/1274] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:21:33.899179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34868b91-b238-4b3d-9e5c-e4641f041a97 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:33.899570 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34868b91-b238-4b3d-9e5c-e4641f041a97 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:33.899739 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34868b91-b238-4b3d-9e5c-e4641f041a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:33.916205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-34868b91-b238-4b3d-9e5c-e4641f041a97 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:21:33.917389 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-34868b91-b238-4b3d-9e5c-e4641f041a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:21:33.983049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 650/1275] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:21:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:21:34.006203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3eb2d-1aaa-415f-a4e6-5a237b842ba2 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:34.104424 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3eb2d-1aaa-415f-a4e6-5a237b842ba2 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:34.120945 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:34.138199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87bb24-5f43-4639-a624-b283a524d252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:34.139016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87bb24-5f43-4639-a624-b283a524d252 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:34.139298 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87bb24-5f43-4639-a624-b283a524d252 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:34.139567 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87bb24-5f43-4639-a624-b283a524d252 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:34.149684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87bb24-5f43-4639-a624-b283a524d252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 12:21:34.157954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-ce87bb24-5f43-4639-a624-b283a524d252 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:21:34.157954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:34.157954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:34.157954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:34.157954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:34.157954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:34.157954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:34.157954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:34.157954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:34.157954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:34.157954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:34.157954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:34.157954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 12:21:34.157954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 12:21:34.157954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 12:21:34.157954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 12:21:34.159055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 12:21:34.159055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 12:21:34.159055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 12:21:34.159055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 12:21:34.159055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:34.159055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:34.159055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:34.159055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:34.159055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:34.159055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:34.159055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:34.159055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:34.159055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:34.159055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:34.159055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:34.159055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:34.160096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:34.160096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:34.160096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:34.160096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:34.160096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 12:21:34.160096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 12:21:34.160096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 12:21:34.160096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 12:21:34.160096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 12:21:34.160096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 12:21:34.160096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 12:21:34.160096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:34.160096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 626/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Jul 19 12:21:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:34.165090 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34868b91-b238-4b3d-9e5c-e4641f041a97 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:34.244257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:34.263239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34868b91-b238-4b3d-9e5c-e4641f041a97 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:34.295852 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d0ff3-abc9-4512-912e-09abc3dd4333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:34.296500 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d0ff3-abc9-4512-912e-09abc3dd4333 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:34.296776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d0ff3-abc9-4512-912e-09abc3dd4333 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:34.297041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d0ff3-abc9-4512-912e-09abc3dd4333 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:34.297765 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d0ff3-abc9-4512-912e-09abc3dd4333 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:34.298062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d0ff3-abc9-4512-912e-09abc3dd4333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:34.299431 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d0ff3-abc9-4512-912e-09abc3dd4333 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:34.307566 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 651/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Jul 19 12:21:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:34.313121 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87bb24-5f43-4639-a624-b283a524d252 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:34.414347 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87bb24-5f43-4639-a624-b283a524d252 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:34.449961 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdff30-0450-424a-ade7-a461022ea1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:34.451576 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdff30-0450-424a-ade7-a461022ea1cc None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:34.451863 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdff30-0450-424a-ade7-a461022ea1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:34.452138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdff30-0450-424a-ade7-a461022ea1cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:34.462568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdff30-0450-424a-ade7-a461022ea1cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:34.464050 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdff30-0450-424a-ade7-a461022ea1cc None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:34.480870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-bbbdff30-0450-424a-ade7-a461022ea1cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:34.480870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:34.480870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:34.480870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:34.480870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:34.480870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:34.480870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:34.480870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:34.480870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:34.480870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:34.480870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:34.480870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:34.480870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:21:34.480870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:21:34.480870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:21:34.481906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:21:34.481906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:34.481906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:34.481906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:34.481906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:34.481906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:34.481906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:34.481906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:34.481906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:34.481906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:34.481906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:34.481906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:34.481906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:34.481906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:34.481906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:34.481906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:34.481906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:34.482888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:21:34.482888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:21:34.482888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:34.482888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:34.482888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 627/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:34.487901 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d0ff3-abc9-4512-912e-09abc3dd4333 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:34.585791 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d0ff3-abc9-4512-912e-09abc3dd4333 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:34.618141 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae90e32-22b6-4de8-81f8-871c38cc817c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:34.618817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae90e32-22b6-4de8-81f8-871c38cc817c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:34.619100 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae90e32-22b6-4de8-81f8-871c38cc817c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:34.619377 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae90e32-22b6-4de8-81f8-871c38cc817c None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:34.620091 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae90e32-22b6-4de8-81f8-871c38cc817c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:34.620395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae90e32-22b6-4de8-81f8-871c38cc817c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:34.622261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae90e32-22b6-4de8-81f8-871c38cc817c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:34.633270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 652/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:34.639361 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdff30-0450-424a-ade7-a461022ea1cc None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:34.669779 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:34.739641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdff30-0450-424a-ade7-a461022ea1cc None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:34.772466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc70ea-cc9d-4f5f-851e-c29798d51dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:34.773255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc70ea-cc9d-4f5f-851e-c29798d51dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:34.773533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc70ea-cc9d-4f5f-851e-c29798d51dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:34.773802 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc70ea-cc9d-4f5f-851e-c29798d51dc8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:34.781281 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc70ea-cc9d-4f5f-851e-c29798d51dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:34.782714 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc70ea-cc9d-4f5f-851e-c29798d51dc8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:34.797109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-19fc70ea-cc9d-4f5f-851e-c29798d51dc8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 12:21:34.797109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:34.797109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:34.797109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:34.797109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:34.797109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:34.797109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:34.797109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:34.797109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:34.797109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:34.797109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:34.797109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:34.797109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 12:21:34.797109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 12:21:34.797109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 12:21:34.797109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 12:21:34.798200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:34.798200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:34.798200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 12:21:34.798200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:21:34.798200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 12:21:34.798200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 12:21:34.798200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:34.798200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:34.798200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:34.798200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:34.798200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:34.798200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:34.798200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:34.798200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:34.798200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:34.798200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:34.798200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:34.798200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:34.799196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:34.799196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:34.799196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 12:21:34.799196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 12:21:34.799196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 12:21:34.799196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 12:21:34.799196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 12:21:34.799196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 12:21:34.799196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 12:21:34.799196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:34.799196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 628/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:34.804135 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae90e32-22b6-4de8-81f8-871c38cc817c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:34.807951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:34.902869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae90e32-22b6-4de8-81f8-871c38cc817c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:34.936240 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30408128-4454-4d1a-bdf3-d67aa7d4207e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:34.936900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30408128-4454-4d1a-bdf3-d67aa7d4207e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:34.937180 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30408128-4454-4d1a-bdf3-d67aa7d4207e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:34.937451 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30408128-4454-4d1a-bdf3-d67aa7d4207e None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:34.938274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30408128-4454-4d1a-bdf3-d67aa7d4207e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:34.938582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30408128-4454-4d1a-bdf3-d67aa7d4207e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:34.940034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30408128-4454-4d1a-bdf3-d67aa7d4207e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:34.956731 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 653/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Jul 19 12:21:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:34.962389 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc70ea-cc9d-4f5f-851e-c29798d51dc8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:35.050728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:35.060749 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc70ea-cc9d-4f5f-851e-c29798d51dc8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:35.092473 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad27c8-6cb3-4cb1-9c79-8fa9f1bf28c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:35.093108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad27c8-6cb3-4cb1-9c79-8fa9f1bf28c3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:35.093384 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad27c8-6cb3-4cb1-9c79-8fa9f1bf28c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:35.093654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad27c8-6cb3-4cb1-9c79-8fa9f1bf28c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:35.158989 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad27c8-6cb3-4cb1-9c79-8fa9f1bf28c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:35.160356 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad27c8-6cb3-4cb1-9c79-8fa9f1bf28c3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:35.245547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:35.255891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 629/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Jul 19 12:21:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 12:21:35.261614 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30408128-4454-4d1a-bdf3-d67aa7d4207e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:35.321551 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:35.359566 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30408128-4454-4d1a-bdf3-d67aa7d4207e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:35.396446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fdb31-5898-4515-b2d6-801dbc3e42ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:35.397240 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fdb31-5898-4515-b2d6-801dbc3e42ef None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:35.397524 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fdb31-5898-4515-b2d6-801dbc3e42ef None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:35.397801 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fdb31-5898-4515-b2d6-801dbc3e42ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:35.408459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fdb31-5898-4515-b2d6-801dbc3e42ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:35.409943 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fdb31-5898-4515-b2d6-801dbc3e42ef None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:35.428257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-1c4fdb31-5898-4515-b2d6-801dbc3e42ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:35.428257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:35.428257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:35.428257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:35.428257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:35.428257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:35.428257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:35.428257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:35.428257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:35.428257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:35.428257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:35.428257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:35.428257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 12:21:35.428257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 12:21:35.428257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 12:21:35.429321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 12:21:35.429321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:35.429321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:35.429321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:35.429321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:35.429321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:35.429321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:35.429321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:35.429321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:35.429321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:35.429321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:35.429321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:35.429321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:35.429321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:35.429321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:35.429321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:35.429321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:35.435316 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 12:21:35.435316 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 12:21:35.435316 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 12:21:35.435316 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:21:35.435316 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 654/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:35.435675 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad27c8-6cb3-4cb1-9c79-8fa9f1bf28c3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:35.532433 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad27c8-6cb3-4cb1-9c79-8fa9f1bf28c3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:35.564417 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ed2fe-4c49-424f-b373-e10d2ded448f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:35.565067 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ed2fe-4c49-424f-b373-e10d2ded448f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:35.565349 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ed2fe-4c49-424f-b373-e10d2ded448f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:35.565627 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ed2fe-4c49-424f-b373-e10d2ded448f None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:35.566340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ed2fe-4c49-424f-b373-e10d2ded448f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:35.566644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ed2fe-4c49-424f-b373-e10d2ded448f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:35.568024 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ed2fe-4c49-424f-b373-e10d2ded448f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:35.579470 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 630/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Jul 19 12:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:35.585030 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fdb31-5898-4515-b2d6-801dbc3e42ef None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:35.683318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fdb31-5898-4515-b2d6-801dbc3e42ef None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:35.697230 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:35.718433 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0b5b3-b05d-4614-a0eb-6de61548773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:35.719260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0b5b3-b05d-4614-a0eb-6de61548773c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:35.719540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0b5b3-b05d-4614-a0eb-6de61548773c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:35.719841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0b5b3-b05d-4614-a0eb-6de61548773c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:35.726374 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0b5b3-b05d-4614-a0eb-6de61548773c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:35.727843 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0b5b3-b05d-4614-a0eb-6de61548773c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:35.741878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-00b0b5b3-b05d-4614-a0eb-6de61548773c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:21:35.741878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:35.741878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:35.741878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:35.741878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:35.741878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:35.741878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:35.741878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:35.741878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:35.741878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:35.741878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:35.741878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:35.741878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 12:21:35.741878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 12:21:35.741878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 12:21:35.742966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 12:21:35.742966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:35.742966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:35.742966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:35.742966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:35.742966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:35.742966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:35.742966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:35.742966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:35.742966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:35.742966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:35.742966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:35.742966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:35.742966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:35.742966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:35.742966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:35.742966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:35.744209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 12:21:35.744209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 12:21:35.744209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 12:21:35.744209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 12:21:35.744209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 12:21:35.744209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 12:21:35.744209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 12:21:35.744209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Jul 19 12:21:35.744209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 655/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Jul 19 12:21:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:35.749440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ed2fe-4c49-424f-b373-e10d2ded448f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:35.802245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:35.856598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ed2fe-4c49-424f-b373-e10d2ded448f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:35.889824 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297c509-e401-4e7a-b552-3a43057001d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:35.890471 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297c509-e401-4e7a-b552-3a43057001d9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:35.891037 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297c509-e401-4e7a-b552-3a43057001d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:35.891303 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297c509-e401-4e7a-b552-3a43057001d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:35.892078 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297c509-e401-4e7a-b552-3a43057001d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:35.892383 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297c509-e401-4e7a-b552-3a43057001d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:35.893803 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297c509-e401-4e7a-b552-3a43057001d9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:35.906162 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 631/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Jul 19 12:21:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:21:35.912293 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0b5b3-b05d-4614-a0eb-6de61548773c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:36.010478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0b5b3-b05d-4614-a0eb-6de61548773c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:36.043046 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea396b9-4e52-47e5-857c-a1efd3a9efab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:36.044228 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea396b9-4e52-47e5-857c-a1efd3a9efab None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:36.044504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea396b9-4e52-47e5-857c-a1efd3a9efab None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:36.044774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea396b9-4e52-47e5-857c-a1efd3a9efab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:36.045586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea396b9-4e52-47e5-857c-a1efd3a9efab None admin] RBAC: Adding query filter params (role.id=386cb814e8464fda8832b13c75eabdaf, scope.project.id=1ba395a1e22f430084089947e47a622d, user.id=11a51c42a4094d9b97eb636c57225dd9) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:36.045889 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea396b9-4e52-47e5-857c-a1efd3a9efab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:36.047315 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea396b9-4e52-47e5-857c-a1efd3a9efab None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:36.052925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 656/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Jul 19 12:21:35 2022] GET /identity/v3/role_assignments?user.id=11a51c42a4094d9b97eb636c57225dd9&scope.project.id=1ba395a1e22f430084089947e47a622d&role.id=386cb814e8464fda8832b13c75eabdaf => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:38.072379 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544b925-5838-4164-9738-f014dcdecb46 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:38.072894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544b925-5838-4164-9738-f014dcdecb46 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:38.072894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544b925-5838-4164-9738-f014dcdecb46 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:38.074222 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 632/1288] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:21:38.079975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9458daa-692e-4fa9-9b39-0589ad2d0d92 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:38.080387 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9458daa-692e-4fa9-9b39-0589ad2d0d92 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:38.080522 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9458daa-692e-4fa9-9b39-0589ad2d0d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:38.097580 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e9458daa-692e-4fa9-9b39-0589ad2d0d92 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:21:38.098775 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e9458daa-692e-4fa9-9b39-0589ad2d0d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:21:38.126971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:38.164097 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 657/1289] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:21:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:21:38.186780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544b925-5838-4164-9738-f014dcdecb46 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:38.285793 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544b925-5838-4164-9738-f014dcdecb46 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:38.296485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:38.319204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed96ad-757c-49d2-85f2-fbd5025f5afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:38.319986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed96ad-757c-49d2-85f2-fbd5025f5afa None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:38.320260 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed96ad-757c-49d2-85f2-fbd5025f5afa None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:38.320525 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed96ad-757c-49d2-85f2-fbd5025f5afa None admin] PATH_INFO: `/v3/services/placement` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:38.321160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed96ad-757c-49d2-85f2-fbd5025f5afa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:38.322915 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed96ad-757c-49d2-85f2-fbd5025f5afa None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:38.334712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-e7ed96ad-757c-49d2-85f2-fbd5025f5afa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 12:21:38.334712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:38.334712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:21:38.334712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:21:38.334712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:21:38.334712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:21:38.334712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:21:38.334712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:21:38.334712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 12:21:38.334712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:38.334712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:21:38.334712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:38.334712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:38.334712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:38.334712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:38.334712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:38.334712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:38.335982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:38.335982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:38.335982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:38.335982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:38.335982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:38.335982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:38.335982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:21:38.335982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:21:38.335982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:21:38.335982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:21:38.335982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:38.335982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:38.335982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:38.335982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:38.335982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:38.335982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:38.337115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:38.337115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:38.337115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:38.337115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:38.337115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:38.337115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:38.337115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:38.337115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:38.337115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:38.337115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:38.337115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:21:38.337115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:21:38.337115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 12:21:38.337115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:38.337115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 633/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 19 12:21:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:38.342556 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9458daa-692e-4fa9-9b39-0589ad2d0d92 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:38.456212 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9458daa-692e-4fa9-9b39-0589ad2d0d92 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:38.489891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80775ec-424b-481d-9dc4-7e46cf89768c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:38.490553 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80775ec-424b-481d-9dc4-7e46cf89768c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:38.490863 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80775ec-424b-481d-9dc4-7e46cf89768c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:38.491141 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80775ec-424b-481d-9dc4-7e46cf89768c None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:38.491838 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80775ec-424b-481d-9dc4-7e46cf89768c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:38.492146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80775ec-424b-481d-9dc4-7e46cf89768c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:38.493498 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80775ec-424b-481d-9dc4-7e46cf89768c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:38.498809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 658/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Jul 19 12:21:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:38.504709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed96ad-757c-49d2-85f2-fbd5025f5afa None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:38.601600 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed96ad-757c-49d2-85f2-fbd5025f5afa None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:38.633963 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13707d1e-305f-4372-9345-d5e57a6e4e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:38.634611 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13707d1e-305f-4372-9345-d5e57a6e4e96 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:38.634923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13707d1e-305f-4372-9345-d5e57a6e4e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:38.635199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13707d1e-305f-4372-9345-d5e57a6e4e96 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:38.635897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13707d1e-305f-4372-9345-d5e57a6e4e96 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:38.636202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13707d1e-305f-4372-9345-d5e57a6e4e96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:38.637572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13707d1e-305f-4372-9345-d5e57a6e4e96 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:38.642315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 634/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Jul 19 12:21:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:40.634714 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e10b-c7de-4c6e-8392-b39b5665d341 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:40.635267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e10b-c7de-4c6e-8392-b39b5665d341 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:40.635379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e10b-c7de-4c6e-8392-b39b5665d341 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:40.636668 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 659/1293] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:21:40.642448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57bb86-ae70-45dd-8ac2-e458d2f63b46 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:40.642843 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57bb86-ae70-45dd-8ac2-e458d2f63b46 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:40.643043 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57bb86-ae70-45dd-8ac2-e458d2f63b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:40.659473 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9a57bb86-ae70-45dd-8ac2-e458d2f63b46 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:21:40.660651 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9a57bb86-ae70-45dd-8ac2-e458d2f63b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:21:40.689537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:40.727042 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 635/1294] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:21:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:21:40.749983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e10b-c7de-4c6e-8392-b39b5665d341 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:40.781275 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:40.851190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e10b-c7de-4c6e-8392-b39b5665d341 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:40.889818 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce3eb7-08f9-4c3a-ac55-73c25f23062b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:40.890411 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce3eb7-08f9-4c3a-ac55-73c25f23062b None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:40.890692 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce3eb7-08f9-4c3a-ac55-73c25f23062b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:40.891251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce3eb7-08f9-4c3a-ac55-73c25f23062b None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:40.891963 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce3eb7-08f9-4c3a-ac55-73c25f23062b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:40.893322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce3eb7-08f9-4c3a-ac55-73c25f23062b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:40.907427 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 660/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Jul 19 12:21:40 2022] POST /identity/v3/services => generated 246 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:21:42.946038 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8dfab-708e-498a-b6d6-69acf85a909c None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:42.946593 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8dfab-708e-498a-b6d6-69acf85a909c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:42.946593 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8dfab-708e-498a-b6d6-69acf85a909c None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:42.947977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 636/1296] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:21:42.953113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341bd33-1b75-420d-add9-6219f1af0445 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:42.953508 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341bd33-1b75-420d-add9-6219f1af0445 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:42.953612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341bd33-1b75-420d-add9-6219f1af0445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:42.970419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9341bd33-1b75-420d-add9-6219f1af0445 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:21:42.971614 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9341bd33-1b75-420d-add9-6219f1af0445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:21:43.043525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 661/1297] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:21:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 12:21:43.065631 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8dfab-708e-498a-b6d6-69acf85a909c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:43.163556 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8dfab-708e-498a-b6d6-69acf85a909c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:43.195723 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ed608-7947-4900-8277-bb01d27cbfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:43.196501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ed608-7947-4900-8277-bb01d27cbfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:43.196778 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ed608-7947-4900-8277-bb01d27cbfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:43.197048 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ed608-7947-4900-8277-bb01d27cbfe8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:43.197690 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ed608-7947-4900-8277-bb01d27cbfe8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:43.199062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ed608-7947-4900-8277-bb01d27cbfe8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:43.211221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-8a4ed608-7947-4900-8277-bb01d27cbfe8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 12:21:43.211221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:43.211221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:21:43.211221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:21:43.211221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:21:43.211221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:21:43.211221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:21:43.211221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:21:43.211221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 12:21:43.211221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:43.211221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:21:43.211221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:43.211221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:43.211221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:43.211221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:43.211221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:43.211221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:43.212373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:43.212373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:43.212373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:43.212373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:43.212373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:43.212373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:43.212373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:21:43.212373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:21:43.212373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:21:43.212373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:21:43.212373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:43.212373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:43.212373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:43.212373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:43.212373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:43.212373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:43.213256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:43.213256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:43.213256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:43.213256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:43.213256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:43.213256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:43.213256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:43.213256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:43.213256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:43.213256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:43.213256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:21:43.213256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:21:43.213256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 12:21:43.213256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:43.213256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 637/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 19 12:21:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:43.219144 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341bd33-1b75-420d-add9-6219f1af0445 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:43.237141 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:43.316624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341bd33-1b75-420d-add9-6219f1af0445 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:43.349765 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0113211-fd45-4741-b7c8-bbee341e3265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:43.350416 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0113211-fd45-4741-b7c8-bbee341e3265 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:43.350694 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0113211-fd45-4741-b7c8-bbee341e3265 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:43.351000 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0113211-fd45-4741-b7c8-bbee341e3265 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:43.351690 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0113211-fd45-4741-b7c8-bbee341e3265 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:43.351992 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0113211-fd45-4741-b7c8-bbee341e3265 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:43.353337 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0113211-fd45-4741-b7c8-bbee341e3265 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:43.359021 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 662/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Jul 19 12:21:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:43.364849 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ed608-7947-4900-8277-bb01d27cbfe8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:43.399636 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:43.471811 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ed608-7947-4900-8277-bb01d27cbfe8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:43.504448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4562fc-63ef-48c1-b3e5-809d460d6983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:43.505090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4562fc-63ef-48c1-b3e5-809d460d6983 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:43.505367 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4562fc-63ef-48c1-b3e5-809d460d6983 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:43.505636 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4562fc-63ef-48c1-b3e5-809d460d6983 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:43.506418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4562fc-63ef-48c1-b3e5-809d460d6983 None admin] RBAC: Adding query filter params (interface=public, service_id=5c556006093341628686fe0451ff3495, region_id=RegionOne) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:43.506724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4562fc-63ef-48c1-b3e5-809d460d6983 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:43.508114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4562fc-63ef-48c1-b3e5-809d460d6983 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:43.513058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 638/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Jul 19 12:21:43 2022] GET /identity/v3/endpoints?service_id=5c556006093341628686fe0451ff3495&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:43.519040 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0113211-fd45-4741-b7c8-bbee341e3265 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:43.598991 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:43.617054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0113211-fd45-4741-b7c8-bbee341e3265 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:43.650719 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef600833-62c0-44f5-a32c-2a4f5667c0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:43.651398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef600833-62c0-44f5-a32c-2a4f5667c0fe None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:43.651680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef600833-62c0-44f5-a32c-2a4f5667c0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:43.651957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef600833-62c0-44f5-a32c-2a4f5667c0fe None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:43.652628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef600833-62c0-44f5-a32c-2a4f5667c0fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:43.654056 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef600833-62c0-44f5-a32c-2a4f5667c0fe None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:43.660751 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 663/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Jul 19 12:21:43 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:21:45.654482 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b4913-1a28-41c4-b0b0-b6feb3620009 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:45.655075 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b4913-1a28-41c4-b0b0-b6feb3620009 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:45.655075 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b4913-1a28-41c4-b0b0-b6feb3620009 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:45.656430 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 639/1302] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:21:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:21:45.661433 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a28a4-f629-45d2-bd35-668e74d7215b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:45.661833 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a28a4-f629-45d2-bd35-668e74d7215b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:45.661995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a28a4-f629-45d2-bd35-668e74d7215b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:45.678977 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-152a28a4-f629-45d2-bd35-668e74d7215b None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:21:45.680164 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-152a28a4-f629-45d2-bd35-668e74d7215b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:21:45.745193 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 664/1303] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:21:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 12:21:45.768311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b4913-1a28-41c4-b0b0-b6feb3620009 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:45.862068 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:45.868893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b4913-1a28-41c4-b0b0-b6feb3620009 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:45.901087 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834a048-a423-4595-a902-89f355f9e1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:45.901874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834a048-a423-4595-a902-89f355f9e1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:45.902156 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834a048-a423-4595-a902-89f355f9e1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:45.902427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834a048-a423-4595-a902-89f355f9e1c5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:45.903630 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834a048-a423-4595-a902-89f355f9e1c5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:45.905115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834a048-a423-4595-a902-89f355f9e1c5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:45.916745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-8834a048-a423-4595-a902-89f355f9e1c5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 12:21:45.916745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:45.916745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 12:21:45.916745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 12:21:45.916745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 12:21:45.916745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 12:21:45.916745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 12:21:45.916745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:21:45.916745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 12:21:45.916745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:45.916745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 12:21:45.916745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:45.916745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 12:21:45.916745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 12:21:45.916745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 12:21:45.916745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 12:21:45.916745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 12:21:45.917894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 12:21:45.917894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 12:21:45.917894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 12:21:45.917894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 12:21:45.917894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 12:21:45.917894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 12:21:45.917894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 12:21:45.917894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 12:21:45.917894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 12:21:45.917894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 12:21:45.917894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 12:21:45.917894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 12:21:45.917894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 12:21:45.917894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 12:21:45.917894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 12:21:45.917894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 12:21:45.919786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 12:21:45.919786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( Jul 19 12:21:45.919786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 12:21:45.919786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() Jul 19 12:21:45.919786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 12:21:45.919786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 12:21:45.919786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 12:21:45.919786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() Jul 19 12:21:45.919786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 12:21:45.919786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( Jul 19 12:21:45.919786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 12:21:45.919786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 12:21:45.919786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 12:21:45.919786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Jul 19 12:21:45.919786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 640/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Jul 19 12:21:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 12:21:45.924600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a28a4-f629-45d2-bd35-668e74d7215b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:45.998950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:46.021818 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a28a4-f629-45d2-bd35-668e74d7215b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:46.055058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb1c08-e922-4b61-abf2-ad43f956608f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:46.055715 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb1c08-e922-4b61-abf2-ad43f956608f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:46.056000 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb1c08-e922-4b61-abf2-ad43f956608f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:46.056277 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb1c08-e922-4b61-abf2-ad43f956608f None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:46.056974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb1c08-e922-4b61-abf2-ad43f956608f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:21:46.057281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb1c08-e922-4b61-abf2-ad43f956608f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:46.058640 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb1c08-e922-4b61-abf2-ad43f956608f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:46.063810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 665/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Jul 19 12:21:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:21:46.069425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834a048-a423-4595-a902-89f355f9e1c5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:46.166883 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834a048-a423-4595-a902-89f355f9e1c5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:46.198273 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbf1df-97aa-4a29-bf3a-285724b4a92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:46.198932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbf1df-97aa-4a29-bf3a-285724b4a92c None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:46.199211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbf1df-97aa-4a29-bf3a-285724b4a92c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:46.199481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbf1df-97aa-4a29-bf3a-285724b4a92c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:46.200717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbf1df-97aa-4a29-bf3a-285724b4a92c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:46.202058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbf1df-97aa-4a29-bf3a-285724b4a92c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:46.220392 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 641/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Jul 19 12:21:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:21:56.060907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=30 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:56.215977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:22:49.412969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce41d4-9f0e-42e6-98bc-91181107ef70 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:49.412969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce41d4-9f0e-42e6-98bc-91181107ef70 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:49.413457 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce41d4-9f0e-42e6-98bc-91181107ef70 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:49.415803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 666/1307] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:22:49.421824 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972db09-d7fa-4506-b066-15d5f4218ef9 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:49.422275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972db09-d7fa-4506-b066-15d5f4218ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:49.422379 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972db09-d7fa-4506-b066-15d5f4218ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:49.521448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4972db09-d7fa-4506-b066-15d5f4218ef9 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:22:49.523472 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4972db09-d7fa-4506-b066-15d5f4218ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:49.674950 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 642/1308] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:22:49.728873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed56785-c165-4bce-9453-bf0297d3dfc7 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:49.729323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed56785-c165-4bce-9453-bf0297d3dfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:49.729690 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed56785-c165-4bce-9453-bf0297d3dfc7 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:49.731431 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 667/1309] 10.222.0.25 () {54 vars in 965 bytes} [Tue Jul 19 12:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:22:49.737780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166203d1-0ff1-4054-ae89-8fbe7e84ddfb None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:49.738137 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166203d1-0ff1-4054-ae89-8fbe7e84ddfb None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:49.738320 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166203d1-0ff1-4054-ae89-8fbe7e84ddfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:49.823194 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-166203d1-0ff1-4054-ae89-8fbe7e84ddfb None None] MFA Rules not processed for user `977392666b5a4076884416489b935ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:22:49.825419 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-166203d1-0ff1-4054-ae89-8fbe7e84ddfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:49.850088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:22:49.916905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 643/1310] 10.222.0.25 () {58 vars in 1062 bytes} [Tue Jul 19 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:22:49.926372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed56785-c165-4bce-9453-bf0297d3dfc7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:49.929585 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8ed56785-c165-4bce-9453-bf0297d3dfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:50.052939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed56785-c165-4bce-9453-bf0297d3dfc7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:50.150633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2078f-7543-43a1-acfa-9c95545c3a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:50.152884 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2078f-7543-43a1-acfa-9c95545c3a64 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:50.152884 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2078f-7543-43a1-acfa-9c95545c3a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:50.153302 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2078f-7543-43a1-acfa-9c95545c3a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:50.155253 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3ad2078f-7543-43a1-acfa-9c95545c3a64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:50.227336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:22:50.300655 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2078f-7543-43a1-acfa-9c95545c3a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:50.302182 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2078f-7543-43a1-acfa-9c95545c3a64 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:50.330476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 668/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:22:52.693319 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48ff83-93cf-4c12-a57a-bc050c283cc7 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:52.693848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48ff83-93cf-4c12-a57a-bc050c283cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:52.693848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48ff83-93cf-4c12-a57a-bc050c283cc7 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:52.697913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 644/1312] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:22:52.701347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eb760-e774-4fe8-88c7-5548ec202a7b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:52.701721 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eb760-e774-4fe8-88c7-5548ec202a7b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:52.701721 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eb760-e774-4fe8-88c7-5548ec202a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:52.776330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-249eb760-e774-4fe8-88c7-5548ec202a7b None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:22:52.778349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-249eb760-e774-4fe8-88c7-5548ec202a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:52.880474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 669/1313] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:22:52.920561 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48ff83-93cf-4c12-a57a-bc050c283cc7 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:52.922254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8e48ff83-93cf-4c12-a57a-bc050c283cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:53.038366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48ff83-93cf-4c12-a57a-bc050c283cc7 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:53.128952 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:22:53.132427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81952c6f-ee54-4021-8de9-c0c0798f732d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:53.133161 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81952c6f-ee54-4021-8de9-c0c0798f732d service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:53.133897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81952c6f-ee54-4021-8de9-c0c0798f732d service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:53.134386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81952c6f-ee54-4021-8de9-c0c0798f732d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:53.137467 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-81952c6f-ee54-4021-8de9-c0c0798f732d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:53.277591 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81952c6f-ee54-4021-8de9-c0c0798f732d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:53.279189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81952c6f-ee54-4021-8de9-c0c0798f732d service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:53.298644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 645/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:22:55.667727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c01160-f0bd-4f44-b3b9-890a380f0cdd None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:55.668255 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c01160-f0bd-4f44-b3b9-890a380f0cdd None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:55.668255 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c01160-f0bd-4f44-b3b9-890a380f0cdd None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:55.669625 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 670/1315] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:22:55.674683 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2765b6-283e-409c-ba72-c41be655ad55 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:55.675146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2765b6-283e-409c-ba72-c41be655ad55 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:55.675295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2765b6-283e-409c-ba72-c41be655ad55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:55.739656 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-eb2765b6-283e-409c-ba72-c41be655ad55 None None] MFA Rules not processed for user `cab36057742a4256b2d6d72a97dec4da`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:22:55.740839 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-eb2765b6-283e-409c-ba72-c41be655ad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:55.791717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:22:55.836715 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 646/1316] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:22:55 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:22:55.877051 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c01160-f0bd-4f44-b3b9-890a380f0cdd None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:55.878566 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a9c01160-f0bd-4f44-b3b9-890a380f0cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:55.888346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:22:55.983455 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c01160-f0bd-4f44-b3b9-890a380f0cdd None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:56.056124 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c71c8-3eb9-4226-8436-bcfd59de3e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:56.056695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c71c8-3eb9-4226-8436-bcfd59de3e8a service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:56.056972 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c71c8-3eb9-4226-8436-bcfd59de3e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:56.057242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c71c8-3eb9-4226-8436-bcfd59de3e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:56.059439 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-098c71c8-3eb9-4226-8436-bcfd59de3e8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:56.121240 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:22:56.167004 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c71c8-3eb9-4226-8436-bcfd59de3e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:56.169268 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c71c8-3eb9-4226-8436-bcfd59de3e8a service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:56.187278 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 671/1317] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:22:55 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:22:58.760833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460228c-e142-4983-95f7-3df4babd3fec None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:58.761331 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460228c-e142-4983-95f7-3df4babd3fec None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:58.761692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460228c-e142-4983-95f7-3df4babd3fec None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:58.763133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 647/1318] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:22:58.768527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc3d29-3a37-4602-b723-70416a434145 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:58.768949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc3d29-3a37-4602-b723-70416a434145 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:58.769084 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc3d29-3a37-4602-b723-70416a434145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:58.833162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cbfc3d29-3a37-4602-b723-70416a434145 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:22:58.834363 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cbfc3d29-3a37-4602-b723-70416a434145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:58.930250 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 672/1319] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:22:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:22:58.970178 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460228c-e142-4983-95f7-3df4babd3fec None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:58.971737 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7460228c-e142-4983-95f7-3df4babd3fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:59.073439 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460228c-e142-4983-95f7-3df4babd3fec None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:59.145800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b44fb4-e532-4bb1-a997-5058bc23714c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:59.146447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b44fb4-e532-4bb1-a997-5058bc23714c service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:59.146729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b44fb4-e532-4bb1-a997-5058bc23714c service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:59.147033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b44fb4-e532-4bb1-a997-5058bc23714c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:59.148676 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-13b44fb4-e532-4bb1-a997-5058bc23714c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:59.156659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:22:59.256168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b44fb4-e532-4bb1-a997-5058bc23714c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:59.257516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b44fb4-e532-4bb1-a997-5058bc23714c service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:59.276071 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 648/1320] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:22:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:01.960695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db66b3-3315-4f71-94c9-0ddaec115c2b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:01.961253 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db66b3-3315-4f71-94c9-0ddaec115c2b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:01.961253 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db66b3-3315-4f71-94c9-0ddaec115c2b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:01.962590 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 673/1321] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:01.968356 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac5512-2a05-48d8-b3b9-b2539f8be8e7 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:01.968766 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac5512-2a05-48d8-b3b9-b2539f8be8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:01.968901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac5512-2a05-48d8-b3b9-b2539f8be8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:02.033613 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6bac5512-2a05-48d8-b3b9-b2539f8be8e7 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:02.034877 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6bac5512-2a05-48d8-b3b9-b2539f8be8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:02.093513 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:02.136573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 649/1322] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:23:02.189656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7da03-692e-4131-ac4b-a514231aaff6 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:02.190027 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7da03-692e-4131-ac4b-a514231aaff6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:02.190299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7da03-692e-4131-ac4b-a514231aaff6 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:02.191711 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 674/1323] 10.222.0.25 () {54 vars in 965 bytes} [Tue Jul 19 12:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:02.198157 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3253cb3-5a37-4438-b471-9d94081ef710 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:02.198599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3253cb3-5a37-4438-b471-9d94081ef710 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:02.199438 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3253cb3-5a37-4438-b471-9d94081ef710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:02.281956 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d3253cb3-5a37-4438-b471-9d94081ef710 None None] MFA Rules not processed for user `977392666b5a4076884416489b935ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:02.283203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d3253cb3-5a37-4438-b471-9d94081ef710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:02.363016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 650/1324] 10.222.0.25 () {58 vars in 1062 bytes} [Tue Jul 19 12:23:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:02.372079 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7da03-692e-4131-ac4b-a514231aaff6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:02.373629 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b7b7da03-692e-4131-ac4b-a514231aaff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:02.395158 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:02.480898 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7da03-692e-4131-ac4b-a514231aaff6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:02.553673 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e281cf-b1db-494a-bdc6-ffaa432be8b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:02.554212 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e281cf-b1db-494a-bdc6-ffaa432be8b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:02.554489 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e281cf-b1db-494a-bdc6-ffaa432be8b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:02.554778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e281cf-b1db-494a-bdc6-ffaa432be8b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:02.556401 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d0e281cf-b1db-494a-bdc6-ffaa432be8b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:02.628865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:02.668913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e281cf-b1db-494a-bdc6-ffaa432be8b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:02.670364 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e281cf-b1db-494a-bdc6-ffaa432be8b2 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:02.691402 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 675/1325] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:05.006895 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d4a3b-7873-46c7-a759-fb01bf67b1e0 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:05.007444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d4a3b-7873-46c7-a759-fb01bf67b1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:05.007444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d4a3b-7873-46c7-a759-fb01bf67b1e0 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:05.008781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 651/1326] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:05.015206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66318778-d35d-4f8c-b175-68a7c603dab8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:05.015740 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66318778-d35d-4f8c-b175-68a7c603dab8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:05.015740 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66318778-d35d-4f8c-b175-68a7c603dab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:05.083057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-66318778-d35d-4f8c-b175-68a7c603dab8 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:05.084265 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-66318778-d35d-4f8c-b175-68a7c603dab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:05.183211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 676/1327] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:05.220210 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d4a3b-7873-46c7-a759-fb01bf67b1e0 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:05.221777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3f4d4a3b-7873-46c7-a759-fb01bf67b1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:05.287355 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:05.331095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d4a3b-7873-46c7-a759-fb01bf67b1e0 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:05.407930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942e8fa-bd18-43c7-b8a3-56bcc862a270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:05.408577 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942e8fa-bd18-43c7-b8a3-56bcc862a270 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:05.408853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942e8fa-bd18-43c7-b8a3-56bcc862a270 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:05.409120 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942e8fa-bd18-43c7-b8a3-56bcc862a270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:05.410769 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0942e8fa-bd18-43c7-b8a3-56bcc862a270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:05.515969 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:05.518266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942e8fa-bd18-43c7-b8a3-56bcc862a270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:05.520224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942e8fa-bd18-43c7-b8a3-56bcc862a270 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:05.540028 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 652/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:07.630321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d70a1-fae6-4750-9280-7126c5a7a9e1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:07.630800 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d70a1-fae6-4750-9280-7126c5a7a9e1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:07.630915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d70a1-fae6-4750-9280-7126c5a7a9e1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:07.632250 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 677/1329] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:07.637881 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca38664-9a46-472a-a197-7f34129c1e3f None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:07.638274 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca38664-9a46-472a-a197-7f34129c1e3f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:07.638450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca38664-9a46-472a-a197-7f34129c1e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:07.712577 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-eca38664-9a46-472a-a197-7f34129c1e3f None None] MFA Rules not processed for user `cab36057742a4256b2d6d72a97dec4da`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:07.713792 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-eca38664-9a46-472a-a197-7f34129c1e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:07.829743 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 653/1330] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:23:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:07.868794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d70a1-fae6-4750-9280-7126c5a7a9e1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:07.870926 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-263d70a1-fae6-4750-9280-7126c5a7a9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:07.904936 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:07.982811 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d70a1-fae6-4750-9280-7126c5a7a9e1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:08.056641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba7ef4-aef9-49c8-a168-dbd3f7498834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:08.057212 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba7ef4-aef9-49c8-a168-dbd3f7498834 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:08.057490 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba7ef4-aef9-49c8-a168-dbd3f7498834 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:08.058387 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba7ef4-aef9-49c8-a168-dbd3f7498834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:08.060325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-09ba7ef4-aef9-49c8-a168-dbd3f7498834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:08.139676 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:08.172749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba7ef4-aef9-49c8-a168-dbd3f7498834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:08.174179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba7ef4-aef9-49c8-a168-dbd3f7498834 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:08.192110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 678/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:07 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:23:10.656923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949adc7-29e0-4c1a-9a20-552e7e574fe9 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:10.657506 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949adc7-29e0-4c1a-9a20-552e7e574fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:10.657506 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949adc7-29e0-4c1a-9a20-552e7e574fe9 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:10.658952 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 654/1332] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:10.664129 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2139b-bd91-4d83-8a7b-1c4164a2d433 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:10.664573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2139b-bd91-4d83-8a7b-1c4164a2d433 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:10.664669 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2139b-bd91-4d83-8a7b-1c4164a2d433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:10.732864 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a1b2139b-bd91-4d83-8a7b-1c4164a2d433 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:10.734059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a1b2139b-bd91-4d83-8a7b-1c4164a2d433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:10.832074 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 679/1333] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:10.869187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949adc7-29e0-4c1a-9a20-552e7e574fe9 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:10.871285 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a949adc7-29e0-4c1a-9a20-552e7e574fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:10.941944 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:10.975624 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949adc7-29e0-4c1a-9a20-552e7e574fe9 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:11.048604 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9f325-6788-4935-b656-191171f65059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:11.049241 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9f325-6788-4935-b656-191171f65059 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:11.049517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9f325-6788-4935-b656-191171f65059 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:11.049783 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9f325-6788-4935-b656-191171f65059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:11.051441 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-82a9f325-6788-4935-b656-191171f65059 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:11.158387 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9f325-6788-4935-b656-191171f65059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:11.159841 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9f325-6788-4935-b656-191171f65059 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:11.170257 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:11.178955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 655/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:13.285606 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79b0dd-d4ec-4c15-8293-dab790ae3daa None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:13.286177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79b0dd-d4ec-4c15-8293-dab790ae3daa None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:13.286177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79b0dd-d4ec-4c15-8293-dab790ae3daa None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:13.287543 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 680/1335] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:13.292991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc3a2d-b48c-461c-baf9-30751c99e567 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:13.293395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc3a2d-b48c-461c-baf9-30751c99e567 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:13.293541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc3a2d-b48c-461c-baf9-30751c99e567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:13.357970 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3bcc3a2d-b48c-461c-baf9-30751c99e567 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:13.359182 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3bcc3a2d-b48c-461c-baf9-30751c99e567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:13.456890 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 656/1336] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:13.501482 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79b0dd-d4ec-4c15-8293-dab790ae3daa None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:13.503031 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0a79b0dd-d4ec-4c15-8293-dab790ae3daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:13.543525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:13.606085 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79b0dd-d4ec-4c15-8293-dab790ae3daa None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:13.678578 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288916a5-8ce4-4b1f-a71c-50ba60d81a48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:13.679246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288916a5-8ce4-4b1f-a71c-50ba60d81a48 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:13.679526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288916a5-8ce4-4b1f-a71c-50ba60d81a48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:13.679796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288916a5-8ce4-4b1f-a71c-50ba60d81a48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:13.681431 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-288916a5-8ce4-4b1f-a71c-50ba60d81a48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:13.765037 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:13.790697 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288916a5-8ce4-4b1f-a71c-50ba60d81a48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:13.792706 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288916a5-8ce4-4b1f-a71c-50ba60d81a48 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:13.811846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 681/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:16.144248 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135ee4-19bc-4bc7-ae4f-26dfb4b1c3e7 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:16.144817 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135ee4-19bc-4bc7-ae4f-26dfb4b1c3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:16.144817 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135ee4-19bc-4bc7-ae4f-26dfb4b1c3e7 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:16.146173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 657/1338] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:16.152001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974f810-ec51-420f-8d88-0305d4675b78 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:16.152402 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974f810-ec51-420f-8d88-0305d4675b78 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:16.152556 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974f810-ec51-420f-8d88-0305d4675b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:16.219483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5974f810-ec51-420f-8d88-0305d4675b78 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:16.220719 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5974f810-ec51-420f-8d88-0305d4675b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:16.319088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 682/1339] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:23:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:16.355722 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135ee4-19bc-4bc7-ae4f-26dfb4b1c3e7 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:16.357251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f1135ee4-19bc-4bc7-ae4f-26dfb4b1c3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:16.438387 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:16.466996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135ee4-19bc-4bc7-ae4f-26dfb4b1c3e7 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:16.539784 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c3d0d-ac2b-4a00-af2a-b652c5309600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:16.540423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c3d0d-ac2b-4a00-af2a-b652c5309600 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:16.540702 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c3d0d-ac2b-4a00-af2a-b652c5309600 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:16.540974 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c3d0d-ac2b-4a00-af2a-b652c5309600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:16.542801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-492c3d0d-ac2b-4a00-af2a-b652c5309600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:16.650198 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c3d0d-ac2b-4a00-af2a-b652c5309600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:16.651733 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c3d0d-ac2b-4a00-af2a-b652c5309600 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:16.669304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 658/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:20.792428 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83ee46-5e2d-4352-9009-0c5f48189892 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:20.792928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83ee46-5e2d-4352-9009-0c5f48189892 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:20.792928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83ee46-5e2d-4352-9009-0c5f48189892 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:20.794510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 683/1341] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:20.799948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c481cb-2d8f-4d4c-94d3-4dc20cb31336 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:20.800356 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c481cb-2d8f-4d4c-94d3-4dc20cb31336 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:20.800628 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c481cb-2d8f-4d4c-94d3-4dc20cb31336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:20.805074 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:20.867423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-13c481cb-2d8f-4d4c-94d3-4dc20cb31336 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:20.868656 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-13c481cb-2d8f-4d4c-94d3-4dc20cb31336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:20.968026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 659/1342] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:21.007444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83ee46-5e2d-4352-9009-0c5f48189892 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:21.009097 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9e83ee46-5e2d-4352-9009-0c5f48189892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:21.060231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:21.119296 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83ee46-5e2d-4352-9009-0c5f48189892 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:21.195706 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e465f-3b2a-4f5d-bd37-8422bafdd01f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:21.196358 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e465f-3b2a-4f5d-bd37-8422bafdd01f service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:21.196640 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e465f-3b2a-4f5d-bd37-8422bafdd01f service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:21.196915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e465f-3b2a-4f5d-bd37-8422bafdd01f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:21.198591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-410e465f-3b2a-4f5d-bd37-8422bafdd01f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:21.294904 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:21.311607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e465f-3b2a-4f5d-bd37-8422bafdd01f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:21.312973 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e465f-3b2a-4f5d-bd37-8422bafdd01f service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:21.331477 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 684/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:24.006220 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329ac51-d44a-4f03-84f6-32885ea51181 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:24.006818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329ac51-d44a-4f03-84f6-32885ea51181 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:24.006818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329ac51-d44a-4f03-84f6-32885ea51181 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:24.008194 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 660/1344] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:24.014498 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8529723-1701-4a4c-8919-581831e3869b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:24.015039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8529723-1701-4a4c-8919-581831e3869b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:24.015157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8529723-1701-4a4c-8919-581831e3869b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:24.085123 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b8529723-1701-4a4c-8919-581831e3869b None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:24.086335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b8529723-1701-4a4c-8919-581831e3869b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:24.188670 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 685/1345] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:23:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:24.226513 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329ac51-d44a-4f03-84f6-32885ea51181 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:24.228168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2329ac51-d44a-4f03-84f6-32885ea51181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:24.318374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:24.336781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329ac51-d44a-4f03-84f6-32885ea51181 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:24.418679 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a6aae-a806-4bf0-8fcc-5e9aea0dc51f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:24.419358 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a6aae-a806-4bf0-8fcc-5e9aea0dc51f service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:24.419640 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a6aae-a806-4bf0-8fcc-5e9aea0dc51f service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:24.419910 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a6aae-a806-4bf0-8fcc-5e9aea0dc51f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:24.421549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c65a6aae-a806-4bf0-8fcc-5e9aea0dc51f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:24.533825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a6aae-a806-4bf0-8fcc-5e9aea0dc51f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:24.535339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a6aae-a806-4bf0-8fcc-5e9aea0dc51f service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:24.554145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 661/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:28.599292 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6438e4-1398-4715-8dfb-4755500dfe10 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:28.599784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6438e4-1398-4715-8dfb-4755500dfe10 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:28.599865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6438e4-1398-4715-8dfb-4755500dfe10 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:28.601219 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 686/1347] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:28.606628 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d5582-e97d-4d0c-a59b-5cb24be847a3 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:28.607068 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d5582-e97d-4d0c-a59b-5cb24be847a3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:28.607250 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d5582-e97d-4d0c-a59b-5cb24be847a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:28.638467 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:28.701637 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-752d5582-e97d-4d0c-a59b-5cb24be847a3 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:28.702885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-752d5582-e97d-4d0c-a59b-5cb24be847a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:28.809656 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 662/1348] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:28.849944 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6438e4-1398-4715-8dfb-4755500dfe10 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:28.851568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1d6438e4-1398-4715-8dfb-4755500dfe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:28.915358 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:28.964736 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6438e4-1398-4715-8dfb-4755500dfe10 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:29.042065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d516a7e-434c-4769-939a-e6ff1ff490bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:29.042718 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d516a7e-434c-4769-939a-e6ff1ff490bb service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:29.043027 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d516a7e-434c-4769-939a-e6ff1ff490bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:29.043305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d516a7e-434c-4769-939a-e6ff1ff490bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:29.045139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3d516a7e-434c-4769-939a-e6ff1ff490bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:29.158981 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:29.163077 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d516a7e-434c-4769-939a-e6ff1ff490bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:29.164516 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d516a7e-434c-4769-939a-e6ff1ff490bb service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:29.183783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 687/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:34.140591 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03f41a-4b90-4b7a-b585-661179163095 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:34.141107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03f41a-4b90-4b7a-b585-661179163095 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:34.141216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03f41a-4b90-4b7a-b585-661179163095 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:34.143218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 663/1350] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 19 12:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:34.148155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9f77a-411d-4099-8f55-fec9500bafe7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:34.158610 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9f77a-411d-4099-8f55-fec9500bafe7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:34.158996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9f77a-411d-4099-8f55-fec9500bafe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:34.270362 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6bc9f77a-411d-4099-8f55-fec9500bafe7 None None] MFA Rules not processed for user `11a51c42a4094d9b97eb636c57225dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:34.271887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6bc9f77a-411d-4099-8f55-fec9500bafe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:34.389725 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 688/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 19 12:23:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:38.507541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd3df8-d241-47d6-aaa6-aece1491880d None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:38.508067 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd3df8-d241-47d6-aaa6-aece1491880d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:38.508374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd3df8-d241-47d6-aaa6-aece1491880d None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:38.509928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 664/1352] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 19 12:23:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:38.515432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14c116-3301-4458-bba4-9949607f6139 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:38.515848 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14c116-3301-4458-bba4-9949607f6139 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:38.516171 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14c116-3301-4458-bba4-9949607f6139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:38.581708 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:38.609170 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7c14c116-3301-4458-bba4-9949607f6139 None None] MFA Rules not processed for user `11a51c42a4094d9b97eb636c57225dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:38.610819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7c14c116-3301-4458-bba4-9949607f6139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:38.748581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 689/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 19 12:23:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:38.807166 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=59 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:40.127948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4fb68-0e58-4137-a23f-eb7983659442 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:40.128541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4fb68-0e58-4137-a23f-eb7983659442 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:40.128541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4fb68-0e58-4137-a23f-eb7983659442 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:40.129786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 665/1354] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 19 12:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:40.134806 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6ebe6-b4b2-4a6c-b788-4b0a6fff71c9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:40.135242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6ebe6-b4b2-4a6c-b788-4b0a6fff71c9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:40.135633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6ebe6-b4b2-4a6c-b788-4b0a6fff71c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:40.211493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3ad6ebe6-b4b2-4a6c-b788-4b0a6fff71c9 None None] MFA Rules not processed for user `11a51c42a4094d9b97eb636c57225dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:40.212814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3ad6ebe6-b4b2-4a6c-b788-4b0a6fff71c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:40.255805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:40.323142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 690/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 19 12:23:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:43.769029 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b16398-5363-4961-bdaf-af68583b4822 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:43.769964 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b16398-5363-4961-bdaf-af68583b4822 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:43.770453 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b16398-5363-4961-bdaf-af68583b4822 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:43.776073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 666/1356] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:23:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:43.778237 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8d12c-a9ad-46e4-8bdc-da15823eafb6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:43.778675 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8d12c-a9ad-46e4-8bdc-da15823eafb6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:43.781179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8d12c-a9ad-46e4-8bdc-da15823eafb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:43.855266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-16f8d12c-a9ad-46e4-8bdc-da15823eafb6 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:43.856681 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-16f8d12c-a9ad-46e4-8bdc-da15823eafb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:43.964038 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 691/1357] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:44.019423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15682bb5-850a-4550-ad0b-25c2567891cb None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:44.020389 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15682bb5-850a-4550-ad0b-25c2567891cb None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:44.020887 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15682bb5-850a-4550-ad0b-25c2567891cb None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:44.023433 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 667/1358] 10.222.0.25 () {54 vars in 962 bytes} [Tue Jul 19 12:23:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:44.033649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54381629-27cc-4984-beb8-a9545f54406f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:44.033979 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54381629-27cc-4984-beb8-a9545f54406f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:44.034492 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54381629-27cc-4984-beb8-a9545f54406f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:44.050511 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:44.121355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-54381629-27cc-4984-beb8-a9545f54406f None None] MFA Rules not processed for user `5d9543657e1e4a6d85632bf57f6ba6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:44.123279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-54381629-27cc-4984-beb8-a9545f54406f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:44.255291 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 692/1359] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Jul 19 12:23:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:44.264589 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15682bb5-850a-4550-ad0b-25c2567891cb None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:44.266113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-15682bb5-850a-4550-ad0b-25c2567891cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:44.425682 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15682bb5-850a-4550-ad0b-25c2567891cb None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:44.505828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:44.550694 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36599dcd-6e9a-4001-828b-0ccaade28be7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:44.551374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36599dcd-6e9a-4001-828b-0ccaade28be7 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:44.551651 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36599dcd-6e9a-4001-828b-0ccaade28be7 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:44.551921 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36599dcd-6e9a-4001-828b-0ccaade28be7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:44.553551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-36599dcd-6e9a-4001-828b-0ccaade28be7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:44.656655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36599dcd-6e9a-4001-828b-0ccaade28be7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:44.658897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36599dcd-6e9a-4001-828b-0ccaade28be7 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:44.678625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 668/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:46.931922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59604-b13e-43cc-9a49-8371d8a5a879 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:46.932460 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59604-b13e-43cc-9a49-8371d8a5a879 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:46.932460 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59604-b13e-43cc-9a49-8371d8a5a879 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:46.933886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 693/1361] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:46.939177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f21491-2dd4-4582-bcf6-6a50c53ddb65 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:46.939602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f21491-2dd4-4582-bcf6-6a50c53ddb65 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:46.939719 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f21491-2dd4-4582-bcf6-6a50c53ddb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:47.007447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-83f21491-2dd4-4582-bcf6-6a50c53ddb65 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:47.008913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-83f21491-2dd4-4582-bcf6-6a50c53ddb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:47.048764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:47.120824 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 669/1362] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:23:47.168342 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a59604-b13e-43cc-9a49-8371d8a5a879 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:47.169871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d7a59604-b13e-43cc-9a49-8371d8a5a879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:47.256761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:47.351717 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a59604-b13e-43cc-9a49-8371d8a5a879 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:47.481178 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6144ddb-f6c7-4112-b382-9c9d24174999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:47.481837 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6144ddb-f6c7-4112-b382-9c9d24174999 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:47.482120 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6144ddb-f6c7-4112-b382-9c9d24174999 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:47.482396 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6144ddb-f6c7-4112-b382-9c9d24174999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:47.484092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e6144ddb-f6c7-4112-b382-9c9d24174999 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:47.507212 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:47.579975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6144ddb-f6c7-4112-b382-9c9d24174999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:47.581811 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6144ddb-f6c7-4112-b382-9c9d24174999 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:47.601225 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 694/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:49.976810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802bea3-1877-463c-9ae0-72a4be0764c9 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:49.977342 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802bea3-1877-463c-9ae0-72a4be0764c9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:49.977432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802bea3-1877-463c-9ae0-72a4be0764c9 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:49.979036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 670/1364] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:49.984489 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fac61b-005d-4406-9df0-ccb9d0e0d7e9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:49.984939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fac61b-005d-4406-9df0-ccb9d0e0d7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:49.985228 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fac61b-005d-4406-9df0-ccb9d0e0d7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:50.071099 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-83fac61b-005d-4406-9df0-ccb9d0e0d7e9 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:50.072983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-83fac61b-005d-4406-9df0-ccb9d0e0d7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:50.182284 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:50.185102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 695/1365] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:50.234298 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d302174-917d-497c-88a8-d77006c51f4a None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:50.235032 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d302174-917d-497c-88a8-d77006c51f4a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:50.235387 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d302174-917d-497c-88a8-d77006c51f4a None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:50.237469 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 671/1366] 10.222.0.25 () {54 vars in 962 bytes} [Tue Jul 19 12:23:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:50.242978 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cd761-36ae-4cfd-a186-59dddbd40cf9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:50.243409 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cd761-36ae-4cfd-a186-59dddbd40cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:50.243791 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cd761-36ae-4cfd-a186-59dddbd40cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:50.325075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-151cd761-36ae-4cfd-a186-59dddbd40cf9 None None] MFA Rules not processed for user `5d9543657e1e4a6d85632bf57f6ba6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:50.326414 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-151cd761-36ae-4cfd-a186-59dddbd40cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:50.459983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 696/1367] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Jul 19 12:23:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:50.467730 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d302174-917d-497c-88a8-d77006c51f4a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:50.469259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8d302174-917d-497c-88a8-d77006c51f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:50.628825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d302174-917d-497c-88a8-d77006c51f4a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:50.651695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:50.761470 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390be2e2-c863-4159-a4f8-819a8aa7f40c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:50.762382 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390be2e2-c863-4159-a4f8-819a8aa7f40c service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:50.762931 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390be2e2-c863-4159-a4f8-819a8aa7f40c service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:50.763309 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390be2e2-c863-4159-a4f8-819a8aa7f40c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:50.765155 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-390be2e2-c863-4159-a4f8-819a8aa7f40c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:50.870038 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390be2e2-c863-4159-a4f8-819a8aa7f40c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:50.872122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390be2e2-c863-4159-a4f8-819a8aa7f40c service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:50.896082 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 672/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:52.057331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb3d92-1865-4be3-8db9-3d96c70c9394 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:52.057895 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb3d92-1865-4be3-8db9-3d96c70c9394 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:52.058126 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb3d92-1865-4be3-8db9-3d96c70c9394 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:52.059831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 697/1369] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:23:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:52.064840 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237036f0-86b6-4940-9ce2-ce66be4db001 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:52.065248 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237036f0-86b6-4940-9ce2-ce66be4db001 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:52.065451 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237036f0-86b6-4940-9ce2-ce66be4db001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:52.099574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:52.143564 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-237036f0-86b6-4940-9ce2-ce66be4db001 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:52.145121 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-237036f0-86b6-4940-9ce2-ce66be4db001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:52.255834 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 673/1370] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:52.598516 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fa75e-31cf-44fc-99b0-b856a518c60f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:52.598516 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fa75e-31cf-44fc-99b0-b856a518c60f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:52.598516 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fa75e-31cf-44fc-99b0-b856a518c60f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:52.602790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 698/1371] 10.222.0.25 () {54 vars in 964 bytes} [Tue Jul 19 12:23:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:52.606489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b35b4-5082-4dbe-ac64-daaa6f911460 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:52.606872 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b35b4-5082-4dbe-ac64-daaa6f911460 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:52.607226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b35b4-5082-4dbe-ac64-daaa6f911460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:52.688400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7f1b35b4-5082-4dbe-ac64-daaa6f911460 None None] MFA Rules not processed for user `726c2035855c444b88ec07a7811ea711`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:52.689762 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7f1b35b4-5082-4dbe-ac64-daaa6f911460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:52.741105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:52.776003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 674/1372] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Jul 19 12:23:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:52.783980 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fa75e-31cf-44fc-99b0-b856a518c60f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:52.785686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5f8fa75e-31cf-44fc-99b0-b856a518c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:52.841108 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:52.901378 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fa75e-31cf-44fc-99b0-b856a518c60f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:52.984669 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610693a-f8d9-4b81-a955-936e8cf9b22c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:52.985329 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610693a-f8d9-4b81-a955-936e8cf9b22c service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:52.985632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610693a-f8d9-4b81-a955-936e8cf9b22c service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:52.985906 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610693a-f8d9-4b81-a955-936e8cf9b22c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:52.987772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5610693a-f8d9-4b81-a955-936e8cf9b22c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:53.069253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24f4da-ee37-4ed1-b92a-57cca0106338 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:53.069700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24f4da-ee37-4ed1-b92a-57cca0106338 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:53.069700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24f4da-ee37-4ed1-b92a-57cca0106338 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:53.071368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 675/1373] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:53.076750 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52516a43-ed9f-4904-b88d-28608f08e71a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:53.077108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52516a43-ed9f-4904-b88d-28608f08e71a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:53.078107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52516a43-ed9f-4904-b88d-28608f08e71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:53.101313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:53.115253 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610693a-f8d9-4b81-a955-936e8cf9b22c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:53.116693 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610693a-f8d9-4b81-a955-936e8cf9b22c service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:53.136087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 699/1374] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:53.155052 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-52516a43-ed9f-4904-b88d-28608f08e71a None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:53.156394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-52516a43-ed9f-4904-b88d-28608f08e71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:53.263211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 676/1375] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:53.308342 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610693a-f8d9-4b81-a955-936e8cf9b22c service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:53.308976 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5610693a-f8d9-4b81-a955-936e8cf9b22c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:53.418935 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610693a-f8d9-4b81-a955-936e8cf9b22c service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:53.524185 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:53.537241 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f46e5c-ada6-458a-bf10-f01c9f5482d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:53.537890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f46e5c-ada6-458a-bf10-f01c9f5482d8 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:53.538166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f46e5c-ada6-458a-bf10-f01c9f5482d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:53.538436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f46e5c-ada6-458a-bf10-f01c9f5482d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:53.540118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a6f46e5c-ada6-458a-bf10-f01c9f5482d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:53.632916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f46e5c-ada6-458a-bf10-f01c9f5482d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:53.634402 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f46e5c-ada6-458a-bf10-f01c9f5482d8 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:53.654210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 700/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:55.732385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce9160-f85f-4f48-bdd6-58fe5f1e1f59 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:55.732883 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce9160-f85f-4f48-bdd6-58fe5f1e1f59 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:55.732962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce9160-f85f-4f48-bdd6-58fe5f1e1f59 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:55.734471 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 677/1377] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:55.739862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119156e-aa0e-4aa2-8718-6eca67c0a5c5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:55.740323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119156e-aa0e-4aa2-8718-6eca67c0a5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:55.740420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119156e-aa0e-4aa2-8718-6eca67c0a5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:55.806108 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6119156e-aa0e-4aa2-8718-6eca67c0a5c5 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:55.807444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6119156e-aa0e-4aa2-8718-6eca67c0a5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:55.868205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:55.909585 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 701/1378] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:55.954671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce9160-f85f-4f48-bdd6-58fe5f1e1f59 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:55.956403 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c1ce9160-f85f-4f48-bdd6-58fe5f1e1f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:56.011858 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:56.125606 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce9160-f85f-4f48-bdd6-58fe5f1e1f59 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:56.254535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4e6e5-2ada-4e29-bbcc-0d3cf6dd3753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:56.255144 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4e6e5-2ada-4e29-bbcc-0d3cf6dd3753 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:56.255422 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4e6e5-2ada-4e29-bbcc-0d3cf6dd3753 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:56.255693 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4e6e5-2ada-4e29-bbcc-0d3cf6dd3753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:56.257332 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c0c4e6e5-2ada-4e29-bbcc-0d3cf6dd3753 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:56.269980 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:56.346879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4e6e5-2ada-4e29-bbcc-0d3cf6dd3753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:56.348453 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4e6e5-2ada-4e29-bbcc-0d3cf6dd3753 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:56.366766 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 678/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:58.491026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feb481-e2dd-4ed6-827c-2fd60163d34e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:58.491561 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feb481-e2dd-4ed6-827c-2fd60163d34e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:58.491687 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feb481-e2dd-4ed6-827c-2fd60163d34e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:58.493118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 702/1380] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:23:58.499501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd0480-2718-4493-ba09-28d3320490da None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:58.499973 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd0480-2718-4493-ba09-28d3320490da None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:58.500259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd0480-2718-4493-ba09-28d3320490da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:58.573286 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-62fd0480-2718-4493-ba09-28d3320490da None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:58.574489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-62fd0480-2718-4493-ba09-28d3320490da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:58.673240 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:58.690324 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 679/1381] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:58.738310 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8feb481-e2dd-4ed6-827c-2fd60163d34e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:58.740057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b8feb481-e2dd-4ed6-827c-2fd60163d34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:58.907577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8feb481-e2dd-4ed6-827c-2fd60163d34e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:58.963816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:59.039432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62405e95-ea22-49b2-995d-19f90fb509f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:59.039432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62405e95-ea22-49b2-995d-19f90fb509f6 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:59.039786 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62405e95-ea22-49b2-995d-19f90fb509f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:59.040196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62405e95-ea22-49b2-995d-19f90fb509f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:59.042628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-62405e95-ea22-49b2-995d-19f90fb509f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:59.146373 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62405e95-ea22-49b2-995d-19f90fb509f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:59.148020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62405e95-ea22-49b2-995d-19f90fb509f6 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:59.169113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 703/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:01.279656 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1e803-a7d0-4336-9e03-7d39e0a72596 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:01.280199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1e803-a7d0-4336-9e03-7d39e0a72596 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:01.280319 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1e803-a7d0-4336-9e03-7d39e0a72596 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:01.282070 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 680/1383] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:01.287463 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79206c0-9a10-4374-b6a0-b0b189c74056 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:01.287908 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79206c0-9a10-4374-b6a0-b0b189c74056 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:01.288007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79206c0-9a10-4374-b6a0-b0b189c74056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:01.355694 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c79206c0-9a10-4374-b6a0-b0b189c74056 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:01.357007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c79206c0-9a10-4374-b6a0-b0b189c74056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:01.359282 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:01.459383 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 704/1384] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:01.506363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1e803-a7d0-4336-9e03-7d39e0a72596 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:01.508176 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-18b1e803-a7d0-4336-9e03-7d39e0a72596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:01.662920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1e803-a7d0-4336-9e03-7d39e0a72596 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:01.730224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:01.783771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fcf41-28be-4835-a02b-f33e8f91ce4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:01.784428 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fcf41-28be-4835-a02b-f33e8f91ce4a service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:01.784713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fcf41-28be-4835-a02b-f33e8f91ce4a service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:01.785021 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fcf41-28be-4835-a02b-f33e8f91ce4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:01.786687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-533fcf41-28be-4835-a02b-f33e8f91ce4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:01.877001 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fcf41-28be-4835-a02b-f33e8f91ce4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:01.878601 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fcf41-28be-4835-a02b-f33e8f91ce4a service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:01.903232 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 681/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:04.158126 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab641fd5-d9ba-43f7-960c-fba78d5b9d90 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:04.158651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab641fd5-d9ba-43f7-960c-fba78d5b9d90 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:04.158893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab641fd5-d9ba-43f7-960c-fba78d5b9d90 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:04.160879 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 705/1386] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:24:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:24:04.166813 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650fae2-021d-466f-9456-c40f704b5de7 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:04.167399 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650fae2-021d-466f-9456-c40f704b5de7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:04.167399 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650fae2-021d-466f-9456-c40f704b5de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:04.240796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4650fae2-021d-466f-9456-c40f704b5de7 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:04.242546 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4650fae2-021d-466f-9456-c40f704b5de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:04.277271 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:04.363218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 682/1387] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:04.413878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab641fd5-d9ba-43f7-960c-fba78d5b9d90 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:04.415379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ab641fd5-d9ba-43f7-960c-fba78d5b9d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:04.554233 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:04.573277 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab641fd5-d9ba-43f7-960c-fba78d5b9d90 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:04.694905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13f3cc-ab74-440a-8935-55ba55537fe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:04.695499 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13f3cc-ab74-440a-8935-55ba55537fe3 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:04.695765 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13f3cc-ab74-440a-8935-55ba55537fe3 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:04.696039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13f3cc-ab74-440a-8935-55ba55537fe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:04.698386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ca13f3cc-ab74-440a-8935-55ba55537fe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:04.798093 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13f3cc-ab74-440a-8935-55ba55537fe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:04.800180 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13f3cc-ab74-440a-8935-55ba55537fe3 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:04.806908 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:04.825376 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 706/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:24:07.036286 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0ed96-da4e-40ff-80ad-8aef4e772b06 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:07.036805 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0ed96-da4e-40ff-80ad-8aef4e772b06 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:07.036950 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0ed96-da4e-40ff-80ad-8aef4e772b06 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:07.039085 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 683/1389] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:24:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:07.045160 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8c8a9-57ea-4716-8f28-548b2060c6a5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:07.045611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8c8a9-57ea-4716-8f28-548b2060c6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:07.045707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8c8a9-57ea-4716-8f28-548b2060c6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:07.112727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-92c8c8a9-57ea-4716-8f28-548b2060c6a5 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:07.113946 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-92c8c8a9-57ea-4716-8f28-548b2060c6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:07.214803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 707/1390] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:07.261237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0ed96-da4e-40ff-80ad-8aef4e772b06 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:07.263425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-94d0ed96-da4e-40ff-80ad-8aef4e772b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:07.414999 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0ed96-da4e-40ff-80ad-8aef4e772b06 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:07.424923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:07.536711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f70689-ac87-4513-bd01-af28853acca9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:07.537364 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f70689-ac87-4513-bd01-af28853acca9 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:07.537646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f70689-ac87-4513-bd01-af28853acca9 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:07.537916 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f70689-ac87-4513-bd01-af28853acca9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:07.539590 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-85f70689-ac87-4513-bd01-af28853acca9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:07.644202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f70689-ac87-4513-bd01-af28853acca9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:07.645805 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f70689-ac87-4513-bd01-af28853acca9 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:07.664584 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 684/1391] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:09.792777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f85f5e-f843-4bf7-960d-afd9d168ceb5 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:09.793374 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f85f5e-f843-4bf7-960d-afd9d168ceb5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:09.793374 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f85f5e-f843-4bf7-960d-afd9d168ceb5 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:09.794700 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 708/1392] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:09.799973 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531f680-f701-41e6-8ffb-2d583c7d2cfa None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:09.800392 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531f680-f701-41e6-8ffb-2d583c7d2cfa None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:09.800548 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531f680-f701-41e6-8ffb-2d583c7d2cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:09.815680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:09.869439 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6531f680-f701-41e6-8ffb-2d583c7d2cfa None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:09.870640 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6531f680-f701-41e6-8ffb-2d583c7d2cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:09.971693 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 685/1393] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:10.017221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f85f5e-f843-4bf7-960d-afd9d168ceb5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:10.019193 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-09f85f5e-f843-4bf7-960d-afd9d168ceb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:10.033727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb9386-1574-4a18-8291-51d90e8bc667 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:10.034017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb9386-1574-4a18-8291-51d90e8bc667 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:10.034304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb9386-1574-4a18-8291-51d90e8bc667 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:10.035862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 686/1394] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:24:10.041525 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98972f-6307-416d-ac72-a0483caa0096 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:10.041994 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98972f-6307-416d-ac72-a0483caa0096 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:10.042401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98972f-6307-416d-ac72-a0483caa0096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:10.102361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:10.109305 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-5f98972f-6307-416d-ac72-a0483caa0096 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:10.110529 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5f98972f-6307-416d-ac72-a0483caa0096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:10.154727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:10.177971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f85f5e-f843-4bf7-960d-afd9d168ceb5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:10.210677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 687/1395] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:24:10.267003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c75eec-419d-47d6-b7ab-07e4c57c655b None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:10.267297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c75eec-419d-47d6-b7ab-07e4c57c655b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:10.267850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c75eec-419d-47d6-b7ab-07e4c57c655b None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:10.269235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 688/1396] 10.222.0.25 () {54 vars in 961 bytes} [Tue Jul 19 12:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:24:10.274014 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec1d70-4697-4666-9ba9-32fd9a88cc1a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:10.274304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec1d70-4697-4666-9ba9-32fd9a88cc1a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:10.274578 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec1d70-4697-4666-9ba9-32fd9a88cc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:10.295430 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888ae0d-673d-462f-93ec-e33729e031e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:10.296078 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888ae0d-673d-462f-93ec-e33729e031e6 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:10.296353 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888ae0d-673d-462f-93ec-e33729e031e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:10.296622 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888ae0d-673d-462f-93ec-e33729e031e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:10.298265 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b888ae0d-673d-462f-93ec-e33729e031e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:10.332753 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:10.350753 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-dfec1d70-4697-4666-9ba9-32fd9a88cc1a None None] MFA Rules not processed for user `1af8b237e2df41668bc5409d8fdd3f67`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:10.351948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-dfec1d70-4697-4666-9ba9-32fd9a88cc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:10.392105 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888ae0d-673d-462f-93ec-e33729e031e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:10.393880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888ae0d-673d-462f-93ec-e33729e031e6 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:10.413641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 709/1397] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:10.436161 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 689/1398] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Jul 19 12:24:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:24:10.443690 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888ae0d-673d-462f-93ec-e33729e031e6 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:10.444982 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b888ae0d-673d-462f-93ec-e33729e031e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:10.529438 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888ae0d-673d-462f-93ec-e33729e031e6 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:10.610626 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f99e97-4d3e-45a9-ac6c-ac947dbd3b26 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1af8b237e2df41668bc5409d8fdd3f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:10.611311 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f99e97-4d3e-45a9-ac6c-ac947dbd3b26 service glance] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:10.611591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f99e97-4d3e-45a9-ac6c-ac947dbd3b26 service glance] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:10.611866 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f99e97-4d3e-45a9-ac6c-ac947dbd3b26 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:10.613581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-87f99e97-4d3e-45a9-ac6c-ac947dbd3b26 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:10.627696 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:10.730532 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f99e97-4d3e-45a9-ac6c-ac947dbd3b26 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:10.731997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f99e97-4d3e-45a9-ac6c-ac947dbd3b26 service glance] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:10.750712 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 710/1399] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:11.454089 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a6ddd-0c56-4d93-b3f4-1084187111e1 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:11.454556 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a6ddd-0c56-4d93-b3f4-1084187111e1 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:11.454654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a6ddd-0c56-4d93-b3f4-1084187111e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:11.501697 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:11.521813 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d57a6ddd-0c56-4d93-b3f4-1084187111e1 None None] MFA Rules not processed for user `18030043de1942779baf3ad94aec4071`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:11.523064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d57a6ddd-0c56-4d93-b3f4-1084187111e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:11.614122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 690/1400] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 19 12:24:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:11.660626 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58d710-b73e-4e9c-890f-9ab77b4e27ba None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:11.661093 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58d710-b73e-4e9c-890f-9ab77b4e27ba None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:11.661209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58d710-b73e-4e9c-890f-9ab77b4e27ba None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:11.662562 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 711/1401] 10.222.0.25 () {54 vars in 943 bytes} [Tue Jul 19 12:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:11.669719 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d669b-8318-438e-8230-67948da185e6 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:11.670010 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d669b-8318-438e-8230-67948da185e6 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:11.670286 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d669b-8318-438e-8230-67948da185e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:11.751460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c08d669b-8318-438e-8230-67948da185e6 None None] MFA Rules not processed for user `35cc2e1079d34745a279588028945c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:11.752649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c08d669b-8318-438e-8230-67948da185e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:11.816008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:11.858240 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 691/1402] 10.222.0.25 () {58 vars in 1040 bytes} [Tue Jul 19 12:24:11 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:11.867627 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58d710-b73e-4e9c-890f-9ab77b4e27ba None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:11.870020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9d58d710-b73e-4e9c-890f-9ab77b4e27ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:11.985244 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:12.011975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58d710-b73e-4e9c-890f-9ab77b4e27ba None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:12.121787 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff96a47-d49f-4bfb-b605-e373469731a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc2e1079d34745a279588028945c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:12.122432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff96a47-d49f-4bfb-b605-e373469731a4 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:12.122708 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff96a47-d49f-4bfb-b605-e373469731a4 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:12.123005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff96a47-d49f-4bfb-b605-e373469731a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:12.124664 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1ff96a47-d49f-4bfb-b605-e373469731a4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:12.211035 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff96a47-d49f-4bfb-b605-e373469731a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:12.213156 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff96a47-d49f-4bfb-b605-e373469731a4 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:12.221288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 712/1403] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 19 12:24:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:24:12.512792 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425a3f4-0f63-4431-a6cb-64ff0b08d4f0 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:12.513304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425a3f4-0f63-4431-a6cb-64ff0b08d4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:12.513304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425a3f4-0f63-4431-a6cb-64ff0b08d4f0 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:12.514662 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 692/1404] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:12.520357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6a09-294b-4eb2-9fa4-6bd1d7c13905 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:12.520644 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6a09-294b-4eb2-9fa4-6bd1d7c13905 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:12.520919 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6a09-294b-4eb2-9fa4-6bd1d7c13905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:12.535878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:12.595174 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d97f6a09-294b-4eb2-9fa4-6bd1d7c13905 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:12.596681 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d97f6a09-294b-4eb2-9fa4-6bd1d7c13905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:12.718583 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 713/1405] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:12.762917 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425a3f4-0f63-4431-a6cb-64ff0b08d4f0 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:12.764480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2425a3f4-0f63-4431-a6cb-64ff0b08d4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:12.933800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425a3f4-0f63-4431-a6cb-64ff0b08d4f0 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:12.980267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:13.069571 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177d1e6-b5ee-4520-9a56-e06304dc78a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:13.070628 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177d1e6-b5ee-4520-9a56-e06304dc78a0 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:13.071003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177d1e6-b5ee-4520-9a56-e06304dc78a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:13.071350 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177d1e6-b5ee-4520-9a56-e06304dc78a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:13.074156 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2177d1e6-b5ee-4520-9a56-e06304dc78a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:13.182156 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177d1e6-b5ee-4520-9a56-e06304dc78a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:13.183915 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177d1e6-b5ee-4520-9a56-e06304dc78a0 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:13.206161 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 693/1406] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:15.391303 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb6bdb-5eee-4dae-8a1c-059fe28acd3b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:15.392010 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb6bdb-5eee-4dae-8a1c-059fe28acd3b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:15.392010 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb6bdb-5eee-4dae-8a1c-059fe28acd3b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:15.393467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 714/1407] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:15.399059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a66bd6-b8fc-406e-ae70-7a4e5fd724de None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:15.399498 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a66bd6-b8fc-406e-ae70-7a4e5fd724de None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:15.399591 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a66bd6-b8fc-406e-ae70-7a4e5fd724de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:15.467812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:15.475942 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c6a66bd6-b8fc-406e-ae70-7a4e5fd724de None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:15.477394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c6a66bd6-b8fc-406e-ae70-7a4e5fd724de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:15.588256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 694/1408] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:15.632954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb6bdb-5eee-4dae-8a1c-059fe28acd3b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:15.635262 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d9fb6bdb-5eee-4dae-8a1c-059fe28acd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:15.737906 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:15.803583 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb6bdb-5eee-4dae-8a1c-059fe28acd3b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:15.937138 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830252bc-b965-4811-abdd-c0aad714438d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:15.937894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830252bc-b965-4811-abdd-c0aad714438d service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:15.938260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830252bc-b965-4811-abdd-c0aad714438d service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:15.938658 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830252bc-b965-4811-abdd-c0aad714438d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:15.940428 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-830252bc-b965-4811-abdd-c0aad714438d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:16.004859 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:16.045048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830252bc-b965-4811-abdd-c0aad714438d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:16.046670 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830252bc-b965-4811-abdd-c0aad714438d service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:16.067433 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 715/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:25.585422 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=44 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:26.064798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=21 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:34.315188 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e82f7-543b-4c2e-be6c-dde1a7028e75 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:34.315759 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e82f7-543b-4c2e-be6c-dde1a7028e75 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:34.315759 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e82f7-543b-4c2e-be6c-dde1a7028e75 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:34.317103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 695/1410] 10.222.0.25 () {54 vars in 918 bytes} [Tue Jul 19 12:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:34.322337 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e5f56-2e33-4374-a81f-a51e21d6c686 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:34.322801 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e5f56-2e33-4374-a81f-a51e21d6c686 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:34.322934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e5f56-2e33-4374-a81f-a51e21d6c686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:34.398119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cc5e5f56-2e33-4374-a81f-a51e21d6c686 None None] MFA Rules not processed for user `11a51c42a4094d9b97eb636c57225dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:34.400364 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cc5e5f56-2e33-4374-a81f-a51e21d6c686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:34.507583 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 716/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Jul 19 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:24:34.522119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31a0f1-101b-42c0-9af1-b511d41d60a9 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:34.522405 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31a0f1-101b-42c0-9af1-b511d41d60a9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:34.522681 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31a0f1-101b-42c0-9af1-b511d41d60a9 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:34.524611 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 696/1412] 10.222.0.25 () {54 vars in 918 bytes} [Tue Jul 19 12:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:34.529221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91120233-067e-47b1-b12e-c4d77559f440 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:34.529508 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91120233-067e-47b1-b12e-c4d77559f440 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:34.529785 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91120233-067e-47b1-b12e-c4d77559f440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:34.600061 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:34.603622 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-91120233-067e-47b1-b12e-c4d77559f440 None None] MFA Rules not processed for user `5d9543657e1e4a6d85632bf57f6ba6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:34.605177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-91120233-067e-47b1-b12e-c4d77559f440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:34.722100 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 717/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Jul 19 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:37.192207 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4146aa4-b7e1-4ecd-900d-0cf84d68e14a None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:37.192790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4146aa4-b7e1-4ecd-900d-0cf84d68e14a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:37.192790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4146aa4-b7e1-4ecd-900d-0cf84d68e14a None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:37.194133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 12:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:37.199640 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1f0c3-2286-4e14-bfd9-baaf5dd344c6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:37.200064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1f0c3-2286-4e14-bfd9-baaf5dd344c6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:37.200187 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1f0c3-2286-4e14-bfd9-baaf5dd344c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:37.264648 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-63f1f0c3-2286-4e14-bfd9-baaf5dd344c6 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:37.265834 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-63f1f0c3-2286-4e14-bfd9-baaf5dd344c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:37.322173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:37.367182 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 12:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:37.411617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4146aa4-b7e1-4ecd-900d-0cf84d68e14a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:37.413216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f4146aa4-b7e1-4ecd-900d-0cf84d68e14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:37.558707 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4146aa4-b7e1-4ecd-900d-0cf84d68e14a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:37.630649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:37.671512 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6329b5-bfa7-4600-938c-b4701484d782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:37.672164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6329b5-bfa7-4600-938c-b4701484d782 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:37.672445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6329b5-bfa7-4600-938c-b4701484d782 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:37.672714 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6329b5-bfa7-4600-938c-b4701484d782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:37.674350 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ed6329b5-bfa7-4600-938c-b4701484d782 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:37.762456 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6329b5-bfa7-4600-938c-b4701484d782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:37.764089 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6329b5-bfa7-4600-938c-b4701484d782 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:37.782574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 698/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:38.703757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33d39-d6b5-4449-bb88-eb9b17a84f4e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:38.704206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33d39-d6b5-4449-bb88-eb9b17a84f4e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:38.704313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33d39-d6b5-4449-bb88-eb9b17a84f4e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:38.705712 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 12:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:38.710683 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f7fa1-cf2c-48cc-9479-5d76d82526c5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:38.711128 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f7fa1-cf2c-48cc-9479-5d76d82526c5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:38.711938 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f7fa1-cf2c-48cc-9479-5d76d82526c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:38.787224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ab6f7fa1-cf2c-48cc-9479-5d76d82526c5 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:38.788427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ab6f7fa1-cf2c-48cc-9479-5d76d82526c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:38.814649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:38.884092 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 12:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:39.036147 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df33d39-d6b5-4449-bb88-eb9b17a84f4e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:39.037622 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5df33d39-d6b5-4449-bb88-eb9b17a84f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:39.183007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df33d39-d6b5-4449-bb88-eb9b17a84f4e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:39.222255 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:39.298449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f0863-7db4-401e-bd33-371770f0daa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:39.299060 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f0863-7db4-401e-bd33-371770f0daa7 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:39.299342 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f0863-7db4-401e-bd33-371770f0daa7 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:39.299615 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f0863-7db4-401e-bd33-371770f0daa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:39.301280 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ec0f0863-7db4-401e-bd33-371770f0daa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:39.389747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f0863-7db4-401e-bd33-371770f0daa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:39.391772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f0863-7db4-401e-bd33-371770f0daa7 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:39.410045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 720/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:40.295904 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30b62e-7149-4933-9068-d320138cfefa None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:40.296445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30b62e-7149-4933-9068-d320138cfefa None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:40.296445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30b62e-7149-4933-9068-d320138cfefa None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:40.297846 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 12:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:40.302930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef07bfb-1176-4c7c-8edf-3bd47bbf6cf0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:40.303369 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef07bfb-1176-4c7c-8edf-3bd47bbf6cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:40.303477 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef07bfb-1176-4c7c-8edf-3bd47bbf6cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:40.362700 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:40.385564 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7ef07bfb-1176-4c7c-8edf-3bd47bbf6cf0 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:40.386809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7ef07bfb-1176-4c7c-8edf-3bd47bbf6cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:40.483547 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 12:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:40.635589 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30b62e-7149-4933-9068-d320138cfefa None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:40.637003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ae30b62e-7149-4933-9068-d320138cfefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:40.783067 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30b62e-7149-4933-9068-d320138cfefa None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:40.795676 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:40.894548 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bb416-9d32-4f1e-87e3-795aaa59d5ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:40.895150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bb416-9d32-4f1e-87e3-795aaa59d5ee service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:40.895438 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bb416-9d32-4f1e-87e3-795aaa59d5ee service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:40.895705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bb416-9d32-4f1e-87e3-795aaa59d5ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:40.897337 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-497bb416-9d32-4f1e-87e3-795aaa59d5ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:40.986191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bb416-9d32-4f1e-87e3-795aaa59d5ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:40.987852 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bb416-9d32-4f1e-87e3-795aaa59d5ee service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:41.005713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 701/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:41.865650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af0495-f221-4775-8a29-84716242004d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:41.866165 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af0495-f221-4775-8a29-84716242004d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:41.866165 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af0495-f221-4775-8a29-84716242004d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:41.867570 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 12:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:41.872669 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f8b9b-f679-4115-a576-cb8982781fed None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:41.873077 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f8b9b-f679-4115-a576-cb8982781fed None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:41.873222 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f8b9b-f679-4115-a576-cb8982781fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:41.892832 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:41.951062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3b2f8b9b-f679-4115-a576-cb8982781fed None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:41.952285 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3b2f8b9b-f679-4115-a576-cb8982781fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:42.045504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 12:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:42.196537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af0495-f221-4775-8a29-84716242004d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:42.198054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-40af0495-f221-4775-8a29-84716242004d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:42.307346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:42.344013 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af0495-f221-4775-8a29-84716242004d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:42.458495 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d7e47-b1bb-4aef-9362-9ad8336f8780 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:42.459093 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d7e47-b1bb-4aef-9362-9ad8336f8780 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:42.459372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d7e47-b1bb-4aef-9362-9ad8336f8780 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:42.459647 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d7e47-b1bb-4aef-9362-9ad8336f8780 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:42.461478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e67d7e47-b1bb-4aef-9362-9ad8336f8780 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:42.536342 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:42.551179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d7e47-b1bb-4aef-9362-9ad8336f8780 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:42.552771 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d7e47-b1bb-4aef-9362-9ad8336f8780 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:42.571387 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 723/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:43.422830 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578338df-4e20-4c91-8512-ff9f4aa1cc48 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:43.423398 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578338df-4e20-4c91-8512-ff9f4aa1cc48 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:43.423398 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578338df-4e20-4c91-8512-ff9f4aa1cc48 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:43.424844 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 12:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:43.429884 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ebde2-a78a-43f2-9b50-28df4a53b9d1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:43.430290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ebde2-a78a-43f2-9b50-28df4a53b9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:43.430529 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ebde2-a78a-43f2-9b50-28df4a53b9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:43.503018 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0f9ebde2-a78a-43f2-9b50-28df4a53b9d1 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:43.504226 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0f9ebde2-a78a-43f2-9b50-28df4a53b9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:43.599914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:43.750984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578338df-4e20-4c91-8512-ff9f4aa1cc48 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:43.752573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-578338df-4e20-4c91-8512-ff9f4aa1cc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:43.836748 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:43.899064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578338df-4e20-4c91-8512-ff9f4aa1cc48 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:44.010518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147a9d5-735d-4086-96e8-eff2f1f4f1a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:44.011116 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147a9d5-735d-4086-96e8-eff2f1f4f1a4 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:44.011396 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147a9d5-735d-4086-96e8-eff2f1f4f1a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:44.011662 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147a9d5-735d-4086-96e8-eff2f1f4f1a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:44.013317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9147a9d5-735d-4086-96e8-eff2f1f4f1a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:44.060926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:44.101336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147a9d5-735d-4086-96e8-eff2f1f4f1a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:44.103634 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147a9d5-735d-4086-96e8-eff2f1f4f1a4 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:44.121715 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 704/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:44.930241 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43531de7-297f-4607-bec7-3979bc9773ee None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:44.930832 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43531de7-297f-4607-bec7-3979bc9773ee None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:44.930832 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43531de7-297f-4607-bec7-3979bc9773ee None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:44.932269 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 12:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:44.937148 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b85d2b-443f-4bf1-a7bf-295603c637a0 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:44.937537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b85d2b-443f-4bf1-a7bf-295603c637a0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:44.937710 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b85d2b-443f-4bf1-a7bf-295603c637a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:45.013263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e9b85d2b-443f-4bf1-a7bf-295603c637a0 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:45.014405 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e9b85d2b-443f-4bf1-a7bf-295603c637a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:45.118698 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:45.270483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43531de7-297f-4607-bec7-3979bc9773ee None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:45.271942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-43531de7-297f-4607-bec7-3979bc9773ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:45.321199 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:45.420833 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43531de7-297f-4607-bec7-3979bc9773ee None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:45.532934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce27c3-c5b0-43fa-b30f-4d270a9a285b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:45.533518 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce27c3-c5b0-43fa-b30f-4d270a9a285b service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:45.533794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce27c3-c5b0-43fa-b30f-4d270a9a285b service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:45.534064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce27c3-c5b0-43fa-b30f-4d270a9a285b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:45.535735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-85ce27c3-c5b0-43fa-b30f-4d270a9a285b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:45.542510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:45.624456 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce27c3-c5b0-43fa-b30f-4d270a9a285b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:45.626064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce27c3-c5b0-43fa-b30f-4d270a9a285b service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:45.644828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 726/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:46.462250 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93631721-d747-4f74-a347-77bbb5532a56 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:46.462834 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93631721-d747-4f74-a347-77bbb5532a56 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:46.462834 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93631721-d747-4f74-a347-77bbb5532a56 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:46.464146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 12:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:46.469259 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d949cc-2878-4d6c-a693-2063d6de957c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:46.469683 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d949cc-2878-4d6c-a693-2063d6de957c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:46.469836 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d949cc-2878-4d6c-a693-2063d6de957c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:46.544402 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-91d949cc-2878-4d6c-a693-2063d6de957c None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:46.545584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-91d949cc-2878-4d6c-a693-2063d6de957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:46.611434 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:46.641511 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 12:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:46.791189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93631721-d747-4f74-a347-77bbb5532a56 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:46.792658 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-93631721-d747-4f74-a347-77bbb5532a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:46.810905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:46.936870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93631721-d747-4f74-a347-77bbb5532a56 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:47.023093 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:47.050531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15620535-5cdf-4b61-8556-5a5fda5ebf1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:47.051152 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15620535-5cdf-4b61-8556-5a5fda5ebf1a service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:47.051433 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15620535-5cdf-4b61-8556-5a5fda5ebf1a service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:47.051705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15620535-5cdf-4b61-8556-5a5fda5ebf1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:47.053364 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-15620535-5cdf-4b61-8556-5a5fda5ebf1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:47.143255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15620535-5cdf-4b61-8556-5a5fda5ebf1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:47.144839 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15620535-5cdf-4b61-8556-5a5fda5ebf1a service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:47.162962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 707/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:47.959588 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e209-1e5b-4ad9-b735-be11eca3b520 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:47.960144 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e209-1e5b-4ad9-b735-be11eca3b520 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:47.960144 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e209-1e5b-4ad9-b735-be11eca3b520 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:47.961547 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 12:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:47.966604 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78f317-ea27-46d7-b609-bd471a1b9bf5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:47.967032 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78f317-ea27-46d7-b609-bd471a1b9bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:47.967179 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78f317-ea27-46d7-b609-bd471a1b9bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:48.043395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6f78f317-ea27-46d7-b609-bd471a1b9bf5 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:48.044845 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6f78f317-ea27-46d7-b609-bd471a1b9bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:48.085575 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:48.140723 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 12:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:24:48.292917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e209-1e5b-4ad9-b735-be11eca3b520 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:48.294367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1077e209-1e5b-4ad9-b735-be11eca3b520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:48.441647 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e209-1e5b-4ad9-b735-be11eca3b520 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:48.497107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:48.557364 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d6368-17e3-4d17-af96-04f18b17fbe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:48.557943 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d6368-17e3-4d17-af96-04f18b17fbe0 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:48.558225 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d6368-17e3-4d17-af96-04f18b17fbe0 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:48.558500 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d6368-17e3-4d17-af96-04f18b17fbe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:48.560189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-996d6368-17e3-4d17-af96-04f18b17fbe0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:48.649574 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d6368-17e3-4d17-af96-04f18b17fbe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:48.651206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d6368-17e3-4d17-af96-04f18b17fbe0 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:48.669269 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 729/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:49.474761 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26754192-b996-4f6d-9253-90b86980f185 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:49.475327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26754192-b996-4f6d-9253-90b86980f185 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:49.475447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26754192-b996-4f6d-9253-90b86980f185 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:49.476954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 12:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:24:49.482394 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badadb4c-ac7a-4a5f-a47c-8e5641168adf None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:49.482845 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badadb4c-ac7a-4a5f-a47c-8e5641168adf None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:49.483001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badadb4c-ac7a-4a5f-a47c-8e5641168adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:49.559135 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-badadb4c-ac7a-4a5f-a47c-8e5641168adf None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:49.560391 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-badadb4c-ac7a-4a5f-a47c-8e5641168adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:49.562474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:49.658980 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 12:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:49.809377 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26754192-b996-4f6d-9253-90b86980f185 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:49.810851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-26754192-b996-4f6d-9253-90b86980f185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:49.958549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26754192-b996-4f6d-9253-90b86980f185 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:49.985407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:50.074012 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142a3b1-b915-4da8-9f4b-a94105c3ed0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:50.074584 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142a3b1-b915-4da8-9f4b-a94105c3ed0e service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:50.074908 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142a3b1-b915-4da8-9f4b-a94105c3ed0e service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:50.075184 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142a3b1-b915-4da8-9f4b-a94105c3ed0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:50.076820 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c142a3b1-b915-4da8-9f4b-a94105c3ed0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:50.165640 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142a3b1-b915-4da8-9f4b-a94105c3ed0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:50.167283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142a3b1-b915-4da8-9f4b-a94105c3ed0e service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:50.185636 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 710/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:52.134198 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f2a2b-e2a5-4c2b-8122-755388bff731 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:52.134728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f2a2b-e2a5-4c2b-8122-755388bff731 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:52.134728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f2a2b-e2a5-4c2b-8122-755388bff731 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:52.136126 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 12:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:52.141716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44b479-a322-4ae6-bdda-8025089823ef None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:52.142174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44b479-a322-4ae6-bdda-8025089823ef None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:52.142275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44b479-a322-4ae6-bdda-8025089823ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:52.188624 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:52.215811 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-1a44b479-a322-4ae6-bdda-8025089823ef None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:52.217012 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1a44b479-a322-4ae6-bdda-8025089823ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:52.336013 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 12:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:52.380738 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f2a2b-e2a5-4c2b-8122-755388bff731 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:52.382267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6d6f2a2b-e2a5-4c2b-8122-755388bff731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:52.506760 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f2a2b-e2a5-4c2b-8122-755388bff731 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:52.542195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:52.591088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ee178-9059-4820-8b6c-52d8595cf628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:52.591775 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ee178-9059-4820-8b6c-52d8595cf628 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:52.592059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ee178-9059-4820-8b6c-52d8595cf628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:52.592327 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ee178-9059-4820-8b6c-52d8595cf628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:52.594038 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-435ee178-9059-4820-8b6c-52d8595cf628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:52.730050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ee178-9059-4820-8b6c-52d8595cf628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:52.732358 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ee178-9059-4820-8b6c-52d8595cf628 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:52.758845 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 732/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:55.041306 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2fa9b-ed66-4c63-9a1d-8a8f53f443a1 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:55.041818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2fa9b-ed66-4c63-9a1d-8a8f53f443a1 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:55.041818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2fa9b-ed66-4c63-9a1d-8a8f53f443a1 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:55.043190 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 12:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:55.048439 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda162b-fe38-44be-ae22-0302ead58963 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:55.048840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda162b-fe38-44be-ae22-0302ead58963 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:55.048986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda162b-fe38-44be-ae22-0302ead58963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:55.113184 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-abda162b-fe38-44be-ae22-0302ead58963 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:55.114375 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-abda162b-fe38-44be-ae22-0302ead58963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:55.126900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:55.210686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 12:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:55.250422 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2fa9b-ed66-4c63-9a1d-8a8f53f443a1 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:55.251969 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-46b2fa9b-ed66-4c63-9a1d-8a8f53f443a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:55.353665 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2fa9b-ed66-4c63-9a1d-8a8f53f443a1 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:55.366612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:55.429286 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae7c15-b9eb-47e9-947d-9c3c83c3c0c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:55.429963 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae7c15-b9eb-47e9-947d-9c3c83c3c0c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:55.430242 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae7c15-b9eb-47e9-947d-9c3c83c3c0c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:55.430511 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae7c15-b9eb-47e9-947d-9c3c83c3c0c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:55.432175 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-59ae7c15-b9eb-47e9-947d-9c3c83c3c0c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:55.538516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae7c15-b9eb-47e9-947d-9c3c83c3c0c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:55.540649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae7c15-b9eb-47e9-947d-9c3c83c3c0c6 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:55.558481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 713/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:24:57.909279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae8086-4823-48aa-aca8-56f81786728e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:57.909794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae8086-4823-48aa-aca8-56f81786728e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:57.909912 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae8086-4823-48aa-aca8-56f81786728e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:57.911324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 12:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:24:57.917292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ffa8d-22a3-48b9-a75f-16cd0676bd95 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:57.917701 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ffa8d-22a3-48b9-a75f-16cd0676bd95 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:57.917850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ffa8d-22a3-48b9-a75f-16cd0676bd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:57.964176 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:57.983178 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ef4ffa8d-22a3-48b9-a75f-16cd0676bd95 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:24:57.984392 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ef4ffa8d-22a3-48b9-a75f-16cd0676bd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:58.081501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 12:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:24:58.120423 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae8086-4823-48aa-aca8-56f81786728e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:58.121952 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dcae8086-4823-48aa-aca8-56f81786728e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:58.225382 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae8086-4823-48aa-aca8-56f81786728e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:58.264559 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:58.298946 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214afcc-f793-4212-962a-a0d7bcc52a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:58.299592 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214afcc-f793-4212-962a-a0d7bcc52a1c service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:58.299871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214afcc-f793-4212-962a-a0d7bcc52a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:58.300139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214afcc-f793-4212-962a-a0d7bcc52a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:58.301775 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9214afcc-f793-4212-962a-a0d7bcc52a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:58.421659 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214afcc-f793-4212-962a-a0d7bcc52a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:58.423134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214afcc-f793-4212-962a-a0d7bcc52a1c service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:58.441685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 735/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:25:00.617450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae38aa-d5a6-4b88-be97-9b76029d1f25 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:00.618029 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae38aa-d5a6-4b88-be97-9b76029d1f25 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:00.618029 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae38aa-d5a6-4b88-be97-9b76029d1f25 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:00.619425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 12:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:25:00.624731 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1dc22-fe09-47ea-80bb-88381a505bca None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:00.625136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1dc22-fe09-47ea-80bb-88381a505bca None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:00.625279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1dc22-fe09-47ea-80bb-88381a505bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:00.692749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-30c1dc22-fe09-47ea-80bb-88381a505bca None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:25:00.693959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-30c1dc22-fe09-47ea-80bb-88381a505bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:00.717581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:00.798431 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 12:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:25:00.837648 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae38aa-d5a6-4b88-be97-9b76029d1f25 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:25:00.839323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-07ae38aa-d5a6-4b88-be97-9b76029d1f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:00.945135 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae38aa-d5a6-4b88-be97-9b76029d1f25 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:25:00.965461 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:01.019758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c233a16-a57f-4245-941f-8aaa79b51c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:25:01.020402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c233a16-a57f-4245-941f-8aaa79b51c14 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:01.020680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c233a16-a57f-4245-941f-8aaa79b51c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:01.020952 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c233a16-a57f-4245-941f-8aaa79b51c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:01.022585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1c233a16-a57f-4245-941f-8aaa79b51c14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:01.133545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c233a16-a57f-4245-941f-8aaa79b51c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:25:01.134999 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c233a16-a57f-4245-941f-8aaa79b51c14 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:25:01.153862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 716/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:25:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:25:03.322570 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2a272-33f3-4ed7-a51b-6f77139da397 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:03.323137 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2a272-33f3-4ed7-a51b-6f77139da397 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:03.323137 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2a272-33f3-4ed7-a51b-6f77139da397 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:03.324580 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 12:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:25:03.330007 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9976fd-2fdc-4529-80ce-5685b603e9dc None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:03.330411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9976fd-2fdc-4529-80ce-5685b603e9dc None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:03.330529 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9976fd-2fdc-4529-80ce-5685b603e9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:03.392856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:03.395712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9a9976fd-2fdc-4529-80ce-5685b603e9dc None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:25:03.397624 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9a9976fd-2fdc-4529-80ce-5685b603e9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:03.495550 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 12:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:25:03.534855 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2a272-33f3-4ed7-a51b-6f77139da397 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:25:03.536445 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3bb2a272-33f3-4ed7-a51b-6f77139da397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:03.639915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2a272-33f3-4ed7-a51b-6f77139da397 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:25:03.689296 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:03.715743 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4906b9-9563-440a-b08d-ef75bc7d3632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:25:03.716389 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4906b9-9563-440a-b08d-ef75bc7d3632 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:03.716667 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4906b9-9563-440a-b08d-ef75bc7d3632 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:03.716939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4906b9-9563-440a-b08d-ef75bc7d3632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:03.718576 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fc4906b9-9563-440a-b08d-ef75bc7d3632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:03.827125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4906b9-9563-440a-b08d-ef75bc7d3632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:25:03.828559 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4906b9-9563-440a-b08d-ef75bc7d3632 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:25:03.846289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 738/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:25:05.945722 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4e792-caeb-4c23-b8e5-ec47ce1e3729 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:05.946289 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4e792-caeb-4c23-b8e5-ec47ce1e3729 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:05.946289 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4e792-caeb-4c23-b8e5-ec47ce1e3729 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:05.947719 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 12:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:25:05.953165 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31735c4-3be8-44bf-b830-608f94c89d7c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:05.953589 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31735c4-3be8-44bf-b830-608f94c89d7c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:05.953724 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31735c4-3be8-44bf-b830-608f94c89d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:06.019067 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e31735c4-3be8-44bf-b830-608f94c89d7c None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:25:06.020265 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e31735c4-3be8-44bf-b830-608f94c89d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:06.050872 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:06.118454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 12:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:25:06.156947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4e792-caeb-4c23-b8e5-ec47ce1e3729 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:25:06.158493 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f4a4e792-caeb-4c23-b8e5-ec47ce1e3729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:06.261393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4e792-caeb-4c23-b8e5-ec47ce1e3729 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:25:06.291506 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:06.338384 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f1c55-532b-4153-ba1d-6f812bf19f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:25:06.339160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f1c55-532b-4153-ba1d-6f812bf19f21 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:06.339459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f1c55-532b-4153-ba1d-6f812bf19f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:06.339728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f1c55-532b-4153-ba1d-6f812bf19f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:06.341366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-975f1c55-532b-4153-ba1d-6f812bf19f21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:06.450804 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f1c55-532b-4153-ba1d-6f812bf19f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:25:06.452251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f1c55-532b-4153-ba1d-6f812bf19f21 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:25:06.470375 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 719/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:25:08.532799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e04748-baa5-47e6-bd29-6c4ee6a1d907 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:08.533339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e04748-baa5-47e6-bd29-6c4ee6a1d907 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:08.533339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e04748-baa5-47e6-bd29-6c4ee6a1d907 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:08.534708 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 12:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:25:08.540897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f00f2a-4191-4aa8-a984-69ad88572593 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:08.541283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f00f2a-4191-4aa8-a984-69ad88572593 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:08.541452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f00f2a-4191-4aa8-a984-69ad88572593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:08.607635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d6f00f2a-4191-4aa8-a984-69ad88572593 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:25:08.608848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d6f00f2a-4191-4aa8-a984-69ad88572593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:08.617907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:08.708206 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 12:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:25:08.746363 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e04748-baa5-47e6-bd29-6c4ee6a1d907 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:25:08.747996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d2e04748-baa5-47e6-bd29-6c4ee6a1d907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:08.850251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e04748-baa5-47e6-bd29-6c4ee6a1d907 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:25:08.907317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:08.926483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d314a7-6c78-470b-85b2-9fecc8d4b4bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:25:08.927146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d314a7-6c78-470b-85b2-9fecc8d4b4bc service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:08.927427 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d314a7-6c78-470b-85b2-9fecc8d4b4bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:08.927700 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d314a7-6c78-470b-85b2-9fecc8d4b4bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:08.929749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a6d314a7-6c78-470b-85b2-9fecc8d4b4bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:09.039718 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d314a7-6c78-470b-85b2-9fecc8d4b4bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:25:09.041141 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d314a7-6c78-470b-85b2-9fecc8d4b4bc service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:25:09.059150 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 741/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:25:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:25:11.118056 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1649e-90d1-47e7-8d31-e18ba61845bd None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:11.118557 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1649e-90d1-47e7-8d31-e18ba61845bd None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:11.118557 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1649e-90d1-47e7-8d31-e18ba61845bd None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:11.119925 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 12:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:25:11.125252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290b7ac-f862-435a-9b2c-ac9e1348c4d2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:11.125679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290b7ac-f862-435a-9b2c-ac9e1348c4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:11.125786 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290b7ac-f862-435a-9b2c-ac9e1348c4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:11.190722 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e290b7ac-f862-435a-9b2c-ac9e1348c4d2 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:25:11.191950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e290b7ac-f862-435a-9b2c-ac9e1348c4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:11.229699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:11.288078 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 12:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:25:11.326074 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1649e-90d1-47e7-8d31-e18ba61845bd None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:25:11.327634 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-97a1649e-90d1-47e7-8d31-e18ba61845bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:11.428979 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1649e-90d1-47e7-8d31-e18ba61845bd None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:25:11.467219 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:11.508213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de47cd5-4a79-43b0-a175-42d6cfae0d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:25:11.508868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de47cd5-4a79-43b0-a175-42d6cfae0d1e service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:11.509149 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de47cd5-4a79-43b0-a175-42d6cfae0d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:11.509418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de47cd5-4a79-43b0-a175-42d6cfae0d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:11.511075 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7de47cd5-4a79-43b0-a175-42d6cfae0d1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:11.632675 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de47cd5-4a79-43b0-a175-42d6cfae0d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:25:11.634095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de47cd5-4a79-43b0-a175-42d6cfae0d1e service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:25:11.652619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 722/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:25:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:25:13.728334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfad9bd-5340-4783-96fb-8344f0b34418 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:13.728815 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfad9bd-5340-4783-96fb-8344f0b34418 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:13.728911 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfad9bd-5340-4783-96fb-8344f0b34418 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:13.730302 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 12:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:25:13.735663 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785a4f5-8cb2-438a-a4ed-e807088ac129 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:13.736093 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785a4f5-8cb2-438a-a4ed-e807088ac129 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:13.736213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785a4f5-8cb2-438a-a4ed-e807088ac129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:13.800621 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2785a4f5-8cb2-438a-a4ed-e807088ac129 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:25:13.801818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2785a4f5-8cb2-438a-a4ed-e807088ac129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:13.820483 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:13.898905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 12:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:25:13.935954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfad9bd-5340-4783-96fb-8344f0b34418 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:25:13.937471 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1cfad9bd-5340-4783-96fb-8344f0b34418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:14.040674 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfad9bd-5340-4783-96fb-8344f0b34418 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:25:14.106221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:14.113266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44543187-2b2f-46ec-b240-cf76635da6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:25:14.113901 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44543187-2b2f-46ec-b240-cf76635da6bf service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:14.114176 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44543187-2b2f-46ec-b240-cf76635da6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:14.114447 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44543187-2b2f-46ec-b240-cf76635da6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:14.116304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-44543187-2b2f-46ec-b240-cf76635da6bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:14.224828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44543187-2b2f-46ec-b240-cf76635da6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:25:14.226444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44543187-2b2f-46ec-b240-cf76635da6bf service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:25:14.245055 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 744/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:25:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:25:16.343298 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11b9d9-4204-4856-b84b-cb5d09466761 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:16.343898 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11b9d9-4204-4856-b84b-cb5d09466761 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:16.343898 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11b9d9-4204-4856-b84b-cb5d09466761 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:16.345255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 12:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:25:16.350664 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7bd7b-e99d-4f34-b07a-2fb3e398f754 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:16.351097 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7bd7b-e99d-4f34-b07a-2fb3e398f754 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:16.351325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7bd7b-e99d-4f34-b07a-2fb3e398f754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:16.418205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d0a7bd7b-e99d-4f34-b07a-2fb3e398f754 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:25:16.419438 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d0a7bd7b-e99d-4f34-b07a-2fb3e398f754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:16.468590 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:16.519715 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 12:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:25:16.556828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11b9d9-4204-4856-b84b-cb5d09466761 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:25:16.558345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ce11b9d9-4204-4856-b84b-cb5d09466761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:16.666957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11b9d9-4204-4856-b84b-cb5d09466761 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:25:16.716091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:16.743236 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d412fc-43c0-4db2-b74f-765c3cb9481b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:25:16.743885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d412fc-43c0-4db2-b74f-765c3cb9481b service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:16.744174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d412fc-43c0-4db2-b74f-765c3cb9481b service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:16.744449 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d412fc-43c0-4db2-b74f-765c3cb9481b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:16.746087 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d1d412fc-43c0-4db2-b74f-765c3cb9481b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:16.857826 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d412fc-43c0-4db2-b74f-765c3cb9481b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:25:16.859202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d412fc-43c0-4db2-b74f-765c3cb9481b service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:25:16.877930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 725/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:25:26.517696 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=22 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:26.875708 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=66 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:36.559480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e7b7a-86ef-4298-82ff-6e3151ddb135 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:36.560050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e7b7a-86ef-4298-82ff-6e3151ddb135 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:36.560050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e7b7a-86ef-4298-82ff-6e3151ddb135 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:36.561386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 746/1471] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:25:36.566485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45a6e6-e498-474b-85fa-101c8311124e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:36.566952 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45a6e6-e498-474b-85fa-101c8311124e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:36.567095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45a6e6-e498-474b-85fa-101c8311124e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:36.639441 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-5b45a6e6-e498-474b-85fa-101c8311124e None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:25:36.640652 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5b45a6e6-e498-474b-85fa-101c8311124e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:36.736685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 726/1472] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:25:36.820867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6ea55-063f-408e-a541-23cb99ebb1c4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:36.821177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6ea55-063f-408e-a541-23cb99ebb1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:36.821449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6ea55-063f-408e-a541-23cb99ebb1c4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:36.822828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 747/1473] 10.222.0.25 () {54 vars in 961 bytes} [Tue Jul 19 12:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:25:36.827688 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cfab3-81a2-4e1e-b669-29e146fb68d9 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:36.827982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cfab3-81a2-4e1e-b669-29e146fb68d9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:36.828261 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cfab3-81a2-4e1e-b669-29e146fb68d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:36.902293 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b01cfab3-81a2-4e1e-b669-29e146fb68d9 None None] MFA Rules not processed for user `1af8b237e2df41668bc5409d8fdd3f67`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:25:36.903539 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b01cfab3-81a2-4e1e-b669-29e146fb68d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:36.923659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:36.979384 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 727/1474] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Jul 19 12:25:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:25:36.986658 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6ea55-063f-408e-a541-23cb99ebb1c4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:25:36.988185 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e3b6ea55-063f-408e-a541-23cb99ebb1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:37.092115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6ea55-063f-408e-a541-23cb99ebb1c4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:25:37.166300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bbfd5-3174-480c-85b9-f43f0b7a9037 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1af8b237e2df41668bc5409d8fdd3f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:25:37.166970 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bbfd5-3174-480c-85b9-f43f0b7a9037 service glance] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:37.167251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bbfd5-3174-480c-85b9-f43f0b7a9037 service glance] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:37.167532 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bbfd5-3174-480c-85b9-f43f0b7a9037 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:37.169183 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-aa3bbfd5-3174-480c-85b9-f43f0b7a9037 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:37.221840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:37.277873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bbfd5-3174-480c-85b9-f43f0b7a9037 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:25:37.279333 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bbfd5-3174-480c-85b9-f43f0b7a9037 service glance] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:25:37.298146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 748/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:25:39.434111 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42ee65-32a0-4822-843d-de4315ed899c None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:39.434763 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42ee65-32a0-4822-843d-de4315ed899c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:39.434763 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42ee65-32a0-4822-843d-de4315ed899c None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:39.436087 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 728/1476] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:25:39.441377 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b54dc-d24e-434d-acc3-5cec2a029aa0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:39.441785 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b54dc-d24e-434d-acc3-5cec2a029aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:39.441933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b54dc-d24e-434d-acc3-5cec2a029aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:39.506358 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2b3b54dc-d24e-434d-acc3-5cec2a029aa0 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:25:39.507595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2b3b54dc-d24e-434d-acc3-5cec2a029aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:39.605498 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 749/1477] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:25:39.628872 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42ee65-32a0-4822-843d-de4315ed899c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:25:39.630451 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0c42ee65-32a0-4822-843d-de4315ed899c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:39.756496 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42ee65-32a0-4822-843d-de4315ed899c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:25:39.805191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:39.851517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf162ef9-94c9-4fce-b0e5-569e11b2c30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:25:39.852211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf162ef9-94c9-4fce-b0e5-569e11b2c30f admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:39.852490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf162ef9-94c9-4fce-b0e5-569e11b2c30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:39.852758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf162ef9-94c9-4fce-b0e5-569e11b2c30f admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:39.853488 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf162ef9-94c9-4fce-b0e5-569e11b2c30f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:25:39.855313 dv-cinder-820994-4-smb devstack@keystone.service[80230]: WARNING py.warnings [None req-cf162ef9-94c9-4fce-b0e5-569e11b2c30f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:25:39.855313 dv-cinder-820994-4-smb devstack@keystone.service[80230]: warnings.warn(msg) Jul 19 12:25:39.855313 dv-cinder-820994-4-smb devstack@keystone.service[80230]: Jul 19 12:25:39.856475 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf162ef9-94c9-4fce-b0e5-569e11b2c30f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:25:39.876150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 729/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Jul 19 12:25:39 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:25:41.922087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30e159-6eac-49cc-a732-4e5d1b20f9d3 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:41.922631 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30e159-6eac-49cc-a732-4e5d1b20f9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:41.922631 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30e159-6eac-49cc-a732-4e5d1b20f9d3 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:41.924039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 750/1479] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:25:41.930010 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6549e1-6317-4a8c-bb20-09a3b5c5ae75 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:41.930481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6549e1-6317-4a8c-bb20-09a3b5c5ae75 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:41.930586 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6549e1-6317-4a8c-bb20-09a3b5c5ae75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:41.995222 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-fa6549e1-6317-4a8c-bb20-09a3b5c5ae75 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:25:41.996442 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fa6549e1-6317-4a8c-bb20-09a3b5c5ae75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:42.092157 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 730/1480] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:25:42.136081 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30e159-6eac-49cc-a732-4e5d1b20f9d3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:25:42.137576 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bd30e159-6eac-49cc-a732-4e5d1b20f9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:42.147594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:42.284706 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30e159-6eac-49cc-a732-4e5d1b20f9d3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:25:42.375751 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:42.408476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d69f8-17ce-4fef-80fb-d22c3e0d72cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:25:42.409117 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d69f8-17ce-4fef-80fb-d22c3e0d72cd service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:42.409389 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d69f8-17ce-4fef-80fb-d22c3e0d72cd service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:42.409655 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d69f8-17ce-4fef-80fb-d22c3e0d72cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:42.411295 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-643d69f8-17ce-4fef-80fb-d22c3e0d72cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:42.501670 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d69f8-17ce-4fef-80fb-d22c3e0d72cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:25:42.503301 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d69f8-17ce-4fef-80fb-d22c3e0d72cd service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:25:42.521318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 751/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:25:44.716098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c242683-278a-4386-a3d6-0c1189a780e8 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:44.716569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c242683-278a-4386-a3d6-0c1189a780e8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:44.716685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c242683-278a-4386-a3d6-0c1189a780e8 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:44.718375 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 731/1482] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:25:44.723488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3f96e-ca14-4409-8629-5a5d6a0b6150 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:44.724459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3f96e-ca14-4409-8629-5a5d6a0b6150 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:44.724660 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3f96e-ca14-4409-8629-5a5d6a0b6150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:44.788748 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-65f3f96e-ca14-4409-8629-5a5d6a0b6150 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:25:44.789948 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-65f3f96e-ca14-4409-8629-5a5d6a0b6150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:44.835498 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:44.885989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 752/1483] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:25:44.923503 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c242683-278a-4386-a3d6-0c1189a780e8 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:25:44.925100 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4c242683-278a-4386-a3d6-0c1189a780e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:44.948444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:45.027511 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c242683-278a-4386-a3d6-0c1189a780e8 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:25:45.101128 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c752303-1c5d-48cc-b797-b40fbfaf5601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:25:45.101779 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c752303-1c5d-48cc-b797-b40fbfaf5601 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:45.102063 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c752303-1c5d-48cc-b797-b40fbfaf5601 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:45.102336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c752303-1c5d-48cc-b797-b40fbfaf5601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:45.104022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4c752303-1c5d-48cc-b797-b40fbfaf5601 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:45.177934 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:45.213304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c752303-1c5d-48cc-b797-b40fbfaf5601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:25:45.214758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c752303-1c5d-48cc-b797-b40fbfaf5601 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:25:45.235145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 732/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:25:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:25:47.322916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2cb7d-8369-4f56-8379-caa8aa2742b5 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:47.323528 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2cb7d-8369-4f56-8379-caa8aa2742b5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:47.323528 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2cb7d-8369-4f56-8379-caa8aa2742b5 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:47.324869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 753/1485] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:25:47.330263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491bf37-93cd-4e0d-a22a-eb01df2a0208 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:47.330697 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491bf37-93cd-4e0d-a22a-eb01df2a0208 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:47.330917 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491bf37-93cd-4e0d-a22a-eb01df2a0208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:47.514433 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6491bf37-93cd-4e0d-a22a-eb01df2a0208 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:25:47.515680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6491bf37-93cd-4e0d-a22a-eb01df2a0208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:47.612160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 733/1486] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:25:47.652298 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2cb7d-8369-4f56-8379-caa8aa2742b5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:25:47.653858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-04d2cb7d-8369-4f56-8379-caa8aa2742b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:47.759342 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2cb7d-8369-4f56-8379-caa8aa2742b5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:25:47.831762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:47.834614 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731825f3-7dd4-44da-a04f-c04dae203c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:25:47.835475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731825f3-7dd4-44da-a04f-c04dae203c30 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:47.835954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731825f3-7dd4-44da-a04f-c04dae203c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:47.836411 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731825f3-7dd4-44da-a04f-c04dae203c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:47.838085 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-731825f3-7dd4-44da-a04f-c04dae203c30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:47.946889 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731825f3-7dd4-44da-a04f-c04dae203c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:25:47.948303 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731825f3-7dd4-44da-a04f-c04dae203c30 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:25:47.965814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 754/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:25:50.084703 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a0475-9d28-4a4c-842b-aa19cee53f9b None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:50.085269 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a0475-9d28-4a4c-842b-aa19cee53f9b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:50.085269 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a0475-9d28-4a4c-842b-aa19cee53f9b None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:50.086610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 734/1488] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:25:50.092032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77b36e-e156-4576-9492-28a163218d28 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:50.092479 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77b36e-e156-4576-9492-28a163218d28 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:50.092619 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77b36e-e156-4576-9492-28a163218d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:50.157600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3d77b36e-e156-4576-9492-28a163218d28 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:25:50.158847 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3d77b36e-e156-4576-9492-28a163218d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:50.211964 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:50.257396 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 755/1489] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:25:50.299786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a0475-9d28-4a4c-842b-aa19cee53f9b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:25:50.301325 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bb3a0475-9d28-4a4c-842b-aa19cee53f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:50.337312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:50.406189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a0475-9d28-4a4c-842b-aa19cee53f9b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:25:50.478955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551031cf-a4c7-4f5d-a0dc-ecaebfb04c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:25:50.479598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551031cf-a4c7-4f5d-a0dc-ecaebfb04c7b service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:50.479873 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551031cf-a4c7-4f5d-a0dc-ecaebfb04c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:50.480140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551031cf-a4c7-4f5d-a0dc-ecaebfb04c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:50.481754 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-551031cf-a4c7-4f5d-a0dc-ecaebfb04c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:50.560393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:50.592819 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551031cf-a4c7-4f5d-a0dc-ecaebfb04c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:25:50.594164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551031cf-a4c7-4f5d-a0dc-ecaebfb04c7b service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:25:50.612706 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 735/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:25:52.842337 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f44780-0770-42f7-a1c8-c311ce7ebfd5 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:52.842919 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f44780-0770-42f7-a1c8-c311ce7ebfd5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:52.842919 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f44780-0770-42f7-a1c8-c311ce7ebfd5 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:52.844325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 756/1491] 10.222.0.25 () {54 vars in 926 bytes} [Tue Jul 19 12:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:25:52.849637 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f07e50-2d63-4484-a7e5-ec2ad64aa917 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:52.850060 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f07e50-2d63-4484-a7e5-ec2ad64aa917 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:52.850187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f07e50-2d63-4484-a7e5-ec2ad64aa917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:52.914345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c9f07e50-2d63-4484-a7e5-ec2ad64aa917 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:25:52.915570 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c9f07e50-2d63-4484-a7e5-ec2ad64aa917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:53.013322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 736/1492] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Jul 19 12:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:25:53.053040 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f44780-0770-42f7-a1c8-c311ce7ebfd5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:25:53.054622 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-73f44780-0770-42f7-a1c8-c311ce7ebfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:53.169669 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f44780-0770-42f7-a1c8-c311ce7ebfd5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:25:53.248730 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6561db-0055-473b-9c7a-452a2b830fb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:25:53.249458 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6561db-0055-473b-9c7a-452a2b830fb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:53.249955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6561db-0055-473b-9c7a-452a2b830fb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:53.250433 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6561db-0055-473b-9c7a-452a2b830fb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:53.252285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6f6561db-0055-473b-9c7a-452a2b830fb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:53.262463 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:53.374197 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6561db-0055-473b-9c7a-452a2b830fb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:25:53.376092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6561db-0055-473b-9c7a-452a2b830fb1 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:25:53.399228 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 757/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:26:03.011465 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=82 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:26:03.396650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=50 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:27:21.668133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fad29-a94c-4abd-ab78-1f62b0b7336d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:21.668726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fad29-a94c-4abd-ab78-1f62b0b7336d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:21.668726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fad29-a94c-4abd-ab78-1f62b0b7336d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:21.743472 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e51fad29-a94c-4abd-ab78-1f62b0b7336d None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:27:21.744657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e51fad29-a94c-4abd-ab78-1f62b0b7336d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:21.838629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 737/1494] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:27:21.847416 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916802e-e99f-4384-82ff-d1ebd86c4b3e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:21.847890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916802e-e99f-4384-82ff-d1ebd86c4b3e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:21.847997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916802e-e99f-4384-82ff-d1ebd86c4b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:21.926145 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8916802e-e99f-4384-82ff-d1ebd86c4b3e None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:27:21.927333 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8916802e-e99f-4384-82ff-d1ebd86c4b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:22.023905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 758/1495] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:27:22.028522 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fad29-a94c-4abd-ab78-1f62b0b7336d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:27:22.029723 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e51fad29-a94c-4abd-ab78-1f62b0b7336d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:22.041741 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fad29-a94c-4abd-ab78-1f62b0b7336d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:27:22.100907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:27:22.134557 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb53d14-bcda-4775-a572-30dbc6b1cf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:27:22.135258 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb53d14-bcda-4775-a572-30dbc6b1cf47 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:22.135540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb53d14-bcda-4775-a572-30dbc6b1cf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:22.135813 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb53d14-bcda-4775-a572-30dbc6b1cf47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:22.136540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb53d14-bcda-4775-a572-30dbc6b1cf47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:27:22.136841 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb53d14-bcda-4775-a572-30dbc6b1cf47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:27:22.137855 dv-cinder-820994-4-smb devstack@keystone.service[80230]: WARNING py.warnings [None req-0bb53d14-bcda-4775-a572-30dbc6b1cf47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:27:22.137855 dv-cinder-820994-4-smb devstack@keystone.service[80230]: warnings.warn(msg) Jul 19 12:27:22.137855 dv-cinder-820994-4-smb devstack@keystone.service[80230]: Jul 19 12:27:22.138799 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb53d14-bcda-4775-a572-30dbc6b1cf47 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:27:22.151068 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 738/1496] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:27:22.159524 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916802e-e99f-4384-82ff-d1ebd86c4b3e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:27:22.168698 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916802e-e99f-4384-82ff-d1ebd86c4b3e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:27:22.229476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:27:22.264163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd2035-57ae-475c-8545-684a7b429df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:27:22.264820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd2035-57ae-475c-8545-684a7b429df1 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:22.265098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd2035-57ae-475c-8545-684a7b429df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:22.265368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd2035-57ae-475c-8545-684a7b429df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:22.266052 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd2035-57ae-475c-8545-684a7b429df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:27:22.269202 dv-cinder-820994-4-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-91bd2035-57ae-475c-8545-684a7b429df1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:27:22.269202 dv-cinder-820994-4-smb devstack@keystone.service[80231]: warnings.warn(msg) Jul 19 12:27:22.269202 dv-cinder-820994-4-smb devstack@keystone.service[80231]: Jul 19 12:27:22.270392 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd2035-57ae-475c-8545-684a7b429df1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:27:22.323242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 759/1497] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:27:22 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:27:22.327469 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb53d14-bcda-4775-a572-30dbc6b1cf47 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:27:22.329005 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0bb53d14-bcda-4775-a572-30dbc6b1cf47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:22.364344 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb53d14-bcda-4775-a572-30dbc6b1cf47 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:27:22.466574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6439e92-4839-4fd0-bd6b-bc06e7bba030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:27:22.467268 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6439e92-4839-4fd0-bd6b-bc06e7bba030 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:22.467548 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6439e92-4839-4fd0-bd6b-bc06e7bba030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:22.467813 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6439e92-4839-4fd0-bd6b-bc06e7bba030 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:22.468486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6439e92-4839-4fd0-bd6b-bc06e7bba030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:27:22.469489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: WARNING py.warnings [None req-b6439e92-4839-4fd0-bd6b-bc06e7bba030 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:27:22.469489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: warnings.warn(msg) Jul 19 12:27:22.469489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: Jul 19 12:27:22.470956 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6439e92-4839-4fd0-bd6b-bc06e7bba030 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:27:22.512239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 739/1498] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:27:22 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:27:22.516275 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd2035-57ae-475c-8545-684a7b429df1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:27:22.518193 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-91bd2035-57ae-475c-8545-684a7b429df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:22.580766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd2035-57ae-475c-8545-684a7b429df1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:27:22.662401 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:27:22.674592 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fbb37-215a-467d-9944-6a5e8ef9444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:27:22.675298 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fbb37-215a-467d-9944-6a5e8ef9444e admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:22.675576 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fbb37-215a-467d-9944-6a5e8ef9444e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:22.675850 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fbb37-215a-467d-9944-6a5e8ef9444e admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:22.676567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fbb37-215a-467d-9944-6a5e8ef9444e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:27:22.677568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-b28fbb37-215a-467d-9944-6a5e8ef9444e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:27:22.677568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: warnings.warn(msg) Jul 19 12:27:22.677568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: Jul 19 12:27:22.678475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fbb37-215a-467d-9944-6a5e8ef9444e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:27:22.691727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 760/1499] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:27:22.695734 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6439e92-4839-4fd0-bd6b-bc06e7bba030 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:27:22.697257 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b6439e92-4839-4fd0-bd6b-bc06e7bba030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:22.709258 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6439e92-4839-4fd0-bd6b-bc06e7bba030 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:27:22.733634 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:27:22.804894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5ccea-1905-4f38-8e47-f6ae4283f9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:27:22.805556 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5ccea-1905-4f38-8e47-f6ae4283f9ba admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:22.805831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5ccea-1905-4f38-8e47-f6ae4283f9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:22.806097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5ccea-1905-4f38-8e47-f6ae4283f9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:22.806840 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5ccea-1905-4f38-8e47-f6ae4283f9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:27:22.807863 dv-cinder-820994-4-smb devstack@keystone.service[80230]: WARNING py.warnings [None req-94d5ccea-1905-4f38-8e47-f6ae4283f9ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:27:22.807863 dv-cinder-820994-4-smb devstack@keystone.service[80230]: warnings.warn(msg) Jul 19 12:27:22.807863 dv-cinder-820994-4-smb devstack@keystone.service[80230]: Jul 19 12:27:22.808724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5ccea-1905-4f38-8e47-f6ae4283f9ba admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:27:22.820864 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 740/1500] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:27:22.825105 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fbb37-215a-467d-9944-6a5e8ef9444e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:27:22.826666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b28fbb37-215a-467d-9944-6a5e8ef9444e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:22.861518 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fbb37-215a-467d-9944-6a5e8ef9444e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:27:22.954707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05420968-25ed-44bb-9ecd-4c9f8b0c5ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:27:22.955629 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05420968-25ed-44bb-9ecd-4c9f8b0c5ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:22.955906 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05420968-25ed-44bb-9ecd-4c9f8b0c5ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:22.956176 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05420968-25ed-44bb-9ecd-4c9f8b0c5ac9 admin admin] PATH_INFO: `/v3/projects/70fb9b24289746749a7751eb4bb668cd/users/24563737a66a422bbfc86053abb7bf03/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:22.978346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05420968-25ed-44bb-9ecd-4c9f8b0c5ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70fb9b24289746749a7751eb4bb668cd, user_id=24563737a66a422bbfc86053abb7bf03, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:27:22.979405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-05420968-25ed-44bb-9ecd-4c9f8b0c5ac9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:27:22.979405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: warnings.warn(msg) Jul 19 12:27:22.979405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: Jul 19 12:27:22.981347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05420968-25ed-44bb-9ecd-4c9f8b0c5ac9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:27:23.006262 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 761/1501] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:27:22 2022] PUT /identity/v3/projects/70fb9b24289746749a7751eb4bb668cd/users/24563737a66a422bbfc86053abb7bf03/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:27:23.018797 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b384ef5-240d-4f35-b91b-a6733e81c154 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:23.019086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b384ef5-240d-4f35-b91b-a6733e81c154 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:23.019361 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b384ef5-240d-4f35-b91b-a6733e81c154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:23.074913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2b384ef5-240d-4f35-b91b-a6733e81c154 None None] MFA Rules not processed for user `24563737a66a422bbfc86053abb7bf03`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:27:23.076052 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2b384ef5-240d-4f35-b91b-a6733e81c154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:23.154122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 741/1502] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:27:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:27:23.168144 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9b8b7-5a90-417b-b465-8370cc3d1082 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:23.168439 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9b8b7-5a90-417b-b465-8370cc3d1082 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:23.168719 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9b8b7-5a90-417b-b465-8370cc3d1082 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:23.170129 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 762/1503] 10.222.0.25 () {54 vars in 964 bytes} [Tue Jul 19 12:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:27:23.175065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9685be-1a1d-414b-afb3-1816e1e7ebeb None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:23.175354 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9685be-1a1d-414b-afb3-1816e1e7ebeb None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:23.175639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9685be-1a1d-414b-afb3-1816e1e7ebeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:23.204467 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:27:23.250278 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-fa9685be-1a1d-414b-afb3-1816e1e7ebeb None None] MFA Rules not processed for user `726c2035855c444b88ec07a7811ea711`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:27:23.251702 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fa9685be-1a1d-414b-afb3-1816e1e7ebeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:23.327094 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 742/1504] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Jul 19 12:27:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:27:23.335264 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9b8b7-5a90-417b-b465-8370cc3d1082 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:27:23.336779 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f1a9b8b7-5a90-417b-b465-8370cc3d1082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:23.386313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:27:23.444258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9b8b7-5a90-417b-b465-8370cc3d1082 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:27:23.518138 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca7e4d-b645-46f1-9abb-608dd5cb2861 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:27:23.518807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca7e4d-b645-46f1-9abb-608dd5cb2861 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:23.519092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca7e4d-b645-46f1-9abb-608dd5cb2861 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:23.519366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca7e4d-b645-46f1-9abb-608dd5cb2861 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:23.521014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2aca7e4d-b645-46f1-9abb-608dd5cb2861 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:23.633512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca7e4d-b645-46f1-9abb-608dd5cb2861 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:27:23.634975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca7e4d-b645-46f1-9abb-608dd5cb2861 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:27:23.638521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:27:23.654228 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 763/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:27:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:27:23.700849 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da780-bdd4-4867-ad9b-74605939acd2 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:23.701255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da780-bdd4-4867-ad9b-74605939acd2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:23.701822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da780-bdd4-4867-ad9b-74605939acd2 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:23.702674 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 743/1506] 10.222.0.25 () {52 vars in 829 bytes} [Tue Jul 19 12:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:27:23.706299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca7e4d-b645-46f1-9abb-608dd5cb2861 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:27:23.707536 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2aca7e4d-b645-46f1-9abb-608dd5cb2861 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:23.807172 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca7e4d-b645-46f1-9abb-608dd5cb2861 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:27:23.901638 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d3743-d55c-447a-ba37-a89ff7569fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:27:23.902506 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d3743-d55c-447a-ba37-a89ff7569fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:23.902811 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d3743-d55c-447a-ba37-a89ff7569fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:23.903084 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d3743-d55c-447a-ba37-a89ff7569fb6 admin admin] PATH_INFO: `/v3/users/24563737a66a422bbfc86053abb7bf03` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:23.918338 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d3743-d55c-447a-ba37-a89ff7569fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24563737a66a422bbfc86053abb7bf03)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:27:23.919393 dv-cinder-820994-4-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-0e3d3743-d55c-447a-ba37-a89ff7569fb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:27:23.919393 dv-cinder-820994-4-smb devstack@keystone.service[80231]: warnings.warn(msg) Jul 19 12:27:23.919393 dv-cinder-820994-4-smb devstack@keystone.service[80231]: Jul 19 12:27:23.920613 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d3743-d55c-447a-ba37-a89ff7569fb6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:27:23.930404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:27:23.982722 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0e3d3743-d55c-447a-ba37-a89ff7569fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24563737a66a422bbfc86053abb7bf03'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:27:23.995250 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0e3d3743-d55c-447a-ba37-a89ff7569fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24563737a66a422bbfc86053abb7bf03'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:27:24.013334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0e3d3743-d55c-447a-ba37-a89ff7569fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24563737a66a422bbfc86053abb7bf03'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:27:24.023283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0e3d3743-d55c-447a-ba37-a89ff7569fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24563737a66a422bbfc86053abb7bf03'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:27:24.023763 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0e3d3743-d55c-447a-ba37-a89ff7569fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24563737a66a422bbfc86053abb7bf03'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:27:24.029496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 764/1507] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:27:23 2022] DELETE /identity/v3/users/24563737a66a422bbfc86053abb7bf03 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:27:24.034604 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4de302-d816-48d6-bef0-ed564c568a0a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:24.034922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4de302-d816-48d6-bef0-ed564c568a0a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:24.035201 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4de302-d816-48d6-bef0-ed564c568a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:24.088533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ca4de302-d816-48d6-bef0-ed564c568a0a None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:27:24.089721 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ca4de302-d816-48d6-bef0-ed564c568a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:24.163837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:27:24.177533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 744/1508] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:27:24.187885 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d3743-d55c-447a-ba37-a89ff7569fb6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:27:24.189251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0e3d3743-d55c-447a-ba37-a89ff7569fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:24.288797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d3743-d55c-447a-ba37-a89ff7569fb6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:27:24.345540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:27:24.366298 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579a6cb-2bad-451d-8011-03910d1af23c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:27:24.366999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579a6cb-2bad-451d-8011-03910d1af23c service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:24.367263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579a6cb-2bad-451d-8011-03910d1af23c service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:24.367534 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579a6cb-2bad-451d-8011-03910d1af23c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:24.369174 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9579a6cb-2bad-451d-8011-03910d1af23c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:24.481715 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579a6cb-2bad-451d-8011-03910d1af23c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:27:24.483092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579a6cb-2bad-451d-8011-03910d1af23c service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:27:24.502138 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 765/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:27:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:27:24.843933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4de302-d816-48d6-bef0-ed564c568a0a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:27:24.846326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ca4de302-d816-48d6-bef0-ed564c568a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:24.857617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4de302-d816-48d6-bef0-ed564c568a0a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:27:24.957890 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fb6f5-2e3a-4de2-988b-bee305ba1342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:27:24.958878 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fb6f5-2e3a-4de2-988b-bee305ba1342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:24.959160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fb6f5-2e3a-4de2-988b-bee305ba1342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:24.959430 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fb6f5-2e3a-4de2-988b-bee305ba1342 admin admin] PATH_INFO: `/v3/projects/70fb9b24289746749a7751eb4bb668cd` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:24.969279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fb6f5-2e3a-4de2-988b-bee305ba1342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70fb9b24289746749a7751eb4bb668cd)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:27:24.970922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: WARNING py.warnings [None req-9d1fb6f5-2e3a-4de2-988b-bee305ba1342 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:27:24.970922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: warnings.warn(msg) Jul 19 12:27:24.970922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: Jul 19 12:27:24.972109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fb6f5-2e3a-4de2-988b-bee305ba1342 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:27:25.028552 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9d1fb6f5-2e3a-4de2-988b-bee305ba1342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70fb9b24289746749a7751eb4bb668cd', 'request_id': 'req-9d1fb6f5-2e3a-4de2-988b-bee305ba1342'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:27:25.035175 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9d1fb6f5-2e3a-4de2-988b-bee305ba1342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70fb9b24289746749a7751eb4bb668cd', 'request_id': 'req-9d1fb6f5-2e3a-4de2-988b-bee305ba1342'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:27:25.044021 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9d1fb6f5-2e3a-4de2-988b-bee305ba1342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70fb9b24289746749a7751eb4bb668cd', 'request_id': 'req-9d1fb6f5-2e3a-4de2-988b-bee305ba1342'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:27:25.075515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9d1fb6f5-2e3a-4de2-988b-bee305ba1342 admin admin] The token cache is being invalidate because project 70fb9b24289746749a7751eb4bb668cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:27:25.075805 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9d1fb6f5-2e3a-4de2-988b-bee305ba1342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:27:25.076236 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9d1fb6f5-2e3a-4de2-988b-bee305ba1342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:27:25.077680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 745/1510] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:27:24 2022] DELETE /identity/v3/projects/70fb9b24289746749a7751eb4bb668cd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:27:34.499517 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=62 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:27:35.073227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:29:09.367603 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f0b9-dc87-403b-8835-3cf9f64c4d07 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:09.368196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f0b9-dc87-403b-8835-3cf9f64c4d07 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:09.368196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f0b9-dc87-403b-8835-3cf9f64c4d07 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:09.369550 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 12:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:29:09.374837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d794d64-e147-4146-baaf-82ab4bb435a5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:09.375343 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d794d64-e147-4146-baaf-82ab4bb435a5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:09.375458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d794d64-e147-4146-baaf-82ab4bb435a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:09.457857 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2d794d64-e147-4146-baaf-82ab4bb435a5 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:29:09.459156 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2d794d64-e147-4146-baaf-82ab4bb435a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:29:09.567238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 12:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:29:09.720322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664f0b9-dc87-403b-8835-3cf9f64c4d07 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:29:09.724288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6664f0b9-dc87-403b-8835-3cf9f64c4d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:29:09.841826 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664f0b9-dc87-403b-8835-3cf9f64c4d07 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:29:09.847935 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aee4a-1c42-44c2-b024-40bece5fab5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:29:09.848577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aee4a-1c42-44c2-b024-40bece5fab5e service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:09.848855 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aee4a-1c42-44c2-b024-40bece5fab5e service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:09.849125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aee4a-1c42-44c2-b024-40bece5fab5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:09.857065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8aee4a-1c42-44c2-b024-40bece5fab5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:29:09.858650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8aee4a-1c42-44c2-b024-40bece5fab5e service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:29:09.869372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 767/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:29:10.704861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfab234-5db2-4053-9648-5d1266a8bdd8 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:10.705901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfab234-5db2-4053-9648-5d1266a8bdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:10.706041 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfab234-5db2-4053-9648-5d1266a8bdd8 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:10.707456 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 747/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 12:29:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:29:10.712366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33718e1-fc71-44fa-8dee-74402986c3a0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:10.712776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33718e1-fc71-44fa-8dee-74402986c3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:10.713010 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33718e1-fc71-44fa-8dee-74402986c3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:10.730867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b33718e1-fc71-44fa-8dee-74402986c3a0 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:29:10.732064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b33718e1-fc71-44fa-8dee-74402986c3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:29:10.739956 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 768/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:29:10.892165 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfab234-5db2-4053-9648-5d1266a8bdd8 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:29:10.906571 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfab234-5db2-4053-9648-5d1266a8bdd8 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:29:10.912730 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56815b-e1b8-4044-88a2-fb7c37cee106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:29:10.913358 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56815b-e1b8-4044-88a2-fb7c37cee106 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:10.913636 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56815b-e1b8-4044-88a2-fb7c37cee106 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:10.913905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56815b-e1b8-4044-88a2-fb7c37cee106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:10.922056 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56815b-e1b8-4044-88a2-fb7c37cee106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:29:10.924251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56815b-e1b8-4044-88a2-fb7c37cee106 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:29:10.933659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 748/1516] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:29:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:29:11.753057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86829e5-8bd6-4f63-8ed4-8c78ee423a6b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:11.753468 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86829e5-8bd6-4f63-8ed4-8c78ee423a6b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:11.753581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86829e5-8bd6-4f63-8ed4-8c78ee423a6b None None] PATH_INFO: `/v3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:11.754907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 769/1517] 10.222.0.27 () {54 vars in 925 bytes} [Tue Jul 19 12:29:11 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:29:11.760856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e9e8c-9f86-4eae-a8a8-fb3461ff3276 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:11.761260 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e9e8c-9f86-4eae-a8a8-fb3461ff3276 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:11.761395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e9e8c-9f86-4eae-a8a8-fb3461ff3276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:11.819028 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-f51e9e8c-9f86-4eae-a8a8-fb3461ff3276 None None] MFA Rules not processed for user `11a51c42a4094d9b97eb636c57225dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:29:11.820246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f51e9e8c-9f86-4eae-a8a8-fb3461ff3276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:29:11.837208 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:29:11.891006 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 749/1518] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Jul 19 12:29:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:29:15.736626 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03dac5-bb59-4b8d-9264-a330b409ff98 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:15.737112 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03dac5-bb59-4b8d-9264-a330b409ff98 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:15.737825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03dac5-bb59-4b8d-9264-a330b409ff98 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:15.739142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 770/1519] 10.222.0.25 () {54 vars in 961 bytes} [Tue Jul 19 12:29:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:29:15.745128 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3a36f-f822-487e-a852-62a460e2123b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:15.745596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3a36f-f822-487e-a852-62a460e2123b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:15.745707 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3a36f-f822-487e-a852-62a460e2123b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:15.764075 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-48a3a36f-f822-487e-a852-62a460e2123b None None] MFA Rules not processed for user `11a51c42a4094d9b97eb636c57225dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:29:15.765300 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-48a3a36f-f822-487e-a852-62a460e2123b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:29:15.775125 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 750/1520] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Jul 19 12:29:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:29:15.782687 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03dac5-bb59-4b8d-9264-a330b409ff98 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:29:15.796769 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03dac5-bb59-4b8d-9264-a330b409ff98 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:29:15.801722 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a471bf-74fe-4ae9-adfd-c8854d3b82ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:29:15.802350 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a471bf-74fe-4ae9-adfd-c8854d3b82ff service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:15.802862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a471bf-74fe-4ae9-adfd-c8854d3b82ff service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:15.803190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a471bf-74fe-4ae9-adfd-c8854d3b82ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:15.811418 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a471bf-74fe-4ae9-adfd-c8854d3b82ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:29:15.812968 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a471bf-74fe-4ae9-adfd-c8854d3b82ff service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:29:15.823135 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 771/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:29:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:29:22.176897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb69ec3-31a8-43b5-8d5c-44d3298463c0 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:22.178101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb69ec3-31a8-43b5-8d5c-44d3298463c0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:22.178101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb69ec3-31a8-43b5-8d5c-44d3298463c0 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:22.179523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 751/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 12:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:29:22.184377 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b15920-7caa-4802-af11-65ac332631d6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:22.184805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b15920-7caa-4802-af11-65ac332631d6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:22.184912 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b15920-7caa-4802-af11-65ac332631d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:22.202822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d6b15920-7caa-4802-af11-65ac332631d6 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:29:22.204007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d6b15920-7caa-4802-af11-65ac332631d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:29:22.212552 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 772/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 12:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:29:22.363836 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb69ec3-31a8-43b5-8d5c-44d3298463c0 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:29:22.378301 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb69ec3-31a8-43b5-8d5c-44d3298463c0 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:29:22.383881 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a68ebc-d5eb-4deb-97aa-e90776579c13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:29:22.384520 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a68ebc-d5eb-4deb-97aa-e90776579c13 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:22.384809 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a68ebc-d5eb-4deb-97aa-e90776579c13 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:22.385079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a68ebc-d5eb-4deb-97aa-e90776579c13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:22.393379 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a68ebc-d5eb-4deb-97aa-e90776579c13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:29:22.394968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a68ebc-d5eb-4deb-97aa-e90776579c13 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:29:22.405318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 752/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:29:23.232542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf31298-8a38-4ef2-972f-e46d1b24266f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:23.233122 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf31298-8a38-4ef2-972f-e46d1b24266f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:23.233122 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf31298-8a38-4ef2-972f-e46d1b24266f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:23.234486 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 773/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 12:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:29:23.239512 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca08975-8bc7-4ed8-9a04-ef1d2eaa44cb None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:23.239998 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca08975-8bc7-4ed8-9a04-ef1d2eaa44cb None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:23.240500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca08975-8bc7-4ed8-9a04-ef1d2eaa44cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:23.258253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-fca08975-8bc7-4ed8-9a04-ef1d2eaa44cb None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:29:23.259489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fca08975-8bc7-4ed8-9a04-ef1d2eaa44cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:29:23.267891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 753/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 12:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:29:23.423914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf31298-8a38-4ef2-972f-e46d1b24266f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:29:23.438717 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf31298-8a38-4ef2-972f-e46d1b24266f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:29:23.444862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af40d0-8e43-4440-9176-3418a49f4b72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:29:23.445494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af40d0-8e43-4440-9176-3418a49f4b72 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:23.445775 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af40d0-8e43-4440-9176-3418a49f4b72 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:23.446047 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af40d0-8e43-4440-9176-3418a49f4b72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:23.454069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af40d0-8e43-4440-9176-3418a49f4b72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:29:23.455687 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af40d0-8e43-4440-9176-3418a49f4b72 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:29:23.466039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 774/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:29:27.340527 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedb2a4-722e-47e4-9f7e-f9b7d6fbf22d None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:27.341068 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedb2a4-722e-47e4-9f7e-f9b7d6fbf22d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:27.341068 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedb2a4-722e-47e4-9f7e-f9b7d6fbf22d None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:27.342436 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 754/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 12:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:29:27.347535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564acc91-c06f-48e1-8096-a4921d2d9752 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:27.347927 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564acc91-c06f-48e1-8096-a4921d2d9752 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:27.348092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564acc91-c06f-48e1-8096-a4921d2d9752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:27.367056 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-564acc91-c06f-48e1-8096-a4921d2d9752 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:29:27.368233 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-564acc91-c06f-48e1-8096-a4921d2d9752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:29:27.375972 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 775/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 12:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:29:27.450532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedb2a4-722e-47e4-9f7e-f9b7d6fbf22d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:29:27.452266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2aedb2a4-722e-47e4-9f7e-f9b7d6fbf22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:29:27.533052 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedb2a4-722e-47e4-9f7e-f9b7d6fbf22d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:29:27.537241 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e7f6c-5404-4844-a4e7-0acb12caf4f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:29:27.537909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e7f6c-5404-4844-a4e7-0acb12caf4f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:27.538191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e7f6c-5404-4844-a4e7-0acb12caf4f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:27.538466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e7f6c-5404-4844-a4e7-0acb12caf4f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:27.547476 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e7f6c-5404-4844-a4e7-0acb12caf4f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:29:27.548886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e7f6c-5404-4844-a4e7-0acb12caf4f7 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:29:27.558182 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 755/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:29:29.557387 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af100-1f90-40fa-aa4d-e1a09f18a5e7 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:29.557966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af100-1f90-40fa-aa4d-e1a09f18a5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:29.557966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af100-1f90-40fa-aa4d-e1a09f18a5e7 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:29.559383 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 776/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 12:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:29:29.564437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948eb8d-69b6-4c36-9ec6-6caaf7c8713a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:29.564843 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948eb8d-69b6-4c36-9ec6-6caaf7c8713a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:29.564991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948eb8d-69b6-4c36-9ec6-6caaf7c8713a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:29.583086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c948eb8d-69b6-4c36-9ec6-6caaf7c8713a None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:29:29.584897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c948eb8d-69b6-4c36-9ec6-6caaf7c8713a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:29:29.593032 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 756/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 12:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:29:29.628430 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af100-1f90-40fa-aa4d-e1a09f18a5e7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:29:29.639893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af100-1f90-40fa-aa4d-e1a09f18a5e7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:29:29.643636 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dff330-af34-40b4-ab9e-b0298804ca6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:29:29.644261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dff330-af34-40b4-ab9e-b0298804ca6e service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:29.644538 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dff330-af34-40b4-ab9e-b0298804ca6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:29.644807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dff330-af34-40b4-ab9e-b0298804ca6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:29.654516 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dff330-af34-40b4-ab9e-b0298804ca6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:29:29.656004 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dff330-af34-40b4-ab9e-b0298804ca6e service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:29:29.666224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 777/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:29:33.333048 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501b1d4-a660-44ce-b641-9f93fa8085c1 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:33.333609 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501b1d4-a660-44ce-b641-9f93fa8085c1 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:33.333609 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501b1d4-a660-44ce-b641-9f93fa8085c1 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:33.335777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 757/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 12:29:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:29:33.341000 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6fa01-59ca-429c-af45-314705db4e21 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:33.341404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6fa01-59ca-429c-af45-314705db4e21 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:33.341547 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6fa01-59ca-429c-af45-314705db4e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:33.359400 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-50e6fa01-59ca-429c-af45-314705db4e21 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:29:33.360577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-50e6fa01-59ca-429c-af45-314705db4e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:29:33.368386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 778/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 12:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:29:33.675838 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501b1d4-a660-44ce-b641-9f93fa8085c1 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:29:33.677521 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f501b1d4-a660-44ce-b641-9f93fa8085c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:29:33.744594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:29:33.759068 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501b1d4-a660-44ce-b641-9f93fa8085c1 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:29:33.762658 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30654c-add9-42c9-84b6-9141d6acb34e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:29:33.763333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30654c-add9-42c9-84b6-9141d6acb34e service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:33.763615 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30654c-add9-42c9-84b6-9141d6acb34e service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:33.763890 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30654c-add9-42c9-84b6-9141d6acb34e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:33.773059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30654c-add9-42c9-84b6-9141d6acb34e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:29:33.774470 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30654c-add9-42c9-84b6-9141d6acb34e service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:29:33.783795 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 758/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:29:35.844416 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b48c98-a4b0-48bb-8408-b53f69dd57eb None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:35.844965 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b48c98-a4b0-48bb-8408-b53f69dd57eb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:35.844965 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b48c98-a4b0-48bb-8408-b53f69dd57eb None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:35.846384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 779/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 12:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:29:35.852340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4eaf7-e662-4996-b4d3-d9fcbdf34eec None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:35.852748 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4eaf7-e662-4996-b4d3-d9fcbdf34eec None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:35.852908 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4eaf7-e662-4996-b4d3-d9fcbdf34eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:35.870220 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-11c4eaf7-e662-4996-b4d3-d9fcbdf34eec None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:29:35.871449 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-11c4eaf7-e662-4996-b4d3-d9fcbdf34eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:29:35.879299 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 759/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 12:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:29:36.181666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b48c98-a4b0-48bb-8408-b53f69dd57eb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:29:36.183432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e8b48c98-a4b0-48bb-8408-b53f69dd57eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:29:36.191257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=84 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:29:36.198557 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b48c98-a4b0-48bb-8408-b53f69dd57eb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:29:36.202101 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e973c-626e-48e3-be22-d8e1555271a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:29:36.202748 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e973c-626e-48e3-be22-d8e1555271a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:36.203040 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e973c-626e-48e3-be22-d8e1555271a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:36.203311 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e973c-626e-48e3-be22-d8e1555271a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:36.212928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e973c-626e-48e3-be22-d8e1555271a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:29:36.214333 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e973c-626e-48e3-be22-d8e1555271a5 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:29:36.223690 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 780/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:29:45.865431 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=11 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:29:46.219522 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:12.935444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d6df8-7e1b-4911-ad57-3bab6fe53e75 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:12.937187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d6df8-7e1b-4911-ad57-3bab6fe53e75 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:12.937683 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d6df8-7e1b-4911-ad57-3bab6fe53e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:12.967315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ec2d6df8-7e1b-4911-ad57-3bab6fe53e75 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:12.970040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ec2d6df8-7e1b-4911-ad57-3bab6fe53e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:12.986283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 760/1540] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:12.995599 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa792a-4dc9-44ab-9143-960827533b89 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:12.996494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa792a-4dc9-44ab-9143-960827533b89 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:12.996953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa792a-4dc9-44ab-9143-960827533b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.018447 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9caa792a-4dc9-44ab-9143-960827533b89 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:13.020521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9caa792a-4dc9-44ab-9143-960827533b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:13.035283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 781/1541] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:13.041341 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d6df8-7e1b-4911-ad57-3bab6fe53e75 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:13.055667 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d6df8-7e1b-4911-ad57-3bab6fe53e75 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:13.063386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41981ea0-72d7-4a10-babf-63aa5ae0cea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:13.064417 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41981ea0-72d7-4a10-babf-63aa5ae0cea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.064877 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41981ea0-72d7-4a10-babf-63aa5ae0cea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.065322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41981ea0-72d7-4a10-babf-63aa5ae0cea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.066286 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41981ea0-72d7-4a10-babf-63aa5ae0cea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:31:13.066787 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41981ea0-72d7-4a10-babf-63aa5ae0cea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:13.069279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41981ea0-72d7-4a10-babf-63aa5ae0cea1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:13.084057 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 761/1542] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:31:13.092728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa792a-4dc9-44ab-9143-960827533b89 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:13.104524 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa792a-4dc9-44ab-9143-960827533b89 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:13.117825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7196d-4a47-4caa-87b3-fcd7f07bce46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:13.118522 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7196d-4a47-4caa-87b3-fcd7f07bce46 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.118826 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7196d-4a47-4caa-87b3-fcd7f07bce46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.119102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7196d-4a47-4caa-87b3-fcd7f07bce46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.119819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7196d-4a47-4caa-87b3-fcd7f07bce46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:13.121766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7196d-4a47-4caa-87b3-fcd7f07bce46 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:13.180118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 782/1543] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:13 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:13.184831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41981ea0-72d7-4a10-babf-63aa5ae0cea1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:13.200073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41981ea0-72d7-4a10-babf-63aa5ae0cea1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:13.266349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8acde-3ff1-4d7d-bc23-297e82902b77 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.266708 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8acde-3ff1-4d7d-bc23-297e82902b77 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.267166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8acde-3ff1-4d7d-bc23-297e82902b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.303839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4dd8acde-3ff1-4d7d-bc23-297e82902b77 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:13.305071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4dd8acde-3ff1-4d7d-bc23-297e82902b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:13.309847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1db706-a1b8-4700-97f2-85f739c83c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:13.311502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1db706-a1b8-4700-97f2-85f739c83c9e admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.312021 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1db706-a1b8-4700-97f2-85f739c83c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.312513 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1db706-a1b8-4700-97f2-85f739c83c9e admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.313438 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1db706-a1b8-4700-97f2-85f739c83c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:13.320318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1db706-a1b8-4700-97f2-85f739c83c9e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:13.337856 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 783/1544] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:13.347930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14a834-9cac-46fc-9496-93a2b6a5183d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.348384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14a834-9cac-46fc-9496-93a2b6a5183d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.348849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14a834-9cac-46fc-9496-93a2b6a5183d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.368014 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 762/1545] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:13 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:13.370398 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bc0d7-2f79-41bc-8048-84e3618f2503 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.371008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bc0d7-2f79-41bc-8048-84e3618f2503 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.371495 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bc0d7-2f79-41bc-8048-84e3618f2503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.392049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8b14a834-9cac-46fc-9496-93a2b6a5183d None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:13.393396 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8b14a834-9cac-46fc-9496-93a2b6a5183d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:13.401970 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8c0bc0d7-2f79-41bc-8048-84e3618f2503 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:13.403190 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8c0bc0d7-2f79-41bc-8048-84e3618f2503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:13.420603 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 784/1546] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:13.421649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14a834-9cac-46fc-9496-93a2b6a5183d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:13.424075 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 763/1547] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:13.427236 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dab8f-0861-42f9-b587-8a61cab09805 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.430771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dab8f-0861-42f9-b587-8a61cab09805 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.431264 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dab8f-0861-42f9-b587-8a61cab09805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.445942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14a834-9cac-46fc-9496-93a2b6a5183d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:13.463648 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-907dab8f-0861-42f9-b587-8a61cab09805 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:13.464885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-907dab8f-0861-42f9-b587-8a61cab09805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:13.465318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9986aa0-56af-49ca-97fd-10297be70174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:13.466010 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9986aa0-56af-49ca-97fd-10297be70174 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.466287 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9986aa0-56af-49ca-97fd-10297be70174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.466560 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9986aa0-56af-49ca-97fd-10297be70174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.467422 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9986aa0-56af-49ca-97fd-10297be70174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:13.469024 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9986aa0-56af-49ca-97fd-10297be70174 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:13.479690 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 764/1548] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:13.481371 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dab8f-0861-42f9-b587-8a61cab09805 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:13.498269 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 785/1549] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:13.499627 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9a5a3-7c69-49bd-8b92-c833c3f166bb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.499913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9a5a3-7c69-49bd-8b92-c833c3f166bb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.500186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9a5a3-7c69-49bd-8b92-c833c3f166bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.503653 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dab8f-0861-42f9-b587-8a61cab09805 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:13.509982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a679c-e54a-4cf0-a09d-f53519c0548f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:13.510660 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a679c-e54a-4cf0-a09d-f53519c0548f admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.510976 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a679c-e54a-4cf0-a09d-f53519c0548f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.511255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a679c-e54a-4cf0-a09d-f53519c0548f admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.512087 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a679c-e54a-4cf0-a09d-f53519c0548f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:31:13.512397 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a679c-e54a-4cf0-a09d-f53519c0548f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:13.518517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a679c-e54a-4cf0-a09d-f53519c0548f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:13.540897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 765/1550] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:31:13.542317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a1dec-1dd5-450c-b05e-67343b0c49a1 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.542610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a1dec-1dd5-450c-b05e-67343b0c49a1 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.542916 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a1dec-1dd5-450c-b05e-67343b0c49a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.544287 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-71d9a5a3-7c69-49bd-8b92-c833c3f166bb None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:13.545690 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-71d9a5a3-7c69-49bd-8b92-c833c3f166bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:13.565749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 786/1551] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:13.566729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9a5a3-7c69-49bd-8b92-c833c3f166bb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:13.578471 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9a5a3-7c69-49bd-8b92-c833c3f166bb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:13.578924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ab6a1dec-1dd5-450c-b05e-67343b0c49a1 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:13.580181 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ab6a1dec-1dd5-450c-b05e-67343b0c49a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:13.584516 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df305714-ece2-423d-88e4-fbe59e4b7d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:13.585315 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df305714-ece2-423d-88e4-fbe59e4b7d57 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.585602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df305714-ece2-423d-88e4-fbe59e4b7d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.585872 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df305714-ece2-423d-88e4-fbe59e4b7d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.586590 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df305714-ece2-423d-88e4-fbe59e4b7d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:13.588227 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df305714-ece2-423d-88e4-fbe59e4b7d57 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:13.591026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 766/1552] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:13.592152 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d58bd-5acc-4531-90c3-f41f6b542967 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.592623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d58bd-5acc-4531-90c3-f41f6b542967 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.592760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d58bd-5acc-4531-90c3-f41f6b542967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.605239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 787/1553] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:13.606196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df305714-ece2-423d-88e4-fbe59e4b7d57 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:13.615800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c61d58bd-5acc-4531-90c3-f41f6b542967 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:13.617211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c61d58bd-5acc-4531-90c3-f41f6b542967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:13.619069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df305714-ece2-423d-88e4-fbe59e4b7d57 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:13.623865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b325e-7111-4303-8ce1-95f71d39d668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:13.624514 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b325e-7111-4303-8ce1-95f71d39d668 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.624787 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b325e-7111-4303-8ce1-95f71d39d668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.625058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b325e-7111-4303-8ce1-95f71d39d668 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.625742 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b325e-7111-4303-8ce1-95f71d39d668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:13.626016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 767/1554] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:13.627447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a732ac-6f4c-449f-92b3-68476722fbee None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.627659 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b325e-7111-4303-8ce1-95f71d39d668 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:13.627774 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a732ac-6f4c-449f-92b3-68476722fbee None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.628002 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a732ac-6f4c-449f-92b3-68476722fbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.647245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c1a732ac-6f4c-449f-92b3-68476722fbee None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:13.648464 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c1a732ac-6f4c-449f-92b3-68476722fbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:13.656388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 788/1555] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:13 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:13.657271 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 768/1556] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:13.658501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1496de-d3bc-4bf1-8f8b-0dc62c30da60 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.658840 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1496de-d3bc-4bf1-8f8b-0dc62c30da60 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.659111 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1496de-d3bc-4bf1-8f8b-0dc62c30da60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.663011 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b325e-7111-4303-8ce1-95f71d39d668 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:13.677609 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9d1496de-d3bc-4bf1-8f8b-0dc62c30da60 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:13.678961 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9d1496de-d3bc-4bf1-8f8b-0dc62c30da60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:13.746353 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 769/1557] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:13.747192 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1496de-d3bc-4bf1-8f8b-0dc62c30da60 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:13.758468 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1496de-d3bc-4bf1-8f8b-0dc62c30da60 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:13.763386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34e80b-3707-4095-a20a-476759bb76f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:13.764073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34e80b-3707-4095-a20a-476759bb76f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.764358 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34e80b-3707-4095-a20a-476759bb76f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.764637 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34e80b-3707-4095-a20a-476759bb76f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.765380 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34e80b-3707-4095-a20a-476759bb76f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:31:13.765690 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34e80b-3707-4095-a20a-476759bb76f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:13.767616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34e80b-3707-4095-a20a-476759bb76f3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:13.781437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 770/1558] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:31:13.782296 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34e80b-3707-4095-a20a-476759bb76f3 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:13.794565 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34e80b-3707-4095-a20a-476759bb76f3 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:13.799411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f20f6-9d1c-47e4-a064-d6f34aa6ef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:13.800323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f20f6-9d1c-47e4-a064-d6f34aa6ef85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.800603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f20f6-9d1c-47e4-a064-d6f34aa6ef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.800879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f20f6-9d1c-47e4-a064-d6f34aa6ef85 admin admin] PATH_INFO: `/v3/projects/206f5ccabdb74e8cb6c3d3cbbe6e0062/users/6575cc39f6a1466691f15625e15fc199/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.811433 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:13.820155 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f20f6-9d1c-47e4-a064-d6f34aa6ef85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=206f5ccabdb74e8cb6c3d3cbbe6e0062, user_id=6575cc39f6a1466691f15625e15fc199, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:13.821412 dv-cinder-820994-4-smb devstack@keystone.service[80230]: WARNING py.warnings [None req-196f20f6-9d1c-47e4-a064-d6f34aa6ef85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:31:13.821412 dv-cinder-820994-4-smb devstack@keystone.service[80230]: warnings.warn(msg) Jul 19 12:31:13.821412 dv-cinder-820994-4-smb devstack@keystone.service[80230]: Jul 19 12:31:13.823642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f20f6-9d1c-47e4-a064-d6f34aa6ef85 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:13.837015 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 771/1559] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:13 2022] PUT /identity/v3/projects/206f5ccabdb74e8cb6c3d3cbbe6e0062/users/6575cc39f6a1466691f15625e15fc199/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:13.838476 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d522ca-11e0-42a6-97db-1361222ea82f None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.838917 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d522ca-11e0-42a6-97db-1361222ea82f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.839297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d522ca-11e0-42a6-97db-1361222ea82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.853640 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b325e-7111-4303-8ce1-95f71d39d668 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:13.856322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-46d522ca-11e0-42a6-97db-1361222ea82f None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:13.857560 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-46d522ca-11e0-42a6-97db-1361222ea82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:13.911681 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e3f4c-577c-49be-b0b9-d729c59a5a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:13.912351 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e3f4c-577c-49be-b0b9-d729c59a5a70 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.912632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e3f4c-577c-49be-b0b9-d729c59a5a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.912904 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e3f4c-577c-49be-b0b9-d729c59a5a70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.913612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e3f4c-577c-49be-b0b9-d729c59a5a70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:31:13.913939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e3f4c-577c-49be-b0b9-d729c59a5a70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:13.915007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-2a2e3f4c-577c-49be-b0b9-d729c59a5a70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:31:13.915007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: warnings.warn(msg) Jul 19 12:31:13.915007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: Jul 19 12:31:13.915882 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e3f4c-577c-49be-b0b9-d729c59a5a70 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:13.918041 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 772/1560] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:13.919156 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a331a0-1517-4a4e-b820-10e4b866791d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.919440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a331a0-1517-4a4e-b820-10e4b866791d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.919711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a331a0-1517-4a4e-b820-10e4b866791d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.924804 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:13.929624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 789/1561] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:31:13.930421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e3f4c-577c-49be-b0b9-d729c59a5a70 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:13.939043 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d4a331a0-1517-4a4e-b820-10e4b866791d None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:13.940269 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d4a331a0-1517-4a4e-b820-10e4b866791d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:13.941578 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e3f4c-577c-49be-b0b9-d729c59a5a70 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:13.946817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf22a1d-b33f-42c5-a4b7-aec13482b55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:13.947566 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf22a1d-b33f-42c5-a4b7-aec13482b55b admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.947923 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf22a1d-b33f-42c5-a4b7-aec13482b55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.948270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf22a1d-b33f-42c5-a4b7-aec13482b55b admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.948388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 773/1562] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:13.949165 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf22a1d-b33f-42c5-a4b7-aec13482b55b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:13.949493 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b367462-0bb7-4d9d-b4a9-d56ca61b7685 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.949777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b367462-0bb7-4d9d-b4a9-d56ca61b7685 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.950044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b367462-0bb7-4d9d-b4a9-d56ca61b7685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.950391 dv-cinder-820994-4-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-baf22a1d-b33f-42c5-a4b7-aec13482b55b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:31:13.950391 dv-cinder-820994-4-smb devstack@keystone.service[80231]: warnings.warn(msg) Jul 19 12:31:13.950391 dv-cinder-820994-4-smb devstack@keystone.service[80231]: Jul 19 12:31:13.951765 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf22a1d-b33f-42c5-a4b7-aec13482b55b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:13.969020 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7b367462-0bb7-4d9d-b4a9-d56ca61b7685 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:13.970322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7b367462-0bb7-4d9d-b4a9-d56ca61b7685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:13.972877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 790/1563] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:13 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:13.974194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef959e00-d26b-4a09-8978-f8d4ca2b4341 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.974479 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef959e00-d26b-4a09-8978-f8d4ca2b4341 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.974788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef959e00-d26b-4a09-8978-f8d4ca2b4341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.979190 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 774/1564] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:13.980068 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b367462-0bb7-4d9d-b4a9-d56ca61b7685 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:13.990701 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b367462-0bb7-4d9d-b4a9-d56ca61b7685 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:13.995516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b95d80-a9f3-418d-ade5-138d4a9c2e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:13.996167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b95d80-a9f3-418d-ade5-138d4a9c2e66 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:13.996504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b95d80-a9f3-418d-ade5-138d4a9c2e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:13.996707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ef959e00-d26b-4a09-8978-f8d4ca2b4341 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:13.997213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b95d80-a9f3-418d-ade5-138d4a9c2e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:13.997540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b95d80-a9f3-418d-ade5-138d4a9c2e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:13.997903 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ef959e00-d26b-4a09-8978-f8d4ca2b4341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:13.998560 dv-cinder-820994-4-smb devstack@keystone.service[80230]: WARNING py.warnings [None req-e5b95d80-a9f3-418d-ade5-138d4a9c2e66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:31:13.998560 dv-cinder-820994-4-smb devstack@keystone.service[80230]: warnings.warn(msg) Jul 19 12:31:13.998560 dv-cinder-820994-4-smb devstack@keystone.service[80230]: Jul 19 12:31:13.999784 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b95d80-a9f3-418d-ade5-138d4a9c2e66 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.006347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 791/1565] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:14.007660 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203b9bb-7ce1-4d92-882d-70c034c45081 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.007951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203b9bb-7ce1-4d92-882d-70c034c45081 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.008227 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203b9bb-7ce1-4d92-882d-70c034c45081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.027086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0203b9bb-7ce1-4d92-882d-70c034c45081 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:14.027448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 775/1566] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:13 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:14.028346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0203b9bb-7ce1-4d92-882d-70c034c45081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:14.028982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba9ae2-c389-4e5d-b258-566b9da87824 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.029242 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba9ae2-c389-4e5d-b258-566b9da87824 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.029520 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba9ae2-c389-4e5d-b258-566b9da87824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.048172 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-35ba9ae2-c389-4e5d-b258-566b9da87824 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:14.049416 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-35ba9ae2-c389-4e5d-b258-566b9da87824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:14.088901 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 792/1567] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:14.089932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203b9bb-7ce1-4d92-882d-70c034c45081 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.099514 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203b9bb-7ce1-4d92-882d-70c034c45081 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.104476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46909e0-8365-4fee-bcd8-56f5f6ae6a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.105132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46909e0-8365-4fee-bcd8-56f5f6ae6a1e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.105412 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46909e0-8365-4fee-bcd8-56f5f6ae6a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.105694 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46909e0-8365-4fee-bcd8-56f5f6ae6a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.106386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46909e0-8365-4fee-bcd8-56f5f6ae6a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.108310 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46909e0-8365-4fee-bcd8-56f5f6ae6a1e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.112652 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 776/1568] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:14.113496 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba9ae2-c389-4e5d-b258-566b9da87824 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.123837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba9ae2-c389-4e5d-b258-566b9da87824 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.129588 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564afca-c15e-493f-bb84-aca574b6999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.130324 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564afca-c15e-493f-bb84-aca574b6999e admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.130612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564afca-c15e-493f-bb84-aca574b6999e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.130914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564afca-c15e-493f-bb84-aca574b6999e admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.131643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564afca-c15e-493f-bb84-aca574b6999e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:31:14.131951 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564afca-c15e-493f-bb84-aca574b6999e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.133534 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564afca-c15e-493f-bb84-aca574b6999e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.136712 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 793/1569] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:14 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:14.137592 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46909e0-8365-4fee-bcd8-56f5f6ae6a1e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.151255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 777/1570] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:31:14.152149 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564afca-c15e-493f-bb84-aca574b6999e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.163732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564afca-c15e-493f-bb84-aca574b6999e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.204092 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:14.205087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46909e0-8365-4fee-bcd8-56f5f6ae6a1e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.210554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e5166-e46f-484a-b1d6-b60554072bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.211225 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e5166-e46f-484a-b1d6-b60554072bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.211495 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e5166-e46f-484a-b1d6-b60554072bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.212001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e5166-e46f-484a-b1d6-b60554072bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.212698 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e5166-e46f-484a-b1d6-b60554072bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.214222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e5166-e46f-484a-b1d6-b60554072bbd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.223687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f252c-01c6-47b3-8200-fda56d87db30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.224350 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f252c-01c6-47b3-8200-fda56d87db30 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.224736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f252c-01c6-47b3-8200-fda56d87db30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.224973 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 794/1571] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:14.225090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f252c-01c6-47b3-8200-fda56d87db30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.225724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f252c-01c6-47b3-8200-fda56d87db30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:31:14.225834 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e5166-e46f-484a-b1d6-b60554072bbd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.226026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f252c-01c6-47b3-8200-fda56d87db30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.227639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f252c-01c6-47b3-8200-fda56d87db30 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.235402 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e5166-e46f-484a-b1d6-b60554072bbd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.247572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 778/1572] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:31:14.247733 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084352ac-658c-4e7d-a6cf-29839a94c730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.247733 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084352ac-658c-4e7d-a6cf-29839a94c730 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.247959 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f252c-01c6-47b3-8200-fda56d87db30 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.248049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084352ac-658c-4e7d-a6cf-29839a94c730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.248049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084352ac-658c-4e7d-a6cf-29839a94c730 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.248049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084352ac-658c-4e7d-a6cf-29839a94c730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:31:14.248049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084352ac-658c-4e7d-a6cf-29839a94c730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.248049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084352ac-658c-4e7d-a6cf-29839a94c730 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.257421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 795/1573] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:31:14.258221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084352ac-658c-4e7d-a6cf-29839a94c730 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.258757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f252c-01c6-47b3-8200-fda56d87db30 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.264415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fc343-cff3-4b19-b82a-938240ff4f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.265230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fc343-cff3-4b19-b82a-938240ff4f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.265522 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fc343-cff3-4b19-b82a-938240ff4f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.265805 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fc343-cff3-4b19-b82a-938240ff4f7a admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.266498 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fc343-cff3-4b19-b82a-938240ff4f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.268698 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fc343-cff3-4b19-b82a-938240ff4f7a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.290910 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 779/1574] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:14 2022] POST /identity/v3/users => generated 292 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:14.291869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fc343-cff3-4b19-b82a-938240ff4f7a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.302190 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fc343-cff3-4b19-b82a-938240ff4f7a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.305179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:14.307281 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d6d69-8bba-4a5a-8688-bd56962b016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.314488 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d6d69-8bba-4a5a-8688-bd56962b016d admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.314806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d6d69-8bba-4a5a-8688-bd56962b016d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.315096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d6d69-8bba-4a5a-8688-bd56962b016d admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.315994 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d6d69-8bba-4a5a-8688-bd56962b016d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:31:14.316347 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d6d69-8bba-4a5a-8688-bd56962b016d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.318175 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d6d69-8bba-4a5a-8688-bd56962b016d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.324301 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084352ac-658c-4e7d-a6cf-29839a94c730 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.328356 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85bdf5-a292-46d3-82b7-f31e3c5e0387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.329008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85bdf5-a292-46d3-82b7-f31e3c5e0387 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.329284 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85bdf5-a292-46d3-82b7-f31e3c5e0387 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.329554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85bdf5-a292-46d3-82b7-f31e3c5e0387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.333850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 780/1575] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:31:14.333850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d6d69-8bba-4a5a-8688-bd56962b016d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.341770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85bdf5-a292-46d3-82b7-f31e3c5e0387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.343269 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85bdf5-a292-46d3-82b7-f31e3c5e0387 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.344452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d6d69-8bba-4a5a-8688-bd56962b016d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.350037 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df0788-9c59-44d0-a71f-8dbce92a8d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.350696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df0788-9c59-44d0-a71f-8dbce92a8d2e admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.351022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df0788-9c59-44d0-a71f-8dbce92a8d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.351302 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df0788-9c59-44d0-a71f-8dbce92a8d2e admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.351992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df0788-9c59-44d0-a71f-8dbce92a8d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.353525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 796/1576] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:14.353899 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df0788-9c59-44d0-a71f-8dbce92a8d2e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.354294 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85bdf5-a292-46d3-82b7-f31e3c5e0387 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.365223 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85bdf5-a292-46d3-82b7-f31e3c5e0387 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.371931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255c50a-57fe-4a35-b15d-5f8d1654d66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.372645 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255c50a-57fe-4a35-b15d-5f8d1654d66b admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.372927 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255c50a-57fe-4a35-b15d-5f8d1654d66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.373192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255c50a-57fe-4a35-b15d-5f8d1654d66b admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.373876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255c50a-57fe-4a35-b15d-5f8d1654d66b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.375833 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255c50a-57fe-4a35-b15d-5f8d1654d66b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.376566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 781/1577] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:14 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:14.381406 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df0788-9c59-44d0-a71f-8dbce92a8d2e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.394016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df0788-9c59-44d0-a71f-8dbce92a8d2e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.400711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e90d3-50a8-4f8b-ae8d-9c08f3cc8381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.401381 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e90d3-50a8-4f8b-ae8d-9c08f3cc8381 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.401713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e90d3-50a8-4f8b-ae8d-9c08f3cc8381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.401965 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e90d3-50a8-4f8b-ae8d-9c08f3cc8381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.402781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e90d3-50a8-4f8b-ae8d-9c08f3cc8381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.404325 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e90d3-50a8-4f8b-ae8d-9c08f3cc8381 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.410604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 797/1578] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:14 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:14.410604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255c50a-57fe-4a35-b15d-5f8d1654d66b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.417240 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 782/1579] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:14.418064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e90d3-50a8-4f8b-ae8d-9c08f3cc8381 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.431680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e90d3-50a8-4f8b-ae8d-9c08f3cc8381 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.490688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255c50a-57fe-4a35-b15d-5f8d1654d66b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.496211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434d9c2-71c3-4c12-a71d-f55fe079ae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.497109 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434d9c2-71c3-4c12-a71d-f55fe079ae50 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.497391 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434d9c2-71c3-4c12-a71d-f55fe079ae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.497843 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434d9c2-71c3-4c12-a71d-f55fe079ae50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.498498 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434d9c2-71c3-4c12-a71d-f55fe079ae50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.500736 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434d9c2-71c3-4c12-a71d-f55fe079ae50 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.503957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a28d7-5fe6-4412-8d09-58541cf8d076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.505267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a28d7-5fe6-4412-8d09-58541cf8d076 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.505547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a28d7-5fe6-4412-8d09-58541cf8d076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.505947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a28d7-5fe6-4412-8d09-58541cf8d076 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.506644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a28d7-5fe6-4412-8d09-58541cf8d076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.508577 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a28d7-5fe6-4412-8d09-58541cf8d076 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.532025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 798/1580] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:14 2022] POST /identity/v3/projects => generated 393 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:14.532873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434d9c2-71c3-4c12-a71d-f55fe079ae50 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.543234 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 783/1581] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:14 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:14.544146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a28d7-5fe6-4412-8d09-58541cf8d076 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.613170 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434d9c2-71c3-4c12-a71d-f55fe079ae50 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.619870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b14db0-daa9-4b81-82fa-127597d83545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.620624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b14db0-daa9-4b81-82fa-127597d83545 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.620980 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b14db0-daa9-4b81-82fa-127597d83545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.621494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a28d7-5fe6-4412-8d09-58541cf8d076 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.621632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b14db0-daa9-4b81-82fa-127597d83545 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.622435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b14db0-daa9-4b81-82fa-127597d83545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.624083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b14db0-daa9-4b81-82fa-127597d83545 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.627748 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0cfcb-429e-40d9-96ba-972f7a2441a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.628538 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0cfcb-429e-40d9-96ba-972f7a2441a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.628821 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0cfcb-429e-40d9-96ba-972f7a2441a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.629088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0cfcb-429e-40d9-96ba-972f7a2441a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.629813 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0cfcb-429e-40d9-96ba-972f7a2441a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.631967 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0cfcb-429e-40d9-96ba-972f7a2441a4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.634933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 799/1582] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:14.638022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:14.639541 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b14db0-daa9-4b81-82fa-127597d83545 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.651335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b14db0-daa9-4b81-82fa-127597d83545 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.656577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621baa1-f926-40ac-8b91-a8bc4e829f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.657357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621baa1-f926-40ac-8b91-a8bc4e829f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.657685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621baa1-f926-40ac-8b91-a8bc4e829f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.657974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621baa1-f926-40ac-8b91-a8bc4e829f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.658929 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621baa1-f926-40ac-8b91-a8bc4e829f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.660856 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621baa1-f926-40ac-8b91-a8bc4e829f0a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.672702 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 784/1583] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:14 2022] POST /identity/v3/projects => generated 405 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:14.672702 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0cfcb-429e-40d9-96ba-972f7a2441a4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.676184 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 800/1584] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:14.677831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621baa1-f926-40ac-8b91-a8bc4e829f0a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.692410 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621baa1-f926-40ac-8b91-a8bc4e829f0a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.727727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:14.764927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0cfcb-429e-40d9-96ba-972f7a2441a4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.769741 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee221bd-7c35-4c54-b3e1-2de061a0e19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.770889 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee221bd-7c35-4c54-b3e1-2de061a0e19b admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.771170 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee221bd-7c35-4c54-b3e1-2de061a0e19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.771441 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee221bd-7c35-4c54-b3e1-2de061a0e19b admin admin] PATH_INFO: `/v3/projects/84fa2500a4cc487784590005d8600664/users/7713fb28e4884d4e903a40b867347b8d/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.778250 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d26721-1161-418d-a310-2a9aa7e5bf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.779901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d26721-1161-418d-a310-2a9aa7e5bf0d admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.780395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d26721-1161-418d-a310-2a9aa7e5bf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.781230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d26721-1161-418d-a310-2a9aa7e5bf0d admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.782259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d26721-1161-418d-a310-2a9aa7e5bf0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.785553 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d26721-1161-418d-a310-2a9aa7e5bf0d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.788142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee221bd-7c35-4c54-b3e1-2de061a0e19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=84fa2500a4cc487784590005d8600664, user_id=7713fb28e4884d4e903a40b867347b8d, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.791143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee221bd-7c35-4c54-b3e1-2de061a0e19b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.808792 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 801/1585] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:14 2022] PUT /identity/v3/projects/84fa2500a4cc487784590005d8600664/users/7713fb28e4884d4e903a40b867347b8d/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:14.809628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee221bd-7c35-4c54-b3e1-2de061a0e19b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.819984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 785/1586] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:14 2022] POST /identity/v3/users => generated 303 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:14.821290 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d26721-1161-418d-a310-2a9aa7e5bf0d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.845042 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d26721-1161-418d-a310-2a9aa7e5bf0d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.888805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee221bd-7c35-4c54-b3e1-2de061a0e19b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.894428 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb75d5-cad7-4aa2-8fc3-4f8dc9f83400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.895935 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb75d5-cad7-4aa2-8fc3-4f8dc9f83400 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.896322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb75d5-cad7-4aa2-8fc3-4f8dc9f83400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.896691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb75d5-cad7-4aa2-8fc3-4f8dc9f83400 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.897499 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb75d5-cad7-4aa2-8fc3-4f8dc9f83400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.899574 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb75d5-cad7-4aa2-8fc3-4f8dc9f83400 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.913433 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249ca9d-46c6-4946-9a65-b48ea2a64e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.914201 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249ca9d-46c6-4946-9a65-b48ea2a64e72 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.914570 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249ca9d-46c6-4946-9a65-b48ea2a64e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.914851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249ca9d-46c6-4946-9a65-b48ea2a64e72 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.915582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249ca9d-46c6-4946-9a65-b48ea2a64e72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.917662 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249ca9d-46c6-4946-9a65-b48ea2a64e72 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.923484 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 802/1587] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:14 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:14.925131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb75d5-cad7-4aa2-8fc3-4f8dc9f83400 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.938040 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb75d5-cad7-4aa2-8fc3-4f8dc9f83400 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.941134 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 786/1588] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:14 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:14.942213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249ca9d-46c6-4946-9a65-b48ea2a64e72 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.945592 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e10b9b-ecbc-432c-9e55-b953bac8a1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.946456 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e10b9b-ecbc-432c-9e55-b953bac8a1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.946603 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e10b9b-ecbc-432c-9e55-b953bac8a1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.946838 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e10b9b-ecbc-432c-9e55-b953bac8a1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.947571 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e10b9b-ecbc-432c-9e55-b953bac8a1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.949275 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e10b9b-ecbc-432c-9e55-b953bac8a1b7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.953919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249ca9d-46c6-4946-9a65-b48ea2a64e72 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.960673 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c5bcd-153c-4cc3-897c-2f41868eed34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.961225 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 803/1589] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:14.961414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c5bcd-153c-4cc3-897c-2f41868eed34 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.961791 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c5bcd-153c-4cc3-897c-2f41868eed34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.962206 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c5bcd-153c-4cc3-897c-2f41868eed34 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.962462 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e10b9b-ecbc-432c-9e55-b953bac8a1b7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:14.963073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c5bcd-153c-4cc3-897c-2f41868eed34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.966121 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c5bcd-153c-4cc3-897c-2f41868eed34 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.973643 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e10b9b-ecbc-432c-9e55-b953bac8a1b7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:14.979578 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8184d-5483-4fcf-9407-84254cd2527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:14.980623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8184d-5483-4fcf-9407-84254cd2527d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.980912 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8184d-5483-4fcf-9407-84254cd2527d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.981190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8184d-5483-4fcf-9407-84254cd2527d admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.982093 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8184d-5483-4fcf-9407-84254cd2527d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:14.983705 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8184d-5483-4fcf-9407-84254cd2527d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:14.992279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 787/1590] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:14 2022] POST /identity/v3/users => generated 303 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:14.993960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd3fa7-9f91-499f-a319-3bdec8c86d5a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:14.994422 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd3fa7-9f91-499f-a319-3bdec8c86d5a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:14.994982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd3fa7-9f91-499f-a319-3bdec8c86d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:14.998980 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 804/1591] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:15.000065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8184d-5483-4fcf-9407-84254cd2527d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:15.010407 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8184d-5483-4fcf-9407-84254cd2527d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:15.015364 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9365f-c3ec-4aa8-998d-b6289bc62070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:15.016073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9365f-c3ec-4aa8-998d-b6289bc62070 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:15.016284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-70bd3fa7-9f91-499f-a319-3bdec8c86d5a None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:15.016410 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9365f-c3ec-4aa8-998d-b6289bc62070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:15.016621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9365f-c3ec-4aa8-998d-b6289bc62070 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:15.017628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9365f-c3ec-4aa8-998d-b6289bc62070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:15.018403 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-70bd3fa7-9f91-499f-a319-3bdec8c86d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:15.019299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9365f-c3ec-4aa8-998d-b6289bc62070 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:15.028289 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 788/1592] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:15.029460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd3fa7-9f91-499f-a319-3bdec8c86d5a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:15.030185 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 805/1593] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:15.030859 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9365f-c3ec-4aa8-998d-b6289bc62070 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:15.046034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9365f-c3ec-4aa8-998d-b6289bc62070 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:15.050449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9633a-1c57-4c62-b8be-1423e8e82147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:15.051155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9633a-1c57-4c62-b8be-1423e8e82147 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:15.051646 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9633a-1c57-4c62-b8be-1423e8e82147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:15.051934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9633a-1c57-4c62-b8be-1423e8e82147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:15.052058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd3fa7-9f91-499f-a319-3bdec8c86d5a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:15.052663 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9633a-1c57-4c62-b8be-1423e8e82147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:15.054250 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9633a-1c57-4c62-b8be-1423e8e82147 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:15.059237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929aa66-0cfe-4651-a590-5e15c2667423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:15.060091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929aa66-0cfe-4651-a590-5e15c2667423 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:15.060446 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929aa66-0cfe-4651-a590-5e15c2667423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:15.060847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929aa66-0cfe-4651-a590-5e15c2667423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:15.061773 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929aa66-0cfe-4651-a590-5e15c2667423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:15.063549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929aa66-0cfe-4651-a590-5e15c2667423 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:15.071101 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 806/1594] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:15.072261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9633a-1c57-4c62-b8be-1423e8e82147 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:15.075861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 789/1595] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:15.079106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929aa66-0cfe-4651-a590-5e15c2667423 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:15.089723 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9633a-1c57-4c62-b8be-1423e8e82147 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:15.095173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84075020-7ade-41e7-97de-1a336b011c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:15.096159 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929aa66-0cfe-4651-a590-5e15c2667423 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:15.096604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84075020-7ade-41e7-97de-1a336b011c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:15.096819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84075020-7ade-41e7-97de-1a336b011c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:15.097226 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84075020-7ade-41e7-97de-1a336b011c23 admin admin] PATH_INFO: `/v3/projects/c74772b4004040619568a892c7d16f49/users/5f5c69bd827c4f579437749f2eaff575/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:15.102547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8760fd5-25ed-4ab6-9fc8-c2efc4c3abd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:15.103468 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8760fd5-25ed-4ab6-9fc8-c2efc4c3abd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:15.103756 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8760fd5-25ed-4ab6-9fc8-c2efc4c3abd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:15.104074 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8760fd5-25ed-4ab6-9fc8-c2efc4c3abd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:15.109061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8760fd5-25ed-4ab6-9fc8-c2efc4c3abd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:15.109061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8760fd5-25ed-4ab6-9fc8-c2efc4c3abd2 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:15.120671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84075020-7ade-41e7-97de-1a336b011c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74772b4004040619568a892c7d16f49, user_id=5f5c69bd827c4f579437749f2eaff575, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:15.122402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 790/1596] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:15.125473 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8760fd5-25ed-4ab6-9fc8-c2efc4c3abd2 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:15.125573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84075020-7ade-41e7-97de-1a336b011c23 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:15.139122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8760fd5-25ed-4ab6-9fc8-c2efc4c3abd2 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:15.141705 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 807/1597] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:15 2022] PUT /identity/v3/projects/c74772b4004040619568a892c7d16f49/users/5f5c69bd827c4f579437749f2eaff575/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:15.142900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84075020-7ade-41e7-97de-1a336b011c23 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:15.169935 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:15.196045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:15.246408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cff12c-9896-4b9e-a9b5-cf9908d65c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:15.247405 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cff12c-9896-4b9e-a9b5-cf9908d65c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:15.247747 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cff12c-9896-4b9e-a9b5-cf9908d65c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:15.248021 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cff12c-9896-4b9e-a9b5-cf9908d65c5a admin admin] PATH_INFO: `/v3/projects/93872b0d988b4371bbf07fe28205f39b/users/d475c732f14a4a3496dca773dc2597b3/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:15.253387 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84075020-7ade-41e7-97de-1a336b011c23 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:15.261426 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8075ff8-dd9a-4a92-b0b8-685feecd70df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:15.262792 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8075ff8-dd9a-4a92-b0b8-685feecd70df admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:15.263234 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8075ff8-dd9a-4a92-b0b8-685feecd70df admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:15.263965 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8075ff8-dd9a-4a92-b0b8-685feecd70df admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:15.265385 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8075ff8-dd9a-4a92-b0b8-685feecd70df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:15.268210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8075ff8-dd9a-4a92-b0b8-685feecd70df admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:15.268553 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cff12c-9896-4b9e-a9b5-cf9908d65c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=93872b0d988b4371bbf07fe28205f39b, user_id=d475c732f14a4a3496dca773dc2597b3, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:15.272480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cff12c-9896-4b9e-a9b5-cf9908d65c5a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:15.282946 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 808/1598] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:15.284117 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8075ff8-dd9a-4a92-b0b8-685feecd70df admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:15.299732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 791/1599] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:15 2022] PUT /identity/v3/projects/93872b0d988b4371bbf07fe28205f39b/users/d475c732f14a4a3496dca773dc2597b3/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:15.301443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cff12c-9896-4b9e-a9b5-cf9908d65c5a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:15.363662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8075ff8-dd9a-4a92-b0b8-685feecd70df admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:15.390118 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cff12c-9896-4b9e-a9b5-cf9908d65c5a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:15.400587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4492b-3479-44f1-a17e-6d4d8a385cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:15.401279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4492b-3479-44f1-a17e-6d4d8a385cbb admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:15.401906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4492b-3479-44f1-a17e-6d4d8a385cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:15.401906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4492b-3479-44f1-a17e-6d4d8a385cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:15.402720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4492b-3479-44f1-a17e-6d4d8a385cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:15.404530 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4492b-3479-44f1-a17e-6d4d8a385cbb admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:15.427059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 792/1600] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:15.427059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4492b-3479-44f1-a17e-6d4d8a385cbb admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:15.441431 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4492b-3479-44f1-a17e-6d4d8a385cbb admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:15.443864 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9da79a-cb28-4ab1-99a4-d5b020062980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:15.444736 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9da79a-cb28-4ab1-99a4-d5b020062980 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:15.445176 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9da79a-cb28-4ab1-99a4-d5b020062980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:15.445666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9da79a-cb28-4ab1-99a4-d5b020062980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:15.448621 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a504eed-f9dd-402c-b1ae-8c890c3649e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:15.449350 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a504eed-f9dd-402c-b1ae-8c890c3649e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:15.449636 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a504eed-f9dd-402c-b1ae-8c890c3649e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:15.450048 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a504eed-f9dd-402c-b1ae-8c890c3649e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:15.450964 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a504eed-f9dd-402c-b1ae-8c890c3649e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:15.452825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a504eed-f9dd-402c-b1ae-8c890c3649e5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:15.458650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9da79a-cb28-4ab1-99a4-d5b020062980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:15.460360 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9da79a-cb28-4ab1-99a4-d5b020062980 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:15.472533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 793/1601] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:15.472533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a504eed-f9dd-402c-b1ae-8c890c3649e5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:15.476561 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 809/1602] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:15.478073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fc657-8b1f-45fe-b784-2f4397ed0a2e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:15.479327 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fc657-8b1f-45fe-b784-2f4397ed0a2e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:15.479800 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fc657-8b1f-45fe-b784-2f4397ed0a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:15.484846 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a504eed-f9dd-402c-b1ae-8c890c3649e5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:15.491101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8642a3-c879-48c4-9446-dccce1f8deee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:15.491891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8642a3-c879-48c4-9446-dccce1f8deee admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:15.492405 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8642a3-c879-48c4-9446-dccce1f8deee admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:15.492688 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8642a3-c879-48c4-9446-dccce1f8deee admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:15.493705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8642a3-c879-48c4-9446-dccce1f8deee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:15.496479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8642a3-c879-48c4-9446-dccce1f8deee admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:15.513734 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 794/1603] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:15.516630 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-bd4fc657-8b1f-45fe-b784-2f4397ed0a2e None None] MFA Rules not processed for user `5f5c69bd827c4f579437749f2eaff575`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:15.518490 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bd4fc657-8b1f-45fe-b784-2f4397ed0a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:15.519489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8642a3-c879-48c4-9446-dccce1f8deee admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:15.534394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8642a3-c879-48c4-9446-dccce1f8deee admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:15.543840 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663e8c1-601f-4387-92fd-a7a42d8d869c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:15.544427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663e8c1-601f-4387-92fd-a7a42d8d869c admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:15.544806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663e8c1-601f-4387-92fd-a7a42d8d869c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:15.545146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663e8c1-601f-4387-92fd-a7a42d8d869c admin admin] PATH_INFO: `/v3/projects/3490be04af0b456d9983e54b81061639/users/ee39b9dc554646d8a08713ebb0560a74/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:15.566359 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663e8c1-601f-4387-92fd-a7a42d8d869c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3490be04af0b456d9983e54b81061639, user_id=ee39b9dc554646d8a08713ebb0560a74, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:15.571640 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663e8c1-601f-4387-92fd-a7a42d8d869c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:15.590308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 795/1604] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:15 2022] PUT /identity/v3/projects/3490be04af0b456d9983e54b81061639/users/ee39b9dc554646d8a08713ebb0560a74/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:15.591973 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af7c5c-bfd6-46aa-a669-b65482d71640 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:15.592263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af7c5c-bfd6-46aa-a669-b65482d71640 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:15.592538 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af7c5c-bfd6-46aa-a669-b65482d71640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:15.627343 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c2af7c5c-bfd6-46aa-a669-b65482d71640 None None] MFA Rules not processed for user `d475c732f14a4a3496dca773dc2597b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:15.628684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c2af7c5c-bfd6-46aa-a669-b65482d71640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:15.633469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 810/1605] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:15.647493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fc657-8b1f-45fe-b784-2f4397ed0a2e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:15.673263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fc657-8b1f-45fe-b784-2f4397ed0a2e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:15.678269 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:15.710289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:15.720105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 796/1606] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:15.721115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af7c5c-bfd6-46aa-a669-b65482d71640 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:15.791618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bd5bd-8244-4247-abd3-f8a5975c28ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:15.792781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bd5bd-8244-4247-abd3-f8a5975c28ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:15.793671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bd5bd-8244-4247-abd3-f8a5975c28ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:15.794489 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bd5bd-8244-4247-abd3-f8a5975c28ce admin admin] PATH_INFO: `/v3/projects/dd80dd27997e49bd867d2cb818951ce8/users/93744e9b360945229e00791f7b55db5a/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:15.821602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320bd5bd-8244-4247-abd3-f8a5975c28ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd80dd27997e49bd867d2cb818951ce8, user_id=93744e9b360945229e00791f7b55db5a, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:15.825380 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320bd5bd-8244-4247-abd3-f8a5975c28ce admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:15.835315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af7c5c-bfd6-46aa-a669-b65482d71640 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:15.840240 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c643966-ea7f-4831-8b0e-c6c8837db422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:15.843051 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c643966-ea7f-4831-8b0e-c6c8837db422 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:15.843051 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c643966-ea7f-4831-8b0e-c6c8837db422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:15.843051 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c643966-ea7f-4831-8b0e-c6c8837db422 admin admin] PATH_INFO: `/v3/projects/ad9849b5e9d44b21841e55000dc1cd23/users/2410dc00847f42eb853780b399950899/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:15.854350 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 811/1607] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:15 2022] PUT /identity/v3/projects/dd80dd27997e49bd867d2cb818951ce8/users/93744e9b360945229e00791f7b55db5a/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:15.855143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bd5bd-8244-4247-abd3-f8a5975c28ce admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:15.861679 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c643966-ea7f-4831-8b0e-c6c8837db422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9849b5e9d44b21841e55000dc1cd23, user_id=2410dc00847f42eb853780b399950899, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:15.866421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c643966-ea7f-4831-8b0e-c6c8837db422 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:15.889895 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 797/1608] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:15 2022] PUT /identity/v3/projects/ad9849b5e9d44b21841e55000dc1cd23/users/2410dc00847f42eb853780b399950899/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:15.891904 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73c7e7-8573-41c2-8063-39b3f920ff1f None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:15.892203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73c7e7-8573-41c2-8063-39b3f920ff1f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:15.892786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73c7e7-8573-41c2-8063-39b3f920ff1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:15.932757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8b73c7e7-8573-41c2-8063-39b3f920ff1f None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:15.934968 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bd5bd-8244-4247-abd3-f8a5975c28ce admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:15.937676 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8b73c7e7-8573-41c2-8063-39b3f920ff1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:16.019336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69df61-9921-4d93-b1f7-7968c5cbc236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:16.020373 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69df61-9921-4d93-b1f7-7968c5cbc236 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:16.020781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69df61-9921-4d93-b1f7-7968c5cbc236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:16.021154 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69df61-9921-4d93-b1f7-7968c5cbc236 admin admin] PATH_INFO: `/v3/projects/a3174fc1a7c44a1b8bfb6f3370458aee/users/a55b578ccb024e57b13695ac87f1ab82/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:16.027498 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 798/1609] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:16.029193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f0832-da6d-45c3-8740-2f0985e255a0 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:16.029773 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f0832-da6d-45c3-8740-2f0985e255a0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:16.030060 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f0832-da6d-45c3-8740-2f0985e255a0 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:16.031846 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 799/1610] 10.222.0.25 () {54 vars in 962 bytes} [Tue Jul 19 12:31:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:31:16.033266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac42795-ade6-49b0-a895-685fe09bec0c None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:16.033560 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac42795-ade6-49b0-a895-685fe09bec0c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:16.033839 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac42795-ade6-49b0-a895-685fe09bec0c None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:16.041356 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69df61-9921-4d93-b1f7-7968c5cbc236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3174fc1a7c44a1b8bfb6f3370458aee, user_id=a55b578ccb024e57b13695ac87f1ab82, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:16.042420 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 800/1611] 10.222.0.25 () {54 vars in 962 bytes} [Tue Jul 19 12:31:16 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:31:16.044157 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c031b29-2c82-484d-a1cc-6f411c41963f None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:16.044454 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c031b29-2c82-484d-a1cc-6f411c41963f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:16.044980 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69df61-9921-4d93-b1f7-7968c5cbc236 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:16.045274 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c031b29-2c82-484d-a1cc-6f411c41963f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:16.079885 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 812/1612] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:15 2022] PUT /identity/v3/projects/a3174fc1a7c44a1b8bfb6f3370458aee/users/a55b578ccb024e57b13695ac87f1ab82/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:16.082048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17d73b-b731-4eeb-b430-bba811249ddb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:16.082627 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17d73b-b731-4eeb-b430-bba811249ddb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:16.083071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17d73b-b731-4eeb-b430-bba811249ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:16.096627 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-5c031b29-2c82-484d-a1cc-6f411c41963f None None] MFA Rules not processed for user `93744e9b360945229e00791f7b55db5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:16.099157 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5c031b29-2c82-484d-a1cc-6f411c41963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:16.104475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ab17d73b-b731-4eeb-b430-bba811249ddb None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:16.105801 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ab17d73b-b731-4eeb-b430-bba811249ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:16.152564 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:16.173787 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:16.187913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 801/1613] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:16.189678 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c44007-c839-4cd2-8a13-51527f3a2bdf None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:16.190383 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c44007-c839-4cd2-8a13-51527f3a2bdf None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:16.190383 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c44007-c839-4cd2-8a13-51527f3a2bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:16.202281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 813/1614] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:16.204380 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24573d64-92da-4a54-a9fb-4cc107c475da None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:16.205046 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24573d64-92da-4a54-a9fb-4cc107c475da None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:16.205615 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24573d64-92da-4a54-a9fb-4cc107c475da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:16.244307 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-31c44007-c839-4cd2-8a13-51527f3a2bdf None None] MFA Rules not processed for user `5d9543657e1e4a6d85632bf57f6ba6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:16.245795 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-31c44007-c839-4cd2-8a13-51527f3a2bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:16.255059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-24573d64-92da-4a54-a9fb-4cc107c475da None None] MFA Rules not processed for user `5d9543657e1e4a6d85632bf57f6ba6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:16.256246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-24573d64-92da-4a54-a9fb-4cc107c475da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:16.464283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 814/1615] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Jul 19 12:31:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:16.464283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24573d64-92da-4a54-a9fb-4cc107c475da None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:16.464283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-24573d64-92da-4a54-a9fb-4cc107c475da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:16.468101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 802/1616] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Jul 19 12:31:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:16.468101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7dbb4-770c-451b-9b6a-db72fb28ab4a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:16.468101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7dbb4-770c-451b-9b6a-db72fb28ab4a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:16.468101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7dbb4-770c-451b-9b6a-db72fb28ab4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:16.527302 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-60c7dbb4-770c-451b-9b6a-db72fb28ab4a None None] MFA Rules not processed for user `a55b578ccb024e57b13695ac87f1ab82`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:16.528563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-60c7dbb4-770c-451b-9b6a-db72fb28ab4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:16.569240 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24573d64-92da-4a54-a9fb-4cc107c475da None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:16.582475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a8143-fd0c-4d1d-91d0-8faf13f64a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:16.583105 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a8143-fd0c-4d1d-91d0-8faf13f64a3b service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:16.583390 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a8143-fd0c-4d1d-91d0-8faf13f64a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:16.583666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a8143-fd0c-4d1d-91d0-8faf13f64a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:16.606766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a8143-fd0c-4d1d-91d0-8faf13f64a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:16.608246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a8143-fd0c-4d1d-91d0-8faf13f64a3b service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:16.622302 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 815/1617] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:16.623197 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a8143-fd0c-4d1d-91d0-8faf13f64a3b service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:16.639232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a8143-fd0c-4d1d-91d0-8faf13f64a3b service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:16.652024 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8b565-c4fa-483c-9094-77e991b7fc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:16.652764 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8b565-c4fa-483c-9094-77e991b7fc60 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:16.653049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8b565-c4fa-483c-9094-77e991b7fc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:16.653333 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8b565-c4fa-483c-9094-77e991b7fc60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:16.654232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8b565-c4fa-483c-9094-77e991b7fc60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:16.657785 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8b565-c4fa-483c-9094-77e991b7fc60 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:16.662366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 803/1618] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:16.663826 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7dbb4-770c-451b-9b6a-db72fb28ab4a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:16.675139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7dbb4-770c-451b-9b6a-db72fb28ab4a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:16.682135 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800dd9e-55e6-4bb4-9b96-96a7f091679e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:16.685427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800dd9e-55e6-4bb4-9b96-96a7f091679e service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:16.685747 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800dd9e-55e6-4bb4-9b96-96a7f091679e service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:16.687659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800dd9e-55e6-4bb4-9b96-96a7f091679e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:16.711926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800dd9e-55e6-4bb4-9b96-96a7f091679e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:16.713468 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800dd9e-55e6-4bb4-9b96-96a7f091679e service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:16.715540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 816/1619] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:16 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:16.716508 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8b565-c4fa-483c-9094-77e991b7fc60 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:16.727247 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 804/1620] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:16.728896 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800dd9e-55e6-4bb4-9b96-96a7f091679e service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:16.747281 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800dd9e-55e6-4bb4-9b96-96a7f091679e service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:16.782435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:16.842111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8b565-c4fa-483c-9094-77e991b7fc60 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:16.853249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:16.854902 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea1707-0d38-4d42-80bf-009fb46609cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:16.856181 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea1707-0d38-4d42-80bf-009fb46609cf service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:16.856461 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea1707-0d38-4d42-80bf-009fb46609cf service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:16.856733 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea1707-0d38-4d42-80bf-009fb46609cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:16.923895 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a81a0-555b-47e8-b25d-74508a37d123 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:16.925112 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a81a0-555b-47e8-b25d-74508a37d123 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:16.927491 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a81a0-555b-47e8-b25d-74508a37d123 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:16.927906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a81a0-555b-47e8-b25d-74508a37d123 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:16.941685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea1707-0d38-4d42-80bf-009fb46609cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:16.944066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea1707-0d38-4d42-80bf-009fb46609cf service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:16.959600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 817/1621] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:16.961044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea1707-0d38-4d42-80bf-009fb46609cf service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:17.071541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a81a0-555b-47e8-b25d-74508a37d123 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:17.073178 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a81a0-555b-47e8-b25d-74508a37d123 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:17.105266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 805/1622] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:17.107798 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a81a0-555b-47e8-b25d-74508a37d123 service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:17.128847 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea1707-0d38-4d42-80bf-009fb46609cf service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:17.136510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722226d-2d18-44ff-8831-210b419c7622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:17.138276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722226d-2d18-44ff-8831-210b419c7622 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:17.139108 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722226d-2d18-44ff-8831-210b419c7622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:17.139618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722226d-2d18-44ff-8831-210b419c7622 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:17.141178 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722226d-2d18-44ff-8831-210b419c7622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:17.162645 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722226d-2d18-44ff-8831-210b419c7622 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:17.242151 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 818/1623] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:16 2022] POST /identity/v3/projects => generated 405 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:17.246620 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722226d-2d18-44ff-8831-210b419c7622 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:17.289577 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a81a0-555b-47e8-b25d-74508a37d123 service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:17.429392 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722226d-2d18-44ff-8831-210b419c7622 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:17.444949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6235d0b-cf4a-422b-8bee-a99ba5d1235a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:17.445649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6235d0b-cf4a-422b-8bee-a99ba5d1235a admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:17.445946 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6235d0b-cf4a-422b-8bee-a99ba5d1235a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:17.446202 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6235d0b-cf4a-422b-8bee-a99ba5d1235a admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:17.446966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6235d0b-cf4a-422b-8bee-a99ba5d1235a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:17.448891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6235d0b-cf4a-422b-8bee-a99ba5d1235a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:17.467950 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca157bf-c297-4331-b41b-e327902a18bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:17.474869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca157bf-c297-4331-b41b-e327902a18bf admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:17.477344 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca157bf-c297-4331-b41b-e327902a18bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:17.477344 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca157bf-c297-4331-b41b-e327902a18bf admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:17.478024 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca157bf-c297-4331-b41b-e327902a18bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:17.480190 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca157bf-c297-4331-b41b-e327902a18bf admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:17.483025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:17.509921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 819/1624] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:17 2022] POST /identity/v3/users => generated 309 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:31:17.519184 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6235d0b-cf4a-422b-8bee-a99ba5d1235a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:17.542164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 806/1625] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:17 2022] POST /identity/v3/users => generated 297 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:17.542164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca157bf-c297-4331-b41b-e327902a18bf admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:17.545741 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6235d0b-cf4a-422b-8bee-a99ba5d1235a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:17.575584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be7b23-0b85-433b-95e3-2a1ff7afe320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:17.577254 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be7b23-0b85-433b-95e3-2a1ff7afe320 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:17.577559 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be7b23-0b85-433b-95e3-2a1ff7afe320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:17.577826 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be7b23-0b85-433b-95e3-2a1ff7afe320 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:17.580636 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca157bf-c297-4331-b41b-e327902a18bf admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:17.582102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be7b23-0b85-433b-95e3-2a1ff7afe320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:17.590765 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be7b23-0b85-433b-95e3-2a1ff7afe320 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:17.602710 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747bd92-cd9a-4d6c-bdff-b11eaf5e9eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:17.603443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747bd92-cd9a-4d6c-bdff-b11eaf5e9eea admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:17.607956 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747bd92-cd9a-4d6c-bdff-b11eaf5e9eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:17.608320 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747bd92-cd9a-4d6c-bdff-b11eaf5e9eea admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:17.609106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747bd92-cd9a-4d6c-bdff-b11eaf5e9eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:17.610816 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747bd92-cd9a-4d6c-bdff-b11eaf5e9eea admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:17.639818 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 820/1626] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:31:17.646391 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be7b23-0b85-433b-95e3-2a1ff7afe320 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:17.669100 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 807/1627] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:17.672242 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747bd92-cd9a-4d6c-bdff-b11eaf5e9eea admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:17.699470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be7b23-0b85-433b-95e3-2a1ff7afe320 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:17.716968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747bd92-cd9a-4d6c-bdff-b11eaf5e9eea admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:17.718002 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a469b65-dc2f-4264-b2c6-ea48b1d69cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:17.718939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469b65-dc2f-4264-b2c6-ea48b1d69cf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:17.719222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469b65-dc2f-4264-b2c6-ea48b1d69cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:17.726087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469b65-dc2f-4264-b2c6-ea48b1d69cf3 admin admin] PATH_INFO: `/v3/projects/604bef9258104767bba5b6bd4c55962c/users/92f86782e9ea4f3395e4fe49e28b5786/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:17.745798 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8687fb-b79d-4ee2-8819-5b1c587048da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:17.750271 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8687fb-b79d-4ee2-8819-5b1c587048da admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:17.750641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8687fb-b79d-4ee2-8819-5b1c587048da admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:17.750959 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8687fb-b79d-4ee2-8819-5b1c587048da admin admin] PATH_INFO: `/v3/projects/428689c638554a7b81cf87f354540203/users/d7b159dbb8bd4a8a9457cc06815c8428/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:17.790269 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a469b65-dc2f-4264-b2c6-ea48b1d69cf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=604bef9258104767bba5b6bd4c55962c, user_id=92f86782e9ea4f3395e4fe49e28b5786, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:17.793114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:17.793257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a469b65-dc2f-4264-b2c6-ea48b1d69cf3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:17.825069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 821/1628] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:17 2022] PUT /identity/v3/projects/604bef9258104767bba5b6bd4c55962c/users/92f86782e9ea4f3395e4fe49e28b5786/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:17.825069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a266be-01b7-4a14-b4ad-11ca7f99c523 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:17.825069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a266be-01b7-4a14-b4ad-11ca7f99c523 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:17.825069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a266be-01b7-4a14-b4ad-11ca7f99c523 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:17.828814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 822/1629] 10.222.0.25 () {54 vars in 912 bytes} [Tue Jul 19 12:31:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:31:17.830050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a266be-01b7-4a14-b4ad-11ca7f99c523 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:17.836641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8687fb-b79d-4ee2-8819-5b1c587048da admin admin] RBAC: Authorizing `identity:create_grant(project_id=428689c638554a7b81cf87f354540203, user_id=d7b159dbb8bd4a8a9457cc06815c8428, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:17.852059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8687fb-b79d-4ee2-8819-5b1c587048da admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:17.904691 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 808/1630] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:17 2022] PUT /identity/v3/projects/428689c638554a7b81cf87f354540203/users/d7b159dbb8bd4a8a9457cc06815c8428/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:17.909122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f37f7-37e4-4fa7-8b31-41f1212900d7 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:17.909417 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f37f7-37e4-4fa7-8b31-41f1212900d7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:17.909701 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f37f7-37e4-4fa7-8b31-41f1212900d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:17.943781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-927f37f7-37e4-4fa7-8b31-41f1212900d7 None None] MFA Rules not processed for user `5d9543657e1e4a6d85632bf57f6ba6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:17.945814 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-927f37f7-37e4-4fa7-8b31-41f1212900d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:17.972569 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a266be-01b7-4a14-b4ad-11ca7f99c523 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:18.061473 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81615721-508c-4aff-97e8-7de7e63c135d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:18.062176 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81615721-508c-4aff-97e8-7de7e63c135d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:18.063078 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81615721-508c-4aff-97e8-7de7e63c135d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:18.063078 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81615721-508c-4aff-97e8-7de7e63c135d admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:18.063632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81615721-508c-4aff-97e8-7de7e63c135d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:18.065379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81615721-508c-4aff-97e8-7de7e63c135d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:18.077868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 809/1631] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 19 12:31:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:18.078588 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f37f7-37e4-4fa7-8b31-41f1212900d7 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:18.080595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 823/1632] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:18.089833 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45430131-fa1d-4f75-b7e7-0c7d1fba7446 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:18.090024 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45430131-fa1d-4f75-b7e7-0c7d1fba7446 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:18.090289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45430131-fa1d-4f75-b7e7-0c7d1fba7446 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:18.092755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 824/1633] 10.222.0.25 () {54 vars in 912 bytes} [Tue Jul 19 12:31:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:31:18.093289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45430131-fa1d-4f75-b7e7-0c7d1fba7446 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:18.105331 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f37f7-37e4-4fa7-8b31-41f1212900d7 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:18.109817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45430131-fa1d-4f75-b7e7-0c7d1fba7446 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:18.115751 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2906d-cf2e-4ac8-959e-2175d8d3cc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:18.116862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2906d-cf2e-4ac8-959e-2175d8d3cc93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:18.117145 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2906d-cf2e-4ac8-959e-2175d8d3cc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:18.117468 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2906d-cf2e-4ac8-959e-2175d8d3cc93 admin admin] PATH_INFO: `/v3/projects/604bef9258104767bba5b6bd4c55962c/users/92f86782e9ea4f3395e4fe49e28b5786/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:18.117672 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b789775-d291-44e6-a781-ef62f1748252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:18.119025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789775-d291-44e6-a781-ef62f1748252 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:18.119945 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2906d-cf2e-4ac8-959e-2175d8d3cc93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=604bef9258104767bba5b6bd4c55962c, user_id=92f86782e9ea4f3395e4fe49e28b5786, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:18.120485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789775-d291-44e6-a781-ef62f1748252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:18.120902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789775-d291-44e6-a781-ef62f1748252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:18.123071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2906d-cf2e-4ac8-959e-2175d8d3cc93 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:18.124670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b789775-d291-44e6-a781-ef62f1748252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:18.129127 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b789775-d291-44e6-a781-ef62f1748252 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:18.147869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 825/1634] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:18 2022] PUT /identity/v3/projects/604bef9258104767bba5b6bd4c55962c/users/92f86782e9ea4f3395e4fe49e28b5786/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:18.148960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2906d-cf2e-4ac8-959e-2175d8d3cc93 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:18.161476 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 810/1635] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:18.163545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d5370-c5c1-45ff-bdbc-2a6796bfa3c4 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:18.163851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d5370-c5c1-45ff-bdbc-2a6796bfa3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:18.165804 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d5370-c5c1-45ff-bdbc-2a6796bfa3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:18.206887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:18.208586 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-924d5370-c5c1-45ff-bdbc-2a6796bfa3c4 None None] MFA Rules not processed for user `5d9543657e1e4a6d85632bf57f6ba6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:18.211364 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-924d5370-c5c1-45ff-bdbc-2a6796bfa3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:18.218170 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2906d-cf2e-4ac8-959e-2175d8d3cc93 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:18.223569 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198915b0-0a3d-4aec-b020-c329ec5f5853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:18.224679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198915b0-0a3d-4aec-b020-c329ec5f5853 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:18.225069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198915b0-0a3d-4aec-b020-c329ec5f5853 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:18.225449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198915b0-0a3d-4aec-b020-c329ec5f5853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:18.407534 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 811/1636] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 19 12:31:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:18.417388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b209a2-7fce-4f92-926e-642769f222b0 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:18.417388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b209a2-7fce-4f92-926e-642769f222b0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:18.417388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b209a2-7fce-4f92-926e-642769f222b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:18.460327 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198915b0-0a3d-4aec-b020-c329ec5f5853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:18.461789 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198915b0-0a3d-4aec-b020-c329ec5f5853 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:18.483768 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-62b209a2-7fce-4f92-926e-642769f222b0 None None] MFA Rules not processed for user `92f86782e9ea4f3395e4fe49e28b5786`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:18.485021 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-62b209a2-7fce-4f92-926e-642769f222b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:18.490260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 826/1637] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:18.491625 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198915b0-0a3d-4aec-b020-c329ec5f5853 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:18.607268 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:18.664579 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198915b0-0a3d-4aec-b020-c329ec5f5853 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:18.674617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf106861-1d25-4c0d-bcc4-96bdec8f5b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:18.676099 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 812/1638] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:18 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:18.677647 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf106861-1d25-4c0d-bcc4-96bdec8f5b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:18.677906 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf106861-1d25-4c0d-bcc4-96bdec8f5b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:18.678196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf106861-1d25-4c0d-bcc4-96bdec8f5b78 admin admin] PATH_INFO: `/v3/projects/428689c638554a7b81cf87f354540203/users/d7b159dbb8bd4a8a9457cc06815c8428/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:18.679756 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b209a2-7fce-4f92-926e-642769f222b0 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:18.689798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf106861-1d25-4c0d-bcc4-96bdec8f5b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=428689c638554a7b81cf87f354540203, user_id=d7b159dbb8bd4a8a9457cc06815c8428, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:18.708088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf106861-1d25-4c0d-bcc4-96bdec8f5b78 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:18.715957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b209a2-7fce-4f92-926e-642769f222b0 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:18.727709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58b5b2-cb0f-49e2-847c-e21836c71803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:18.729531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58b5b2-cb0f-49e2-847c-e21836c71803 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:18.736905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58b5b2-cb0f-49e2-847c-e21836c71803 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:18.736905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58b5b2-cb0f-49e2-847c-e21836c71803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:18.746746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 827/1639] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:18 2022] PUT /identity/v3/projects/428689c638554a7b81cf87f354540203/users/d7b159dbb8bd4a8a9457cc06815c8428/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:18.747842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf106861-1d25-4c0d-bcc4-96bdec8f5b78 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:18.767638 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58b5b2-cb0f-49e2-847c-e21836c71803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:18.771828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58b5b2-cb0f-49e2-847c-e21836c71803 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:18.810527 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 813/1640] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:18.814907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14648a-be58-49a8-ad51-a925e03ba293 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:18.815213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14648a-be58-49a8-ad51-a925e03ba293 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:18.815496 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14648a-be58-49a8-ad51-a925e03ba293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:18.859423 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf106861-1d25-4c0d-bcc4-96bdec8f5b78 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:18.869742 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fedfe-db38-4fdc-9955-cd1c2598d9a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:18.871476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fedfe-db38-4fdc-9955-cd1c2598d9a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:18.871759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fedfe-db38-4fdc-9955-cd1c2598d9a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:18.872036 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fedfe-db38-4fdc-9955-cd1c2598d9a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:18.877649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7f14648a-be58-49a8-ad51-a925e03ba293 None None] MFA Rules not processed for user `d7b159dbb8bd4a8a9457cc06815c8428`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:18.881908 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7f14648a-be58-49a8-ad51-a925e03ba293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:19.005164 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:19.102559 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fedfe-db38-4fdc-9955-cd1c2598d9a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:19.104091 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fedfe-db38-4fdc-9955-cd1c2598d9a6 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:19.136995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 828/1641] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:18 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:19.138296 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 814/1642] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:19.339839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fedfe-db38-4fdc-9955-cd1c2598d9a6 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:19.353578 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fedfe-db38-4fdc-9955-cd1c2598d9a6 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:19.375239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f82471-eca6-40ca-bd12-a6b850e7bfdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:19.375848 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f82471-eca6-40ca-bd12-a6b850e7bfdd service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:19.376130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f82471-eca6-40ca-bd12-a6b850e7bfdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:19.376406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f82471-eca6-40ca-bd12-a6b850e7bfdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:19.406198 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f82471-eca6-40ca-bd12-a6b850e7bfdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:19.410517 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f82471-eca6-40ca-bd12-a6b850e7bfdd service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:19.455659 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 829/1643] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:31:19.646231 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14648a-be58-49a8-ad51-a925e03ba293 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:19.809623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f82471-eca6-40ca-bd12-a6b850e7bfdd service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:19.831266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14648a-be58-49a8-ad51-a925e03ba293 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:19.834363 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f82471-eca6-40ca-bd12-a6b850e7bfdd service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:19.850996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e89a0-bf7b-41a8-8208-9263f7793bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:19.851853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9a98f-82e1-427e-8475-c0a12320bc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:19.854200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9a98f-82e1-427e-8475-c0a12320bc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:19.854703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e89a0-bf7b-41a8-8208-9263f7793bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:19.855400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9a98f-82e1-427e-8475-c0a12320bc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:19.855400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9a98f-82e1-427e-8475-c0a12320bc29 admin admin] PATH_INFO: `/v3/users/d475c732f14a4a3496dca773dc2597b3` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:19.857367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e89a0-bf7b-41a8-8208-9263f7793bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:19.858953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e89a0-bf7b-41a8-8208-9263f7793bef admin admin] PATH_INFO: `/v3/users/a55b578ccb024e57b13695ac87f1ab82` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:19.862212 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e89a0-bf7b-41a8-8208-9263f7793bef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a55b578ccb024e57b13695ac87f1ab82)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:19.862977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9a98f-82e1-427e-8475-c0a12320bc29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d475c732f14a4a3496dca773dc2597b3)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:19.865379 dv-cinder-820994-4-smb devstack@keystone.service[80230]: WARNING py.warnings [None req-c9e9a98f-82e1-427e-8475-c0a12320bc29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:31:19.865379 dv-cinder-820994-4-smb devstack@keystone.service[80230]: warnings.warn(msg) Jul 19 12:31:19.865379 dv-cinder-820994-4-smb devstack@keystone.service[80230]: Jul 19 12:31:19.870452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9a98f-82e1-427e-8475-c0a12320bc29 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:19.871969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e89a0-bf7b-41a8-8208-9263f7793bef admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:20.063367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d11e89a0-bf7b-41a8-8208-9263f7793bef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55b578ccb024e57b13695ac87f1ab82'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:20.071386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c9e9a98f-82e1-427e-8475-c0a12320bc29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd475c732f14a4a3496dca773dc2597b3'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:20.073120 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d11e89a0-bf7b-41a8-8208-9263f7793bef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55b578ccb024e57b13695ac87f1ab82'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:20.090520 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c9e9a98f-82e1-427e-8475-c0a12320bc29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd475c732f14a4a3496dca773dc2597b3'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:20.095183 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d11e89a0-bf7b-41a8-8208-9263f7793bef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55b578ccb024e57b13695ac87f1ab82'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:20.117307 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:20.131511 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d11e89a0-bf7b-41a8-8208-9263f7793bef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55b578ccb024e57b13695ac87f1ab82'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:20.132280 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d11e89a0-bf7b-41a8-8208-9263f7793bef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55b578ccb024e57b13695ac87f1ab82'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:20.157887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 830/1644] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:31:19 2022] DELETE /identity/v3/users/a55b578ccb024e57b13695ac87f1ab82 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:31:20.171999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84f815-f8d9-45e6-af27-e84a149a7e31 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:20.171999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84f815-f8d9-45e6-af27-e84a149a7e31 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:20.171999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84f815-f8d9-45e6-af27-e84a149a7e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:20.177546 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c9e9a98f-82e1-427e-8475-c0a12320bc29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd475c732f14a4a3496dca773dc2597b3'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:20.209100 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c9e9a98f-82e1-427e-8475-c0a12320bc29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd475c732f14a4a3496dca773dc2597b3'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:20.209752 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c9e9a98f-82e1-427e-8475-c0a12320bc29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd475c732f14a4a3496dca773dc2597b3'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:20.233453 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-db84f815-f8d9-45e6-af27-e84a149a7e31 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:20.239464 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 815/1645] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:31:19 2022] DELETE /identity/v3/users/d475c732f14a4a3496dca773dc2597b3 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:20.244873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-db84f815-f8d9-45e6-af27-e84a149a7e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:20.248725 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80903324-fb0d-4564-88b7-d9e7eddc1c4e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:20.249141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80903324-fb0d-4564-88b7-d9e7eddc1c4e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:20.252638 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80903324-fb0d-4564-88b7-d9e7eddc1c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:20.292405 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-80903324-fb0d-4564-88b7-d9e7eddc1c4e None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:20.294002 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-80903324-fb0d-4564-88b7-d9e7eddc1c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:20.402815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 816/1646] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:20.421226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80903324-fb0d-4564-88b7-d9e7eddc1c4e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:20.422998 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-80903324-fb0d-4564-88b7-d9e7eddc1c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:20.502513 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 831/1647] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:20.528630 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16092d2a-8bd1-43b3-bc81-b86dbe85789f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:20.528920 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16092d2a-8bd1-43b3-bc81-b86dbe85789f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:20.529193 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16092d2a-8bd1-43b3-bc81-b86dbe85789f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:20.579677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80903324-fb0d-4564-88b7-d9e7eddc1c4e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:20.586937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-16092d2a-8bd1-43b3-bc81-b86dbe85789f None None] MFA Rules not processed for user `ee39b9dc554646d8a08713ebb0560a74`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:20.588257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-16092d2a-8bd1-43b3-bc81-b86dbe85789f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:20.603126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc75c35-ee18-43cb-a03a-e1887974a783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:20.603278 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc75c35-ee18-43cb-a03a-e1887974a783 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:20.603554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc75c35-ee18-43cb-a03a-e1887974a783 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:20.603827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc75c35-ee18-43cb-a03a-e1887974a783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:20.627600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:20.634177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc75c35-ee18-43cb-a03a-e1887974a783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:20.635640 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc75c35-ee18-43cb-a03a-e1887974a783 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:20.666064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 817/1648] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:20.667073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc75c35-ee18-43cb-a03a-e1887974a783 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:20.689869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc75c35-ee18-43cb-a03a-e1887974a783 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:20.710785 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7bcfd-7d25-40dc-921e-5fbd0275e296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:20.711472 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7bcfd-7d25-40dc-921e-5fbd0275e296 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:20.711757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7bcfd-7d25-40dc-921e-5fbd0275e296 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:20.712018 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7bcfd-7d25-40dc-921e-5fbd0275e296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:20.750857 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7bcfd-7d25-40dc-921e-5fbd0275e296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:20.752329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7bcfd-7d25-40dc-921e-5fbd0275e296 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:20.771635 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 832/1649] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:20 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:31:20.772705 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16092d2a-8bd1-43b3-bc81-b86dbe85789f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:20.776759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-16092d2a-8bd1-43b3-bc81-b86dbe85789f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:20.795324 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 818/1650] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:20.811610 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16092d2a-8bd1-43b3-bc81-b86dbe85789f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:20.826612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662eab59-3496-4cf0-9610-29a0d5ba6897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:20.827323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eab59-3496-4cf0-9610-29a0d5ba6897 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:20.827605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eab59-3496-4cf0-9610-29a0d5ba6897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:20.827876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eab59-3496-4cf0-9610-29a0d5ba6897 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:20.828937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662eab59-3496-4cf0-9610-29a0d5ba6897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:20.830663 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662eab59-3496-4cf0-9610-29a0d5ba6897 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:20.832884 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7bcfd-7d25-40dc-921e-5fbd0275e296 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:20.834939 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1bf7bcfd-7d25-40dc-921e-5fbd0275e296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:20.853790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7bcfd-7d25-40dc-921e-5fbd0275e296 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:20.873857 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf499c76-d592-4ec6-aaf6-545b3c584ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:20.877241 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf499c76-d592-4ec6-aaf6-545b3c584ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:20.877514 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf499c76-d592-4ec6-aaf6-545b3c584ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:20.881794 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf499c76-d592-4ec6-aaf6-545b3c584ce5 admin admin] PATH_INFO: `/v3/users/93744e9b360945229e00791f7b55db5a` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:20.888849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 833/1651] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:20 2022] POST /identity/v3/projects => generated 403 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:20.889419 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf499c76-d592-4ec6-aaf6-545b3c584ce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93744e9b360945229e00791f7b55db5a)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:20.894666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662eab59-3496-4cf0-9610-29a0d5ba6897 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:20.896822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf499c76-d592-4ec6-aaf6-545b3c584ce5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:21.044947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bf499c76-d592-4ec6-aaf6-545b3c584ce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93744e9b360945229e00791f7b55db5a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:21.059804 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662eab59-3496-4cf0-9610-29a0d5ba6897 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:21.076177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bf499c76-d592-4ec6-aaf6-545b3c584ce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93744e9b360945229e00791f7b55db5a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:21.082197 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e7d1a-1c02-41f2-8f6f-365334f5077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:21.083887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e7d1a-1c02-41f2-8f6f-365334f5077b admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:21.084699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e7d1a-1c02-41f2-8f6f-365334f5077b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:21.084699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e7d1a-1c02-41f2-8f6f-365334f5077b admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:21.085115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e7d1a-1c02-41f2-8f6f-365334f5077b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:21.087139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e7d1a-1c02-41f2-8f6f-365334f5077b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:21.089469 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:21.114479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bf499c76-d592-4ec6-aaf6-545b3c584ce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93744e9b360945229e00791f7b55db5a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:21.138693 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bf499c76-d592-4ec6-aaf6-545b3c584ce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93744e9b360945229e00791f7b55db5a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:21.139384 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bf499c76-d592-4ec6-aaf6-545b3c584ce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93744e9b360945229e00791f7b55db5a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:21.147445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 819/1652] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:31:20 2022] DELETE /identity/v3/users/93744e9b360945229e00791f7b55db5a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:31:21.152076 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de41440-b7f9-447b-b9bd-3601ab76367d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:21.152371 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de41440-b7f9-447b-b9bd-3601ab76367d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:21.152650 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de41440-b7f9-447b-b9bd-3601ab76367d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:21.217777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 834/1653] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:20 2022] POST /identity/v3/users => generated 308 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:21.221447 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e7d1a-1c02-41f2-8f6f-365334f5077b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:21.223861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a11e7d1a-1c02-41f2-8f6f-365334f5077b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:21.233357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2de41440-b7f9-447b-b9bd-3601ab76367d None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:21.241002 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2de41440-b7f9-447b-b9bd-3601ab76367d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:21.298045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e7d1a-1c02-41f2-8f6f-365334f5077b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:21.471744 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb49d9b-10f7-4db5-ac0e-467cff53a3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:21.473230 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb49d9b-10f7-4db5-ac0e-467cff53a3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:21.473875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb49d9b-10f7-4db5-ac0e-467cff53a3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:21.474359 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb49d9b-10f7-4db5-ac0e-467cff53a3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:21.475613 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb49d9b-10f7-4db5-ac0e-467cff53a3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:21.478095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb49d9b-10f7-4db5-ac0e-467cff53a3f3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:21.485618 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 820/1654] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:31:21.505449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 835/1655] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:31:21.506018 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de41440-b7f9-447b-b9bd-3601ab76367d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:21.521185 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de41440-b7f9-447b-b9bd-3601ab76367d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:21.535073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27841628-904b-4c59-9068-49671a266639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:21.536213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27841628-904b-4c59-9068-49671a266639 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:21.537651 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27841628-904b-4c59-9068-49671a266639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:21.537940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27841628-904b-4c59-9068-49671a266639 admin admin] PATH_INFO: `/v3/projects/8d1c559a773841819e14aa7b0d54d74f/users/75a7facec5664d00ae1e78678f548598/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:21.572227 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb49d9b-10f7-4db5-ac0e-467cff53a3f3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:21.575123 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ecb49d9b-10f7-4db5-ac0e-467cff53a3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:21.581500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27841628-904b-4c59-9068-49671a266639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1c559a773841819e14aa7b0d54d74f, user_id=75a7facec5664d00ae1e78678f548598, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:21.586828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27841628-904b-4c59-9068-49671a266639 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:21.625359 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 821/1656] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:21 2022] PUT /identity/v3/projects/8d1c559a773841819e14aa7b0d54d74f/users/75a7facec5664d00ae1e78678f548598/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:21.626956 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27841628-904b-4c59-9068-49671a266639 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:21.639152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:21.733068 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb49d9b-10f7-4db5-ac0e-467cff53a3f3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:21.800182 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27841628-904b-4c59-9068-49671a266639 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:21.816234 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b51da-c397-483c-81c4-5acc04fd2341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:21.817695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b51da-c397-483c-81c4-5acc04fd2341 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:21.819122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b51da-c397-483c-81c4-5acc04fd2341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:21.819569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b51da-c397-483c-81c4-5acc04fd2341 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:21.822041 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b51da-c397-483c-81c4-5acc04fd2341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:21.826905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b51da-c397-483c-81c4-5acc04fd2341 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:21.857313 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 822/1657] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:21.858229 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b51da-c397-483c-81c4-5acc04fd2341 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:21.886936 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b51da-c397-483c-81c4-5acc04fd2341 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:21.891770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2fa81-7082-44e1-bd89-be4bca1fda53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:21.893639 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2fa81-7082-44e1-bd89-be4bca1fda53 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:21.896414 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2fa81-7082-44e1-bd89-be4bca1fda53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:21.896968 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2fa81-7082-44e1-bd89-be4bca1fda53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:21.905286 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc2ef0-65ea-4d8f-9c3c-fc55ed93ab99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:21.908071 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc2ef0-65ea-4d8f-9c3c-fc55ed93ab99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:21.910611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2fa81-7082-44e1-bd89-be4bca1fda53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:21.911080 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc2ef0-65ea-4d8f-9c3c-fc55ed93ab99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:21.911981 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc2ef0-65ea-4d8f-9c3c-fc55ed93ab99 admin admin] PATH_INFO: `/v3/projects/8d1c559a773841819e14aa7b0d54d74f/users/75a7facec5664d00ae1e78678f548598/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:21.913291 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2fa81-7082-44e1-bd89-be4bca1fda53 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:21.917364 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc2ef0-65ea-4d8f-9c3c-fc55ed93ab99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1c559a773841819e14aa7b0d54d74f, user_id=75a7facec5664d00ae1e78678f548598, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:21.926385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc2ef0-65ea-4d8f-9c3c-fc55ed93ab99 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:21.931342 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 836/1658] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:21.972074 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 823/1659] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:21 2022] PUT /identity/v3/projects/8d1c559a773841819e14aa7b0d54d74f/users/75a7facec5664d00ae1e78678f548598/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:22.662765 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2fa81-7082-44e1-bd89-be4bca1fda53 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:22.664761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-97c2fa81-7082-44e1-bd89-be4bca1fda53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:22.717131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2fa81-7082-44e1-bd89-be4bca1fda53 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:22.824336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342e003-2c9f-45cf-b3bc-74ebeff96b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:22.825722 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342e003-2c9f-45cf-b3bc-74ebeff96b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:22.826199 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342e003-2c9f-45cf-b3bc-74ebeff96b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:22.826609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342e003-2c9f-45cf-b3bc-74ebeff96b13 admin admin] PATH_INFO: `/v3/projects/a3174fc1a7c44a1b8bfb6f3370458aee` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:22.828528 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342e003-2c9f-45cf-b3bc-74ebeff96b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3174fc1a7c44a1b8bfb6f3370458aee)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:22.831979 dv-cinder-820994-4-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-0342e003-2c9f-45cf-b3bc-74ebeff96b13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 12:31:22.831979 dv-cinder-820994-4-smb devstack@keystone.service[80231]: warnings.warn(msg) Jul 19 12:31:22.831979 dv-cinder-820994-4-smb devstack@keystone.service[80231]: Jul 19 12:31:22.835538 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342e003-2c9f-45cf-b3bc-74ebeff96b13 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:22.952974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0342e003-2c9f-45cf-b3bc-74ebeff96b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3174fc1a7c44a1b8bfb6f3370458aee', 'request_id': 'req-0342e003-2c9f-45cf-b3bc-74ebeff96b13'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:22.965728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0342e003-2c9f-45cf-b3bc-74ebeff96b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3174fc1a7c44a1b8bfb6f3370458aee', 'request_id': 'req-0342e003-2c9f-45cf-b3bc-74ebeff96b13'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:22.981088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0342e003-2c9f-45cf-b3bc-74ebeff96b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3174fc1a7c44a1b8bfb6f3370458aee', 'request_id': 'req-0342e003-2c9f-45cf-b3bc-74ebeff96b13'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:23.022873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0342e003-2c9f-45cf-b3bc-74ebeff96b13 admin admin] The token cache is being invalidate because project a3174fc1a7c44a1b8bfb6f3370458aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:31:23.023168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0342e003-2c9f-45cf-b3bc-74ebeff96b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:23.023970 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0342e003-2c9f-45cf-b3bc-74ebeff96b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:23.026140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 837/1660] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:31:22 2022] DELETE /identity/v3/projects/a3174fc1a7c44a1b8bfb6f3370458aee => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:23.034952 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc2ef0-65ea-4d8f-9c3c-fc55ed93ab99 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:23.039908 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b3bc2ef0-65ea-4d8f-9c3c-fc55ed93ab99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:23.093465 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc2ef0-65ea-4d8f-9c3c-fc55ed93ab99 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:23.193992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:23.271238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49495c5-cf85-406d-80c3-59026f1ae084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:23.273535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49495c5-cf85-406d-80c3-59026f1ae084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:23.273975 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49495c5-cf85-406d-80c3-59026f1ae084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:23.274395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49495c5-cf85-406d-80c3-59026f1ae084 admin admin] PATH_INFO: `/v3/users/92f86782e9ea4f3395e4fe49e28b5786` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:23.276483 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49495c5-cf85-406d-80c3-59026f1ae084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f86782e9ea4f3395e4fe49e28b5786)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:23.279852 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49495c5-cf85-406d-80c3-59026f1ae084 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:23.382035 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b49495c5-cf85-406d-80c3-59026f1ae084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f86782e9ea4f3395e4fe49e28b5786'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:23.418437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b49495c5-cf85-406d-80c3-59026f1ae084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f86782e9ea4f3395e4fe49e28b5786'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:23.434173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b49495c5-cf85-406d-80c3-59026f1ae084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f86782e9ea4f3395e4fe49e28b5786'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:23.460088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b49495c5-cf85-406d-80c3-59026f1ae084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f86782e9ea4f3395e4fe49e28b5786'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:23.460814 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b49495c5-cf85-406d-80c3-59026f1ae084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f86782e9ea4f3395e4fe49e28b5786'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:23.479468 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 824/1661] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:31:23 2022] DELETE /identity/v3/users/92f86782e9ea4f3395e4fe49e28b5786 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:23.868939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342e003-2c9f-45cf-b3bc-74ebeff96b13 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:23.874336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0342e003-2c9f-45cf-b3bc-74ebeff96b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:23.949406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342e003-2c9f-45cf-b3bc-74ebeff96b13 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:23.973589 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:24.084951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9b783-d007-4621-b1cc-1cbe67b5ece6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:24.085852 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b783-d007-4621-b1cc-1cbe67b5ece6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:24.087656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b783-d007-4621-b1cc-1cbe67b5ece6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:24.088361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b783-d007-4621-b1cc-1cbe67b5ece6 admin admin] PATH_INFO: `/v3/projects/93872b0d988b4371bbf07fe28205f39b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:24.091643 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9b783-d007-4621-b1cc-1cbe67b5ece6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93872b0d988b4371bbf07fe28205f39b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:24.095777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9b783-d007-4621-b1cc-1cbe67b5ece6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:24.168783 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49495c5-cf85-406d-80c3-59026f1ae084 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:24.170340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b49495c5-cf85-406d-80c3-59026f1ae084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:24.205279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49495c5-cf85-406d-80c3-59026f1ae084 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:24.219642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206f7a8-1dad-4443-b202-d137e4e6252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:24.221056 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206f7a8-1dad-4443-b202-d137e4e6252e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:24.221410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206f7a8-1dad-4443-b202-d137e4e6252e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:24.221890 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206f7a8-1dad-4443-b202-d137e4e6252e admin admin] PATH_INFO: `/v3/projects/dd80dd27997e49bd867d2cb818951ce8` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:24.224610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206f7a8-1dad-4443-b202-d137e4e6252e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd80dd27997e49bd867d2cb818951ce8)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:24.247471 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3ef9b783-d007-4621-b1cc-1cbe67b5ece6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93872b0d988b4371bbf07fe28205f39b', 'request_id': 'req-3ef9b783-d007-4621-b1cc-1cbe67b5ece6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:24.254787 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206f7a8-1dad-4443-b202-d137e4e6252e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:24.262848 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3ef9b783-d007-4621-b1cc-1cbe67b5ece6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93872b0d988b4371bbf07fe28205f39b', 'request_id': 'req-3ef9b783-d007-4621-b1cc-1cbe67b5ece6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:24.274750 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3ef9b783-d007-4621-b1cc-1cbe67b5ece6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93872b0d988b4371bbf07fe28205f39b', 'request_id': 'req-3ef9b783-d007-4621-b1cc-1cbe67b5ece6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:24.321483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3ef9b783-d007-4621-b1cc-1cbe67b5ece6 admin admin] The token cache is being invalidate because project 93872b0d988b4371bbf07fe28205f39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:31:24.321778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3ef9b783-d007-4621-b1cc-1cbe67b5ece6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:24.323629 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3ef9b783-d007-4621-b1cc-1cbe67b5ece6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:24.327806 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 838/1662] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:31:23 2022] DELETE /identity/v3/projects/93872b0d988b4371bbf07fe28205f39b => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:24.329483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c2e93-5330-4792-8d74-30fb2e35f48e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:24.329781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c2e93-5330-4792-8d74-30fb2e35f48e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:24.330068 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c2e93-5330-4792-8d74-30fb2e35f48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:24.363957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f23c2e93-5330-4792-8d74-30fb2e35f48e None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:24.365208 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f23c2e93-5330-4792-8d74-30fb2e35f48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:24.391857 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1206f7a8-1dad-4443-b202-d137e4e6252e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd80dd27997e49bd867d2cb818951ce8', 'request_id': 'req-1206f7a8-1dad-4443-b202-d137e4e6252e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:24.415197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1206f7a8-1dad-4443-b202-d137e4e6252e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd80dd27997e49bd867d2cb818951ce8', 'request_id': 'req-1206f7a8-1dad-4443-b202-d137e4e6252e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:24.435827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1206f7a8-1dad-4443-b202-d137e4e6252e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd80dd27997e49bd867d2cb818951ce8', 'request_id': 'req-1206f7a8-1dad-4443-b202-d137e4e6252e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:24.467967 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1206f7a8-1dad-4443-b202-d137e4e6252e admin admin] The token cache is being invalidate because project dd80dd27997e49bd867d2cb818951ce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:31:24.469058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1206f7a8-1dad-4443-b202-d137e4e6252e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:24.473035 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1206f7a8-1dad-4443-b202-d137e4e6252e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:24.475112 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 825/1663] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:31:24 2022] DELETE /identity/v3/projects/dd80dd27997e49bd867d2cb818951ce8 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:24.478686 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206f7a8-1dad-4443-b202-d137e4e6252e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:24.485740 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1206f7a8-1dad-4443-b202-d137e4e6252e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:24.524925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 839/1664] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:31:24.531429 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41088d45-632e-46a8-8474-c8a28f860210 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:24.531722 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41088d45-632e-46a8-8474-c8a28f860210 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:24.532001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41088d45-632e-46a8-8474-c8a28f860210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:24.572095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-41088d45-632e-46a8-8474-c8a28f860210 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:24.574099 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-41088d45-632e-46a8-8474-c8a28f860210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:24.592631 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:24.599900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 840/1665] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:24.601124 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41088d45-632e-46a8-8474-c8a28f860210 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:24.616339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41088d45-632e-46a8-8474-c8a28f860210 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:24.623210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875638a4-b763-49c5-8c70-1c318d9b9f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:24.623897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875638a4-b763-49c5-8c70-1c318d9b9f8f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:24.624231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875638a4-b763-49c5-8c70-1c318d9b9f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:24.624513 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875638a4-b763-49c5-8c70-1c318d9b9f8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:24.625248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875638a4-b763-49c5-8c70-1c318d9b9f8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:31:24.625553 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875638a4-b763-49c5-8c70-1c318d9b9f8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:24.627220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875638a4-b763-49c5-8c70-1c318d9b9f8f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:24.662841 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206f7a8-1dad-4443-b202-d137e4e6252e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:24.676084 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 841/1666] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:31:24.677973 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ca59a-1344-4635-831f-b621258fa86a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:24.678472 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ca59a-1344-4635-831f-b621258fa86a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:24.679018 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ca59a-1344-4635-831f-b621258fa86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:24.679966 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8f589-b3ab-4ebc-b32b-1a6b4ad48b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:24.680893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8f589-b3ab-4ebc-b32b-1a6b4ad48b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:24.681250 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8f589-b3ab-4ebc-b32b-1a6b4ad48b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:24.681534 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8f589-b3ab-4ebc-b32b-1a6b4ad48b19 admin admin] PATH_INFO: `/v3/users/d7b159dbb8bd4a8a9457cc06815c8428` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:24.688685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8f589-b3ab-4ebc-b32b-1a6b4ad48b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b159dbb8bd4a8a9457cc06815c8428)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:24.691366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8f589-b3ab-4ebc-b32b-1a6b4ad48b19 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:24.768754 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e01ca59a-1344-4635-831f-b621258fa86a None None] MFA Rules not processed for user `6575cc39f6a1466691f15625e15fc199`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:24.770032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e01ca59a-1344-4635-831f-b621258fa86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:24.780965 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:24.796569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8de8f589-b3ab-4ebc-b32b-1a6b4ad48b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b159dbb8bd4a8a9457cc06815c8428'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:24.810416 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8de8f589-b3ab-4ebc-b32b-1a6b4ad48b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b159dbb8bd4a8a9457cc06815c8428'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:24.847494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8de8f589-b3ab-4ebc-b32b-1a6b4ad48b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b159dbb8bd4a8a9457cc06815c8428'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:24.868311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8de8f589-b3ab-4ebc-b32b-1a6b4ad48b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b159dbb8bd4a8a9457cc06815c8428'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:24.870102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8de8f589-b3ab-4ebc-b32b-1a6b4ad48b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b159dbb8bd4a8a9457cc06815c8428'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:24.892848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 826/1667] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:31:24 2022] DELETE /identity/v3/users/d7b159dbb8bd4a8a9457cc06815c8428 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:24.893761 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8f589-b3ab-4ebc-b32b-1a6b4ad48b19 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:24.902825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8de8f589-b3ab-4ebc-b32b-1a6b4ad48b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:24.951602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 842/1668] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:24.965388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ca59a-1344-4635-831f-b621258fa86a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:24.973535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e01ca59a-1344-4635-831f-b621258fa86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:25.007267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ca59a-1344-4635-831f-b621258fa86a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:25.089886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8f589-b3ab-4ebc-b32b-1a6b4ad48b19 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:25.111775 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140ebaa-8d77-4dc2-9b78-de2c8cc85967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:25.111775 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140ebaa-8d77-4dc2-9b78-de2c8cc85967 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:25.111775 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140ebaa-8d77-4dc2-9b78-de2c8cc85967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:25.111775 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140ebaa-8d77-4dc2-9b78-de2c8cc85967 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:25.112689 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140ebaa-8d77-4dc2-9b78-de2c8cc85967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:25.115373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140ebaa-8d77-4dc2-9b78-de2c8cc85967 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:25.152398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225bb35-e56c-48e5-9326-b836a52d35ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:25.154087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225bb35-e56c-48e5-9326-b836a52d35ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:25.154087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225bb35-e56c-48e5-9326-b836a52d35ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:25.154087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225bb35-e56c-48e5-9326-b836a52d35ac admin admin] PATH_INFO: `/v3/projects/604bef9258104767bba5b6bd4c55962c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:25.155331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225bb35-e56c-48e5-9326-b836a52d35ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=604bef9258104767bba5b6bd4c55962c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:25.157377 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225bb35-e56c-48e5-9326-b836a52d35ac admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:25.173817 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 827/1669] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:24 2022] POST /identity/v3/projects => generated 373 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:25.178009 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb3f60-2dd2-40b8-afc6-3802981452a5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:25.178009 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb3f60-2dd2-40b8-afc6-3802981452a5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:25.178009 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb3f60-2dd2-40b8-afc6-3802981452a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:25.208040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-bfeb3f60-2dd2-40b8-afc6-3802981452a5 None None] MFA Rules not processed for user `6575cc39f6a1466691f15625e15fc199`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:25.208040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bfeb3f60-2dd2-40b8-afc6-3802981452a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:25.308210 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:25.309356 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a225bb35-e56c-48e5-9326-b836a52d35ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '604bef9258104767bba5b6bd4c55962c', 'request_id': 'req-a225bb35-e56c-48e5-9326-b836a52d35ac'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:25.319618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a225bb35-e56c-48e5-9326-b836a52d35ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '604bef9258104767bba5b6bd4c55962c', 'request_id': 'req-a225bb35-e56c-48e5-9326-b836a52d35ac'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:25.334568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a225bb35-e56c-48e5-9326-b836a52d35ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '604bef9258104767bba5b6bd4c55962c', 'request_id': 'req-a225bb35-e56c-48e5-9326-b836a52d35ac'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:25.352628 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 828/1670] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:25.353653 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb3f60-2dd2-40b8-afc6-3802981452a5 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:25.354674 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a225bb35-e56c-48e5-9326-b836a52d35ac admin admin] The token cache is being invalidate because project 604bef9258104767bba5b6bd4c55962c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:31:25.355787 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a225bb35-e56c-48e5-9326-b836a52d35ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:25.356776 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bfeb3f60-2dd2-40b8-afc6-3802981452a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:25.358651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a225bb35-e56c-48e5-9326-b836a52d35ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:25.361725 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 843/1671] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:31:24 2022] DELETE /identity/v3/projects/604bef9258104767bba5b6bd4c55962c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:25.363865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225bb35-e56c-48e5-9326-b836a52d35ac admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:25.365516 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a225bb35-e56c-48e5-9326-b836a52d35ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:25.456212 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:25.486663 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225bb35-e56c-48e5-9326-b836a52d35ac admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:25.493841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b178db-a642-472b-9a84-c88707bab5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:25.495000 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b178db-a642-472b-9a84-c88707bab5be admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:25.496501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b178db-a642-472b-9a84-c88707bab5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:25.497454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b178db-a642-472b-9a84-c88707bab5be admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:25.499238 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b178db-a642-472b-9a84-c88707bab5be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:25.502586 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb3f60-2dd2-40b8-afc6-3802981452a5 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:25.505787 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b178db-a642-472b-9a84-c88707bab5be admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:25.520807 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e4489-8a59-4ad4-9878-48da2eec6e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:25.521723 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e4489-8a59-4ad4-9878-48da2eec6e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:25.522114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e4489-8a59-4ad4-9878-48da2eec6e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:25.522503 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e4489-8a59-4ad4-9878-48da2eec6e7f admin admin] PATH_INFO: `/v3/users/5f5c69bd827c4f579437749f2eaff575` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:25.524979 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e4489-8a59-4ad4-9878-48da2eec6e7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f5c69bd827c4f579437749f2eaff575)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:25.527106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e4489-8a59-4ad4-9878-48da2eec6e7f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:25.549560 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 844/1672] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:25 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:25.550309 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4ced9-5aae-477f-ae77-becfd6e5bfb8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:25.550707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4ced9-5aae-477f-ae77-becfd6e5bfb8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:25.552168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4ced9-5aae-477f-ae77-becfd6e5bfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:25.595126 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-69a4ced9-5aae-477f-ae77-becfd6e5bfb8 None None] MFA Rules not processed for user `75a7facec5664d00ae1e78678f548598`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:25.596928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-69a4ced9-5aae-477f-ae77-becfd6e5bfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:25.613213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8c8e4489-8a59-4ad4-9878-48da2eec6e7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f5c69bd827c4f579437749f2eaff575'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:25.623809 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8c8e4489-8a59-4ad4-9878-48da2eec6e7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f5c69bd827c4f579437749f2eaff575'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:25.641737 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8c8e4489-8a59-4ad4-9878-48da2eec6e7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f5c69bd827c4f579437749f2eaff575'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:25.652901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8c8e4489-8a59-4ad4-9878-48da2eec6e7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f5c69bd827c4f579437749f2eaff575'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:25.654048 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8c8e4489-8a59-4ad4-9878-48da2eec6e7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f5c69bd827c4f579437749f2eaff575'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:25.663466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 829/1673] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:31:25 2022] DELETE /identity/v3/users/5f5c69bd827c4f579437749f2eaff575 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:25.664774 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e4489-8a59-4ad4-9878-48da2eec6e7f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:25.667220 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8c8e4489-8a59-4ad4-9878-48da2eec6e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:25.829876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 845/1674] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:25.832039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7047e7-f93d-460b-8d2a-8005ce177775 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:25.832362 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7047e7-f93d-460b-8d2a-8005ce177775 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:25.832639 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7047e7-f93d-460b-8d2a-8005ce177775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:25.863647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e4489-8a59-4ad4-9878-48da2eec6e7f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:25.865771 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9b7047e7-f93d-460b-8d2a-8005ce177775 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:25.867939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9b7047e7-f93d-460b-8d2a-8005ce177775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:25.875534 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f75d3-db71-4af0-b306-ee9a5ec8de05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:25.876519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f75d3-db71-4af0-b306-ee9a5ec8de05 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:25.876906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f75d3-db71-4af0-b306-ee9a5ec8de05 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:25.877244 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f75d3-db71-4af0-b306-ee9a5ec8de05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:25.901447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b99f75d3-db71-4af0-b306-ee9a5ec8de05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:25.918718 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:26.093414 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 846/1675] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:26.094660 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7047e7-f93d-460b-8d2a-8005ce177775 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:26.098479 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9b7047e7-f93d-460b-8d2a-8005ce177775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:26.103394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f75d3-db71-4af0-b306-ee9a5ec8de05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:26.105026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f75d3-db71-4af0-b306-ee9a5ec8de05 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:26.125576 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7047e7-f93d-460b-8d2a-8005ce177775 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:26.129310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 830/1676] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:26.133167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e124e8-36dc-4413-a9b4-b72599971520 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:26.133456 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e124e8-36dc-4413-a9b4-b72599971520 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:26.133735 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e124e8-36dc-4413-a9b4-b72599971520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:26.137812 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d14b1-908b-47d4-8b15-82d80498462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:26.139549 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d14b1-908b-47d4-8b15-82d80498462a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:26.139842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d14b1-908b-47d4-8b15-82d80498462a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:26.140119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d14b1-908b-47d4-8b15-82d80498462a admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:26.140890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d14b1-908b-47d4-8b15-82d80498462a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:26.148209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d14b1-908b-47d4-8b15-82d80498462a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:26.170622 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-43e124e8-36dc-4413-a9b4-b72599971520 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:26.181101 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 847/1677] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:26.181101 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d14b1-908b-47d4-8b15-82d80498462a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:26.181703 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-43e124e8-36dc-4413-a9b4-b72599971520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:26.184507 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-958d14b1-908b-47d4-8b15-82d80498462a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:26.203264 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 831/1678] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:26.205484 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc157fc-899d-439c-8156-5705a7fbdb05 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:26.205769 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc157fc-899d-439c-8156-5705a7fbdb05 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:26.206044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc157fc-899d-439c-8156-5705a7fbdb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:26.212642 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d14b1-908b-47d4-8b15-82d80498462a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:26.225652 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82309163-7ebd-4b81-b7d7-cf78d1763336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:26.226055 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82309163-7ebd-4b81-b7d7-cf78d1763336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:26.226330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82309163-7ebd-4b81-b7d7-cf78d1763336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:26.226595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82309163-7ebd-4b81-b7d7-cf78d1763336 admin admin] PATH_INFO: `/v3/projects/428689c638554a7b81cf87f354540203` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:26.231568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82309163-7ebd-4b81-b7d7-cf78d1763336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=428689c638554a7b81cf87f354540203)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:26.233515 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82309163-7ebd-4b81-b7d7-cf78d1763336 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:26.249299 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0cc157fc-899d-439c-8156-5705a7fbdb05 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:26.254885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0cc157fc-899d-439c-8156-5705a7fbdb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:26.279486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 832/1679] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:26.281422 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc157fc-899d-439c-8156-5705a7fbdb05 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:26.302554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc157fc-899d-439c-8156-5705a7fbdb05 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:26.311189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cddcea-d699-4c42-b203-bbc805f8be3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:26.314938 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cddcea-d699-4c42-b203-bbc805f8be3b admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:26.316464 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cddcea-d699-4c42-b203-bbc805f8be3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:26.317567 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cddcea-d699-4c42-b203-bbc805f8be3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:26.318518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cddcea-d699-4c42-b203-bbc805f8be3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:26.320887 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cddcea-d699-4c42-b203-bbc805f8be3b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:26.331758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:26.334752 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 833/1680] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:26.335947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cddcea-d699-4c42-b203-bbc805f8be3b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:26.349967 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-82309163-7ebd-4b81-b7d7-cf78d1763336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '428689c638554a7b81cf87f354540203', 'request_id': 'req-82309163-7ebd-4b81-b7d7-cf78d1763336'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:26.351679 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cddcea-d699-4c42-b203-bbc805f8be3b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:26.372357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-82309163-7ebd-4b81-b7d7-cf78d1763336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '428689c638554a7b81cf87f354540203', 'request_id': 'req-82309163-7ebd-4b81-b7d7-cf78d1763336'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:26.383138 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-82309163-7ebd-4b81-b7d7-cf78d1763336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '428689c638554a7b81cf87f354540203', 'request_id': 'req-82309163-7ebd-4b81-b7d7-cf78d1763336'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:26.406202 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-82309163-7ebd-4b81-b7d7-cf78d1763336 admin admin] The token cache is being invalidate because project 428689c638554a7b81cf87f354540203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:31:26.406540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-82309163-7ebd-4b81-b7d7-cf78d1763336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:26.411258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-82309163-7ebd-4b81-b7d7-cf78d1763336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:26.417150 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 848/1681] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:31:26 2022] DELETE /identity/v3/projects/428689c638554a7b81cf87f354540203 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:26.418951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82309163-7ebd-4b81-b7d7-cf78d1763336 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:26.424143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-82309163-7ebd-4b81-b7d7-cf78d1763336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:26.562017 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82309163-7ebd-4b81-b7d7-cf78d1763336 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:26.576640 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc1cd0-082e-459f-bc0f-d6e34f0815ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:26.577690 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc1cd0-082e-459f-bc0f-d6e34f0815ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:26.578080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc1cd0-082e-459f-bc0f-d6e34f0815ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:26.578464 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc1cd0-082e-459f-bc0f-d6e34f0815ca admin admin] PATH_INFO: `/v3/projects/7b5aada4886c410d98acdc136bfe5d66/users/00cd3d12efab46c79d84c202fb0a4681/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:26.583246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2cb65-cecf-422e-8039-89f2ea55bb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:26.583944 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2cb65-cecf-422e-8039-89f2ea55bb49 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:26.584225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2cb65-cecf-422e-8039-89f2ea55bb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:26.584497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2cb65-cecf-422e-8039-89f2ea55bb49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:26.589200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2cb65-cecf-422e-8039-89f2ea55bb49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:31:26.589526 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2cb65-cecf-422e-8039-89f2ea55bb49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:26.595801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2cb65-cecf-422e-8039-89f2ea55bb49 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:26.610758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc1cd0-082e-459f-bc0f-d6e34f0815ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5aada4886c410d98acdc136bfe5d66, user_id=00cd3d12efab46c79d84c202fb0a4681, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:26.614288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc1cd0-082e-459f-bc0f-d6e34f0815ca admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:26.627687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 834/1682] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:31:26.630164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5886e67-9f17-4d76-8de8-58bc4bb4f3c2 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:26.630452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5886e67-9f17-4d76-8de8-58bc4bb4f3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:26.632592 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5886e67-9f17-4d76-8de8-58bc4bb4f3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:26.646174 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 849/1683] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:26 2022] PUT /identity/v3/projects/7b5aada4886c410d98acdc136bfe5d66/users/00cd3d12efab46c79d84c202fb0a4681/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:26.647274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc1cd0-082e-459f-bc0f-d6e34f0815ca admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:26.657335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b2bc1cd0-082e-459f-bc0f-d6e34f0815ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:26.693862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a5886e67-9f17-4d76-8de8-58bc4bb4f3c2 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:26.694690 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a5886e67-9f17-4d76-8de8-58bc4bb4f3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:26.783814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc1cd0-082e-459f-bc0f-d6e34f0815ca admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:26.789365 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98aa10-14d8-4c8b-bc35-7101b6321950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:26.789758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98aa10-14d8-4c8b-bc35-7101b6321950 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:26.789972 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98aa10-14d8-4c8b-bc35-7101b6321950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:26.790232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98aa10-14d8-4c8b-bc35-7101b6321950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:26.800640 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fe98aa10-14d8-4c8b-bc35-7101b6321950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:26.919436 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 835/1684] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:26.925705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5886e67-9f17-4d76-8de8-58bc4bb4f3c2 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:26.931306 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a5886e67-9f17-4d76-8de8-58bc4bb4f3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:26.969895 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5886e67-9f17-4d76-8de8-58bc4bb4f3c2 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:26.976049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98aa10-14d8-4c8b-bc35-7101b6321950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:26.977538 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98aa10-14d8-4c8b-bc35-7101b6321950 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:26.979543 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cbd53-7c61-42e7-85d7-18d2b05b720c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:26.980609 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cbd53-7c61-42e7-85d7-18d2b05b720c admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:26.981071 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cbd53-7c61-42e7-85d7-18d2b05b720c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:26.981487 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cbd53-7c61-42e7-85d7-18d2b05b720c admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:26.983144 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cbd53-7c61-42e7-85d7-18d2b05b720c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:26.985847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cbd53-7c61-42e7-85d7-18d2b05b720c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:27.012858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 850/1685] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:27.014827 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748337a-ee1f-42fb-9596-f36348291452 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:27.015258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748337a-ee1f-42fb-9596-f36348291452 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:27.015698 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748337a-ee1f-42fb-9596-f36348291452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:27.029663 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:27.052760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 836/1686] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:26 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:27.054527 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf274e7-3ad5-4508-86b7-6b576b4d8527 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:27.055280 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf274e7-3ad5-4508-86b7-6b576b4d8527 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:27.056214 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf274e7-3ad5-4508-86b7-6b576b4d8527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:27.057377 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:27.095726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-5bf274e7-3ad5-4508-86b7-6b576b4d8527 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:27.097577 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5bf274e7-3ad5-4508-86b7-6b576b4d8527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:27.110570 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4748337a-ee1f-42fb-9596-f36348291452 None None] MFA Rules not processed for user `00cd3d12efab46c79d84c202fb0a4681`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:27.117112 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4748337a-ee1f-42fb-9596-f36348291452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:27.257587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 837/1687] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:27.259365 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf274e7-3ad5-4508-86b7-6b576b4d8527 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:27.273273 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf274e7-3ad5-4508-86b7-6b576b4d8527 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:27.281959 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ed436-65b2-4295-83a7-a0ab35dfcfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:27.283100 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ed436-65b2-4295-83a7-a0ab35dfcfb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:27.283626 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ed436-65b2-4295-83a7-a0ab35dfcfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:27.284162 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ed436-65b2-4295-83a7-a0ab35dfcfb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:27.285153 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ed436-65b2-4295-83a7-a0ab35dfcfb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:27.297475 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ed436-65b2-4295-83a7-a0ab35dfcfb9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:27.336643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 838/1688] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:27 2022] POST /identity/v3/users => generated 286 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:27.337909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ed436-65b2-4295-83a7-a0ab35dfcfb9 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:27.366063 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 851/1689] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:27.366443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ed436-65b2-4295-83a7-a0ab35dfcfb9 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:27.368750 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748337a-ee1f-42fb-9596-f36348291452 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:27.377858 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fa189-6c8a-42d9-a9a1-027e213142ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:27.378724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fa189-6c8a-42d9-a9a1-027e213142ab admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:27.379262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fa189-6c8a-42d9-a9a1-027e213142ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:27.379498 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fa189-6c8a-42d9-a9a1-027e213142ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:27.380353 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fa189-6c8a-42d9-a9a1-027e213142ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:31:27.380733 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fa189-6c8a-42d9-a9a1-027e213142ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:27.382442 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fa189-6c8a-42d9-a9a1-027e213142ab admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:27.390783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748337a-ee1f-42fb-9596-f36348291452 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:27.402487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d19ba-54ea-4444-b3c6-71bffe7d4b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:27.407435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d19ba-54ea-4444-b3c6-71bffe7d4b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:27.412445 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d19ba-54ea-4444-b3c6-71bffe7d4b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:27.412857 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d19ba-54ea-4444-b3c6-71bffe7d4b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:27.413610 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d19ba-54ea-4444-b3c6-71bffe7d4b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:27.420136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d19ba-54ea-4444-b3c6-71bffe7d4b52 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:27.420316 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 839/1690] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:31:27.420316 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fa189-6c8a-42d9-a9a1-027e213142ab admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:27.435423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fa189-6c8a-42d9-a9a1-027e213142ab admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:27.440932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea95e8-be80-425e-afde-7fe6c62ac2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:27.441795 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea95e8-be80-425e-afde-7fe6c62ac2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:27.442165 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea95e8-be80-425e-afde-7fe6c62ac2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:27.442530 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea95e8-be80-425e-afde-7fe6c62ac2d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:27.443407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea95e8-be80-425e-afde-7fe6c62ac2d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:27.445451 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea95e8-be80-425e-afde-7fe6c62ac2d3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:27.448330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 852/1691] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:27.450442 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f38e1-3cb0-463a-9478-b967c6b59e9e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:27.450984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f38e1-3cb0-463a-9478-b967c6b59e9e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:27.451286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f38e1-3cb0-463a-9478-b967c6b59e9e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:27.452809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 853/1692] 10.222.0.25 () {54 vars in 912 bytes} [Tue Jul 19 12:31:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:31:27.453919 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f38e1-3cb0-463a-9478-b967c6b59e9e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:27.484239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f38e1-3cb0-463a-9478-b967c6b59e9e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:27.486014 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 840/1693] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:27 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:27.486984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea95e8-be80-425e-afde-7fe6c62ac2d3 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:27.580506 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea95e8-be80-425e-afde-7fe6c62ac2d3 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:27.585872 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c9db5-6b13-41f1-9912-8ed6e6631b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:27.586560 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c9db5-6b13-41f1-9912-8ed6e6631b34 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:27.586879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c9db5-6b13-41f1-9912-8ed6e6631b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:27.587152 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c9db5-6b13-41f1-9912-8ed6e6631b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:27.587916 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c9db5-6b13-41f1-9912-8ed6e6631b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:27.589533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c9db5-6b13-41f1-9912-8ed6e6631b34 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:27.597503 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123af31-8157-4019-906c-dbd9e609ea2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:27.598598 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123af31-8157-4019-906c-dbd9e609ea2b admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:27.599007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123af31-8157-4019-906c-dbd9e609ea2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:27.599327 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123af31-8157-4019-906c-dbd9e609ea2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:27.600106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123af31-8157-4019-906c-dbd9e609ea2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:27.605101 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123af31-8157-4019-906c-dbd9e609ea2b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:27.606401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 841/1694] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:27.608052 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fe058-20be-4309-b22e-d1a1cc188a96 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:27.608505 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fe058-20be-4309-b22e-d1a1cc188a96 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:27.608930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fe058-20be-4309-b22e-d1a1cc188a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:27.649174 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 854/1695] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:27 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:27.650455 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123af31-8157-4019-906c-dbd9e609ea2b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:27.662397 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-cb9fe058-20be-4309-b22e-d1a1cc188a96 None None] MFA Rules not processed for user `977392666b5a4076884416489b935ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:27.664240 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cb9fe058-20be-4309-b22e-d1a1cc188a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:27.700463 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:27.763957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123af31-8157-4019-906c-dbd9e609ea2b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:27.771573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba204bdd-d20b-444c-85ef-b475bb4a172f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:27.772078 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 842/1696] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 19 12:31:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:27.774074 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fe058-20be-4309-b22e-d1a1cc188a96 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:27.774467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba204bdd-d20b-444c-85ef-b475bb4a172f admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:27.775611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba204bdd-d20b-444c-85ef-b475bb4a172f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:27.775611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba204bdd-d20b-444c-85ef-b475bb4a172f admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:27.776391 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba204bdd-d20b-444c-85ef-b475bb4a172f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:27.778548 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba204bdd-d20b-444c-85ef-b475bb4a172f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:27.790433 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:27.801189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fe058-20be-4309-b22e-d1a1cc188a96 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:27.811571 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 855/1697] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:27 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:27.812567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba204bdd-d20b-444c-85ef-b475bb4a172f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:27.814149 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779acc5-7f4b-4642-9ba0-739c4836c932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:27.815359 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779acc5-7f4b-4642-9ba0-739c4836c932 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:27.815669 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779acc5-7f4b-4642-9ba0-739c4836c932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:27.815948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779acc5-7f4b-4642-9ba0-739c4836c932 admin admin] PATH_INFO: `/v3/projects/fcf9d61c72244694900327634f28ffae/users/0999b7fe05a141508c52c70a3cf46a1a/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:27.824272 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba204bdd-d20b-444c-85ef-b475bb4a172f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:27.831389 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca46b9-3533-41a5-b9f1-38a84e7e1286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:27.832392 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca46b9-3533-41a5-b9f1-38a84e7e1286 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:27.832957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca46b9-3533-41a5-b9f1-38a84e7e1286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:27.833382 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca46b9-3533-41a5-b9f1-38a84e7e1286 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:27.834142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca46b9-3533-41a5-b9f1-38a84e7e1286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:27.836240 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca46b9-3533-41a5-b9f1-38a84e7e1286 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:27.840809 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779acc5-7f4b-4642-9ba0-739c4836c932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf9d61c72244694900327634f28ffae, user_id=0999b7fe05a141508c52c70a3cf46a1a, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:27.843750 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779acc5-7f4b-4642-9ba0-739c4836c932 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:27.875311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 843/1698] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:27 2022] PUT /identity/v3/projects/fcf9d61c72244694900327634f28ffae/users/0999b7fe05a141508c52c70a3cf46a1a/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:27.875505 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 856/1699] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:27 2022] POST /identity/v3/users => generated 292 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:27.876411 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca46b9-3533-41a5-b9f1-38a84e7e1286 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:27.906711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779acc5-7f4b-4642-9ba0-739c4836c932 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:27.908601 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a779acc5-7f4b-4642-9ba0-739c4836c932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:27.915978 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca46b9-3533-41a5-b9f1-38a84e7e1286 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:28.012708 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3c41b-db74-49e3-af1b-7e21001e4f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:28.013335 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779acc5-7f4b-4642-9ba0-739c4836c932 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:28.013450 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3c41b-db74-49e3-af1b-7e21001e4f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:28.013668 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3c41b-db74-49e3-af1b-7e21001e4f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:28.013967 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3c41b-db74-49e3-af1b-7e21001e4f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:28.014758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3c41b-db74-49e3-af1b-7e21001e4f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:28.016739 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3c41b-db74-49e3-af1b-7e21001e4f91 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:28.018022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef019eb-6ab7-49f1-b961-fec29e829708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:28.019106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef019eb-6ab7-49f1-b961-fec29e829708 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:28.019676 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef019eb-6ab7-49f1-b961-fec29e829708 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:28.020653 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef019eb-6ab7-49f1-b961-fec29e829708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:28.034205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 857/1700] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:28.039441 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef019eb-6ab7-49f1-b961-fec29e829708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:28.041103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef019eb-6ab7-49f1-b961-fec29e829708 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:28.046536 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2235d7f-71df-4349-b9da-af0b7ca2c1e4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:28.047595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2235d7f-71df-4349-b9da-af0b7ca2c1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:28.047982 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2235d7f-71df-4349-b9da-af0b7ca2c1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:28.077966 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 844/1701] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:28.078795 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f2235d7f-71df-4349-b9da-af0b7ca2c1e4 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:28.079604 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef019eb-6ab7-49f1-b961-fec29e829708 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:28.082037 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f2235d7f-71df-4349-b9da-af0b7ca2c1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:28.111290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 858/1702] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:28.112052 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2235d7f-71df-4349-b9da-af0b7ca2c1e4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:28.114649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef019eb-6ab7-49f1-b961-fec29e829708 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:28.127286 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972e17b-e76e-4a78-9767-8bf71c3fd50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:28.127973 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972e17b-e76e-4a78-9767-8bf71c3fd50d admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:28.128256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972e17b-e76e-4a78-9767-8bf71c3fd50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:28.128563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972e17b-e76e-4a78-9767-8bf71c3fd50d admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:28.130094 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972e17b-e76e-4a78-9767-8bf71c3fd50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:28.131841 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972e17b-e76e-4a78-9767-8bf71c3fd50d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:28.140447 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2235d7f-71df-4349-b9da-af0b7ca2c1e4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:28.153535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95151fe8-e44a-4d41-a4ec-1ab4ae676f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:28.155206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95151fe8-e44a-4d41-a4ec-1ab4ae676f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:28.156864 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95151fe8-e44a-4d41-a4ec-1ab4ae676f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:28.157210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95151fe8-e44a-4d41-a4ec-1ab4ae676f54 admin admin] PATH_INFO: `/v3/projects/47ece91aedc64e6cb4d5fdb2bdbfeb32/users/a0142f734d80450fb2f0e7f45e015904/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:28.167321 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 845/1703] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:28.170929 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972e17b-e76e-4a78-9767-8bf71c3fd50d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:28.189061 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95151fe8-e44a-4d41-a4ec-1ab4ae676f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47ece91aedc64e6cb4d5fdb2bdbfeb32, user_id=a0142f734d80450fb2f0e7f45e015904, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:28.192771 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95151fe8-e44a-4d41-a4ec-1ab4ae676f54 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:28.197879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972e17b-e76e-4a78-9767-8bf71c3fd50d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:28.209542 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa95d61-8ec2-45ce-853d-4997096ca0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:28.212133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa95d61-8ec2-45ce-853d-4997096ca0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:28.212482 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa95d61-8ec2-45ce-853d-4997096ca0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:28.212764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa95d61-8ec2-45ce-853d-4997096ca0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:28.213549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa95d61-8ec2-45ce-853d-4997096ca0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:28.215766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 859/1704] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:28 2022] PUT /identity/v3/projects/47ece91aedc64e6cb4d5fdb2bdbfeb32/users/a0142f734d80450fb2f0e7f45e015904/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:28.216904 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95151fe8-e44a-4d41-a4ec-1ab4ae676f54 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:28.221968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa95d61-8ec2-45ce-853d-4997096ca0f4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:28.251413 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 846/1705] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:28.252378 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa95d61-8ec2-45ce-853d-4997096ca0f4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:28.278005 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa95d61-8ec2-45ce-853d-4997096ca0f4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:28.374594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95151fe8-e44a-4d41-a4ec-1ab4ae676f54 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:28.384619 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32f117-53d9-4888-9a52-598d61c3675b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:28.385320 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32f117-53d9-4888-9a52-598d61c3675b service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:28.386043 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32f117-53d9-4888-9a52-598d61c3675b service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:28.386043 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32f117-53d9-4888-9a52-598d61c3675b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:28.438277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8d64a-1375-4999-a3fd-420651bfec1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:28.439061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8d64a-1375-4999-a3fd-420651bfec1b admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:28.441713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8d64a-1375-4999-a3fd-420651bfec1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:28.446138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8d64a-1375-4999-a3fd-420651bfec1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:28.447526 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8d64a-1375-4999-a3fd-420651bfec1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:28.453308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8d64a-1375-4999-a3fd-420651bfec1b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:28.480196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 847/1706] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:28.481442 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8d64a-1375-4999-a3fd-420651bfec1b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:28.509143 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8d64a-1375-4999-a3fd-420651bfec1b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:28.519382 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92e8f0-3f4d-440b-946e-1758fd963441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:28.520414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92e8f0-3f4d-440b-946e-1758fd963441 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:28.520703 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92e8f0-3f4d-440b-946e-1758fd963441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:28.521021 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92e8f0-3f4d-440b-946e-1758fd963441 admin admin] PATH_INFO: `/v3/projects/ff5f5e4c32d74cd99bd079d09a796907/users/8b04526f5bf04464b2d26fac489eeefb/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:28.570689 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92e8f0-3f4d-440b-946e-1758fd963441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff5f5e4c32d74cd99bd079d09a796907, user_id=8b04526f5bf04464b2d26fac489eeefb, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:28.573449 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92e8f0-3f4d-440b-946e-1758fd963441 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:28.603705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 848/1707] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:28 2022] PUT /identity/v3/projects/ff5f5e4c32d74cd99bd079d09a796907/users/8b04526f5bf04464b2d26fac489eeefb/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:28.605196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ce0be-81fa-49a3-bd0e-934830dc8876 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:28.605481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ce0be-81fa-49a3-bd0e-934830dc8876 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:28.606022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ce0be-81fa-49a3-bd0e-934830dc8876 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:28.614503 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 849/1708] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 19 12:31:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:31:28.615538 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ce0be-81fa-49a3-bd0e-934830dc8876 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:28.630599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:28.640918 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:28.651044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32f117-53d9-4888-9a52-598d61c3675b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:28.653069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32f117-53d9-4888-9a52-598d61c3675b service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:28.669803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 860/1709] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:28.671534 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb8bf4-337b-499d-8176-d98779fed8b7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:28.672122 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb8bf4-337b-499d-8176-d98779fed8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:28.673242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb8bf4-337b-499d-8176-d98779fed8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:28.710093 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-91bb8bf4-337b-499d-8176-d98779fed8b7 None None] MFA Rules not processed for user `8b04526f5bf04464b2d26fac489eeefb`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:28.711529 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-91bb8bf4-337b-499d-8176-d98779fed8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:28.796200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ce0be-81fa-49a3-bd0e-934830dc8876 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:28.807574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c93b17-0600-4f50-9f17-cc2467ef3ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:28.808905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c93b17-0600-4f50-9f17-cc2467ef3ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:28.809986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c93b17-0600-4f50-9f17-cc2467ef3ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:28.810475 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c93b17-0600-4f50-9f17-cc2467ef3ba4 admin admin] PATH_INFO: `/v3/projects/47ece91aedc64e6cb4d5fdb2bdbfeb32/users/a0142f734d80450fb2f0e7f45e015904/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:28.813301 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 861/1710] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:28.815061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c93b17-0600-4f50-9f17-cc2467ef3ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47ece91aedc64e6cb4d5fdb2bdbfeb32, user_id=a0142f734d80450fb2f0e7f45e015904, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:28.830885 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb8bf4-337b-499d-8176-d98779fed8b7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:28.831849 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c93b17-0600-4f50-9f17-cc2467ef3ba4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:28.834071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-91bb8bf4-337b-499d-8176-d98779fed8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:28.878728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 850/1711] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:28 2022] PUT /identity/v3/projects/47ece91aedc64e6cb4d5fdb2bdbfeb32/users/a0142f734d80450fb2f0e7f45e015904/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:28.881174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba6359-0ecd-4e23-9cc3-064a13bd0eb5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:28.881455 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba6359-0ecd-4e23-9cc3-064a13bd0eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:28.881724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba6359-0ecd-4e23-9cc3-064a13bd0eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:28.984607 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a3ba6359-0ecd-4e23-9cc3-064a13bd0eb5 None None] MFA Rules not processed for user `a0142f734d80450fb2f0e7f45e015904`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:28.990082 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a3ba6359-0ecd-4e23-9cc3-064a13bd0eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:29.030625 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb8bf4-337b-499d-8176-d98779fed8b7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:29.199822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 851/1712] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:31:29.201883 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134625a-0475-4767-90d9-aa2978920b36 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:29.202432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134625a-0475-4767-90d9-aa2978920b36 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:29.202888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134625a-0475-4767-90d9-aa2978920b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:29.227143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64deb37-0330-4a51-ae1e-f54a2772b0ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:29.229681 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64deb37-0330-4a51-ae1e-f54a2772b0ef service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:29.232988 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64deb37-0330-4a51-ae1e-f54a2772b0ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:29.236470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64deb37-0330-4a51-ae1e-f54a2772b0ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:29.265717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3134625a-0475-4767-90d9-aa2978920b36 None None] MFA Rules not processed for user `11a51c42a4094d9b97eb636c57225dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:29.279056 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3134625a-0475-4767-90d9-aa2978920b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:29.417062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:29.427844 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64deb37-0330-4a51-ae1e-f54a2772b0ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:29.433943 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64deb37-0330-4a51-ae1e-f54a2772b0ef service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:29.449295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 852/1713] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 19 12:31:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:29.450249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134625a-0475-4767-90d9-aa2978920b36 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:29.454526 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3134625a-0475-4767-90d9-aa2978920b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:29.473393 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 862/1714] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:29.483517 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71560fe8-b951-49cb-b502-3dfb1989b914 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:29.483858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71560fe8-b951-49cb-b502-3dfb1989b914 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:29.484141 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71560fe8-b951-49cb-b502-3dfb1989b914 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:29.488680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 863/1715] 10.222.0.25 () {54 vars in 961 bytes} [Tue Jul 19 12:31:29 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:31:29.489572 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71560fe8-b951-49cb-b502-3dfb1989b914 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:29.494687 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-71560fe8-b951-49cb-b502-3dfb1989b914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:29.525950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71560fe8-b951-49cb-b502-3dfb1989b914 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:29.535839 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:29.538486 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b9584-d039-4b38-968d-6cd03921c118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:29.539236 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b9584-d039-4b38-968d-6cd03921c118 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:29.539533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b9584-d039-4b38-968d-6cd03921c118 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:29.541210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b9584-d039-4b38-968d-6cd03921c118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:29.559666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b9584-d039-4b38-968d-6cd03921c118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:29.561122 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b9584-d039-4b38-968d-6cd03921c118 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:29.600605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 864/1716] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:29.602457 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b9584-d039-4b38-968d-6cd03921c118 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:29.664454 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134625a-0475-4767-90d9-aa2978920b36 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:29.675870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009b931-efa6-4cd3-97bf-c070d826c657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:29.676890 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009b931-efa6-4cd3-97bf-c070d826c657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:29.679955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009b931-efa6-4cd3-97bf-c070d826c657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:29.680300 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009b931-efa6-4cd3-97bf-c070d826c657 admin admin] PATH_INFO: `/v3/projects/c74772b4004040619568a892c7d16f49` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:29.682619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009b931-efa6-4cd3-97bf-c070d826c657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c74772b4004040619568a892c7d16f49)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:29.690825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009b931-efa6-4cd3-97bf-c070d826c657 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:29.763269 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b9584-d039-4b38-968d-6cd03921c118 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:29.788137 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd320dc5-75d2-4db5-a32d-2076ae0afbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:29.789870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd320dc5-75d2-4db5-a32d-2076ae0afbdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:29.791041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd320dc5-75d2-4db5-a32d-2076ae0afbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:29.791565 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd320dc5-75d2-4db5-a32d-2076ae0afbdf admin admin] PATH_INFO: `/v3/users/8b04526f5bf04464b2d26fac489eeefb` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:29.798071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd320dc5-75d2-4db5-a32d-2076ae0afbdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b04526f5bf04464b2d26fac489eeefb)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:29.804352 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd320dc5-75d2-4db5-a32d-2076ae0afbdf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:29.836169 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1009b931-efa6-4cd3-97bf-c070d826c657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c74772b4004040619568a892c7d16f49', 'request_id': 'req-1009b931-efa6-4cd3-97bf-c070d826c657'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:29.861537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1009b931-efa6-4cd3-97bf-c070d826c657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c74772b4004040619568a892c7d16f49', 'request_id': 'req-1009b931-efa6-4cd3-97bf-c070d826c657'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:29.876622 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1009b931-efa6-4cd3-97bf-c070d826c657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c74772b4004040619568a892c7d16f49', 'request_id': 'req-1009b931-efa6-4cd3-97bf-c070d826c657'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:29.911243 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1009b931-efa6-4cd3-97bf-c070d826c657 admin admin] The token cache is being invalidate because project c74772b4004040619568a892c7d16f49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:31:29.912415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1009b931-efa6-4cd3-97bf-c070d826c657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:29.914515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1009b931-efa6-4cd3-97bf-c070d826c657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:29.918670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 853/1717] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:31:29 2022] DELETE /identity/v3/projects/c74772b4004040619568a892c7d16f49 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:29.925518 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bd320dc5-75d2-4db5-a32d-2076ae0afbdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b04526f5bf04464b2d26fac489eeefb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:29.928425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d777f-c517-4d55-a648-efb2eefcf7fb None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:29.928673 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d777f-c517-4d55-a648-efb2eefcf7fb None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:29.928950 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d777f-c517-4d55-a648-efb2eefcf7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:29.951488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bd320dc5-75d2-4db5-a32d-2076ae0afbdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b04526f5bf04464b2d26fac489eeefb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:29.983931 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0f0d777f-c517-4d55-a648-efb2eefcf7fb None None] MFA Rules not processed for user `11a51c42a4094d9b97eb636c57225dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:29.986537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0f0d777f-c517-4d55-a648-efb2eefcf7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:29.987691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bd320dc5-75d2-4db5-a32d-2076ae0afbdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b04526f5bf04464b2d26fac489eeefb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:30.007160 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bd320dc5-75d2-4db5-a32d-2076ae0afbdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b04526f5bf04464b2d26fac489eeefb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:30.008406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bd320dc5-75d2-4db5-a32d-2076ae0afbdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b04526f5bf04464b2d26fac489eeefb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:30.024746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 865/1718] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:31:29 2022] DELETE /identity/v3/users/8b04526f5bf04464b2d26fac489eeefb => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:30.026830 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd320dc5-75d2-4db5-a32d-2076ae0afbdf admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:30.033287 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bd320dc5-75d2-4db5-a32d-2076ae0afbdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:30.191017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 854/1719] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Jul 19 12:31:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:30.195775 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d777f-c517-4d55-a648-efb2eefcf7fb None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:30.201888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0f0d777f-c517-4d55-a648-efb2eefcf7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:30.271841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:30.278971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:30.299522 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd320dc5-75d2-4db5-a32d-2076ae0afbdf admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:30.304911 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d777f-c517-4d55-a648-efb2eefcf7fb None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:30.310488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94fa96-f146-4c98-9cce-ea84eff9adbd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:30.312135 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94fa96-f146-4c98-9cce-ea84eff9adbd service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:30.312591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94fa96-f146-4c98-9cce-ea84eff9adbd service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:30.313044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94fa96-f146-4c98-9cce-ea84eff9adbd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:30.315374 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9c94fa96-f146-4c98-9cce-ea84eff9adbd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:30.339035 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94fa96-f146-4c98-9cce-ea84eff9adbd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:30.341019 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94fa96-f146-4c98-9cce-ea84eff9adbd service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:30.383154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb804472-5c0c-4db5-b0fe-d1fc5e22d4ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:30.384031 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb804472-5c0c-4db5-b0fe-d1fc5e22d4ab service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:30.384285 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb804472-5c0c-4db5-b0fe-d1fc5e22d4ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:30.384498 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 866/1720] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:30.384669 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb804472-5c0c-4db5-b0fe-d1fc5e22d4ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:30.386521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4b9df-0db7-4474-a36f-2d4c3d8e1a72 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:30.387068 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4b9df-0db7-4474-a36f-2d4c3d8e1a72 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:30.387634 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fb804472-5c0c-4db5-b0fe-d1fc5e22d4ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:30.389368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4b9df-0db7-4474-a36f-2d4c3d8e1a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:30.423789 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-87f4b9df-0db7-4474-a36f-2d4c3d8e1a72 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:30.431305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-87f4b9df-0db7-4474-a36f-2d4c3d8e1a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:30.571959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 867/1721] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:30.574166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2408235-c256-4358-baab-c0c559cccf9e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:30.574532 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2408235-c256-4358-baab-c0c559cccf9e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:30.576810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2408235-c256-4358-baab-c0c559cccf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:30.595773 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb804472-5c0c-4db5-b0fe-d1fc5e22d4ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:30.597179 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb804472-5c0c-4db5-b0fe-d1fc5e22d4ab service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:30.611852 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c2408235-c256-4358-baab-c0c559cccf9e None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:30.613961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c2408235-c256-4358-baab-c0c559cccf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:30.621806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 855/1722] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:30.623230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb804472-5c0c-4db5-b0fe-d1fc5e22d4ab service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:30.630580 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 868/1723] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:30.633771 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999a3cc-9ce5-4b34-a1a1-801276c57181 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:30.634883 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999a3cc-9ce5-4b34-a1a1-801276c57181 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:30.635253 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999a3cc-9ce5-4b34-a1a1-801276c57181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:30.649232 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb804472-5c0c-4db5-b0fe-d1fc5e22d4ab service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:30.666183 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408ec5b-ebb7-4acc-b237-39a6cc5c9baf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:30.667760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408ec5b-ebb7-4acc-b237-39a6cc5c9baf service placement] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:30.667760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408ec5b-ebb7-4acc-b237-39a6cc5c9baf service placement] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:30.667760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408ec5b-ebb7-4acc-b237-39a6cc5c9baf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:30.672535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7408ec5b-ebb7-4acc-b237-39a6cc5c9baf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:30.676549 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5999a3cc-9ce5-4b34-a1a1-801276c57181 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:30.679083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5999a3cc-9ce5-4b34-a1a1-801276c57181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:30.705686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 869/1724] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:30.710689 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408ec5b-ebb7-4acc-b237-39a6cc5c9baf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:30.711806 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999a3cc-9ce5-4b34-a1a1-801276c57181 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:30.717230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408ec5b-ebb7-4acc-b237-39a6cc5c9baf service placement] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:30.742515 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999a3cc-9ce5-4b34-a1a1-801276c57181 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:30.752796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 856/1725] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:30.756385 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47b042-3c0c-4f5c-ba0a-238a68f37f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:30.757068 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47b042-3c0c-4f5c-ba0a-238a68f37f17 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:30.757429 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47b042-3c0c-4f5c-ba0a-238a68f37f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:30.757731 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47b042-3c0c-4f5c-ba0a-238a68f37f17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:30.758885 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47b042-3c0c-4f5c-ba0a-238a68f37f17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:31:30.759007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47b042-3c0c-4f5c-ba0a-238a68f37f17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:30.760805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47b042-3c0c-4f5c-ba0a-238a68f37f17 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:30.785791 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408ec5b-ebb7-4acc-b237-39a6cc5c9baf service placement] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:30.793528 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 870/1726] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:31:30.801910 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408ec5b-ebb7-4acc-b237-39a6cc5c9baf service placement] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:30.807896 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4deb9c-f772-4e02-a1bc-3f6fb29d90d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:30.809590 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4deb9c-f772-4e02-a1bc-3f6fb29d90d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:30.810167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4deb9c-f772-4e02-a1bc-3f6fb29d90d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:30.810606 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4deb9c-f772-4e02-a1bc-3f6fb29d90d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:30.811480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4deb9c-f772-4e02-a1bc-3f6fb29d90d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:30.813806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4deb9c-f772-4e02-a1bc-3f6fb29d90d6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:30.864204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 857/1727] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:30 2022] POST /identity/v3/projects => generated 367 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:30.868952 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47b042-3c0c-4f5c-ba0a-238a68f37f17 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:30.882440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4deb9c-f772-4e02-a1bc-3f6fb29d90d6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:30.886800 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47b042-3c0c-4f5c-ba0a-238a68f37f17 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:30.887518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ff4deb9c-f772-4e02-a1bc-3f6fb29d90d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:31.065028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef231c-642c-4dfc-a8c1-59f15c85ba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:31.066113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef231c-642c-4dfc-a8c1-59f15c85ba83 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:31.069679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef231c-642c-4dfc-a8c1-59f15c85ba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:31.071448 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef231c-642c-4dfc-a8c1-59f15c85ba83 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:31.073022 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef231c-642c-4dfc-a8c1-59f15c85ba83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:31.073536 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4deb9c-f772-4e02-a1bc-3f6fb29d90d6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:31.078026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef231c-642c-4dfc-a8c1-59f15c85ba83 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:31.088175 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba9451-86c1-4461-844b-34cbc92df219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:31.088941 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba9451-86c1-4461-844b-34cbc92df219 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:31.089340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba9451-86c1-4461-844b-34cbc92df219 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:31.089851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba9451-86c1-4461-844b-34cbc92df219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:31.108961 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba9451-86c1-4461-844b-34cbc92df219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:31.116222 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba9451-86c1-4461-844b-34cbc92df219 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:31.130490 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 871/1728] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:30 2022] POST /identity/v3/users => generated 284 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:31.132366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4630b-5523-44b5-9c8b-01de296368c5 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:31.132983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4630b-5523-44b5-9c8b-01de296368c5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:31.134118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4630b-5523-44b5-9c8b-01de296368c5 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:31.139001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 872/1729] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 19 12:31:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:31:31.140025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4630b-5523-44b5-9c8b-01de296368c5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:31.150139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 858/1730] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:31.171807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4630b-5523-44b5-9c8b-01de296368c5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:31.188026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c21e7-5725-40db-8e25-b1264c96814a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:31.188895 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c21e7-5725-40db-8e25-b1264c96814a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:31.189339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c21e7-5725-40db-8e25-b1264c96814a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:31.189727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c21e7-5725-40db-8e25-b1264c96814a admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:31.193508 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c21e7-5725-40db-8e25-b1264c96814a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:31.199417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c21e7-5725-40db-8e25-b1264c96814a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:31.212348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ffade-bd8e-4bb1-99e9-c6decd00551b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:31.213205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ffade-bd8e-4bb1-99e9-c6decd00551b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:31.213566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ffade-bd8e-4bb1-99e9-c6decd00551b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:31.249405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 873/1731] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:31.250821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c21e7-5725-40db-8e25-b1264c96814a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:31.281453 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-aa9ffade-bd8e-4bb1-99e9-c6decd00551b None None] MFA Rules not processed for user `11a51c42a4094d9b97eb636c57225dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:31.282910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c21e7-5725-40db-8e25-b1264c96814a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:31.286672 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-aa9ffade-bd8e-4bb1-99e9-c6decd00551b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:31.296835 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d43cd2-22e2-41da-a3f4-b1b078505ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:31.298549 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d43cd2-22e2-41da-a3f4-b1b078505ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:31.299034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d43cd2-22e2-41da-a3f4-b1b078505ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:31.299392 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d43cd2-22e2-41da-a3f4-b1b078505ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:31.300533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d43cd2-22e2-41da-a3f4-b1b078505ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:31.313695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d43cd2-22e2-41da-a3f4-b1b078505ebd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:31.328624 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:31.353597 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 874/1732] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:31.365559 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d43cd2-22e2-41da-a3f4-b1b078505ebd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:31.371001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-95d43cd2-22e2-41da-a3f4-b1b078505ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:31.434104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d43cd2-22e2-41da-a3f4-b1b078505ebd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:31.451006 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28a324-d8fc-47d5-8de2-3f1b095f9df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:31.452727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28a324-d8fc-47d5-8de2-3f1b095f9df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:31.453435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28a324-d8fc-47d5-8de2-3f1b095f9df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:31.455117 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28a324-d8fc-47d5-8de2-3f1b095f9df8 admin admin] PATH_INFO: `/v3/users/ee39b9dc554646d8a08713ebb0560a74` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:31.459937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28a324-d8fc-47d5-8de2-3f1b095f9df8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee39b9dc554646d8a08713ebb0560a74)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:31.466568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28a324-d8fc-47d5-8de2-3f1b095f9df8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:31.498972 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 859/1733] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 19 12:31:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:31:31.500977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ffade-bd8e-4bb1-99e9-c6decd00551b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:31.547555 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ffade-bd8e-4bb1-99e9-c6decd00551b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:31.589005 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395d425-7e30-41c7-a8e8-4391997c0573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:31.590102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395d425-7e30-41c7-a8e8-4391997c0573 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:31.590756 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395d425-7e30-41c7-a8e8-4391997c0573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:31.591227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395d425-7e30-41c7-a8e8-4391997c0573 admin admin] PATH_INFO: `/v3/projects/a3dad02a7ed9484fa42c2718b3ea54c5/users/8a948b4e5aea480693b50bafc26cb5f9/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:31.595397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:31.623936 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395d425-7e30-41c7-a8e8-4391997c0573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3dad02a7ed9484fa42c2718b3ea54c5, user_id=8a948b4e5aea480693b50bafc26cb5f9, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:31.631491 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395d425-7e30-41c7-a8e8-4391997c0573 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:31.655902 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ed28a324-d8fc-47d5-8de2-3f1b095f9df8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee39b9dc554646d8a08713ebb0560a74'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:31.673200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 860/1734] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:31 2022] PUT /identity/v3/projects/a3dad02a7ed9484fa42c2718b3ea54c5/users/8a948b4e5aea480693b50bafc26cb5f9/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:31.674879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deb508-3231-4583-9020-76ccfaa732fe None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:31.675304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deb508-3231-4583-9020-76ccfaa732fe None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:31.675781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deb508-3231-4583-9020-76ccfaa732fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:31.677220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ed28a324-d8fc-47d5-8de2-3f1b095f9df8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee39b9dc554646d8a08713ebb0560a74'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:31.719657 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ed28a324-d8fc-47d5-8de2-3f1b095f9df8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee39b9dc554646d8a08713ebb0560a74'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:31.741170 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ed28a324-d8fc-47d5-8de2-3f1b095f9df8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee39b9dc554646d8a08713ebb0560a74'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:31.741845 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ed28a324-d8fc-47d5-8de2-3f1b095f9df8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee39b9dc554646d8a08713ebb0560a74'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:31.750094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 875/1735] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:31:31 2022] DELETE /identity/v3/users/ee39b9dc554646d8a08713ebb0560a74 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:31.751023 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28a324-d8fc-47d5-8de2-3f1b095f9df8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:31.759165 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ed28a324-d8fc-47d5-8de2-3f1b095f9df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:31.770963 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d6deb508-3231-4583-9020-76ccfaa732fe None None] MFA Rules not processed for user `0999b7fe05a141508c52c70a3cf46a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:31.772411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d6deb508-3231-4583-9020-76ccfaa732fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:31.909582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28a324-d8fc-47d5-8de2-3f1b095f9df8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:31.913849 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 861/1736] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:31.917768 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e354461-c7f3-451e-bd74-cfd1a9e8b4b7 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:31.918151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e354461-c7f3-451e-bd74-cfd1a9e8b4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:31.919320 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e354461-c7f3-451e-bd74-cfd1a9e8b4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:31.928687 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92218b-b838-4f2d-b4b2-714185347144 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:31.929404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92218b-b838-4f2d-b4b2-714185347144 service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:31.929763 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92218b-b838-4f2d-b4b2-714185347144 service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:31.930044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92218b-b838-4f2d-b4b2-714185347144 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:31.939308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ae92218b-b838-4f2d-b4b2-714185347144 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:31.977374 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92218b-b838-4f2d-b4b2-714185347144 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:31.979034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92218b-b838-4f2d-b4b2-714185347144 service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:31.981687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6e354461-c7f3-451e-bd74-cfd1a9e8b4b7 None None] MFA Rules not processed for user `8a948b4e5aea480693b50bafc26cb5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:31.984380 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6e354461-c7f3-451e-bd74-cfd1a9e8b4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:32.006498 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 876/1737] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:32.007404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92218b-b838-4f2d-b4b2-714185347144 service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:32.008758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ae92218b-b838-4f2d-b4b2-714185347144 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:32.134625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 862/1738] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:32.139419 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e354461-c7f3-451e-bd74-cfd1a9e8b4b7 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:32.142849 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6e354461-c7f3-451e-bd74-cfd1a9e8b4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:32.149607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92218b-b838-4f2d-b4b2-714185347144 service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:32.158867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bec790-5737-46cc-aa00-d70d856b0012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:32.160253 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bec790-5737-46cc-aa00-d70d856b0012 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:32.160871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bec790-5737-46cc-aa00-d70d856b0012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:32.161430 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bec790-5737-46cc-aa00-d70d856b0012 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:32.162281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bec790-5737-46cc-aa00-d70d856b0012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:32.163674 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e354461-c7f3-451e-bd74-cfd1a9e8b4b7 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:32.165820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bec790-5737-46cc-aa00-d70d856b0012 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:32.168230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d7471-9538-45e3-86e4-8237f8a61046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:32.169323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d7471-9538-45e3-86e4-8237f8a61046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:32.169695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d7471-9538-45e3-86e4-8237f8a61046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:32.170071 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d7471-9538-45e3-86e4-8237f8a61046 admin admin] PATH_INFO: `/v3/projects/3490be04af0b456d9983e54b81061639` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:32.173198 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d7471-9538-45e3-86e4-8237f8a61046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3490be04af0b456d9983e54b81061639)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:32.178558 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d7471-9538-45e3-86e4-8237f8a61046 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:32.205236 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:32.217125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 877/1739] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:32 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:32.217125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bec790-5737-46cc-aa00-d70d856b0012 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:32.219012 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-49bec790-5737-46cc-aa00-d70d856b0012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:32.248037 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:32.308891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-950d7471-9538-45e3-86e4-8237f8a61046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3490be04af0b456d9983e54b81061639', 'request_id': 'req-950d7471-9538-45e3-86e4-8237f8a61046'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:32.325239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-950d7471-9538-45e3-86e4-8237f8a61046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3490be04af0b456d9983e54b81061639', 'request_id': 'req-950d7471-9538-45e3-86e4-8237f8a61046'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:32.336142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bec790-5737-46cc-aa00-d70d856b0012 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:32.341155 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-950d7471-9538-45e3-86e4-8237f8a61046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3490be04af0b456d9983e54b81061639', 'request_id': 'req-950d7471-9538-45e3-86e4-8237f8a61046'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:32.378715 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-950d7471-9538-45e3-86e4-8237f8a61046 admin admin] The token cache is being invalidate because project 3490be04af0b456d9983e54b81061639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:31:32.384022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-950d7471-9538-45e3-86e4-8237f8a61046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:32.386500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-950d7471-9538-45e3-86e4-8237f8a61046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:32.395259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 863/1740] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:31:32 2022] DELETE /identity/v3/projects/3490be04af0b456d9983e54b81061639 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:32.395970 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d7471-9538-45e3-86e4-8237f8a61046 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:32.398507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-950d7471-9538-45e3-86e4-8237f8a61046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:32.470114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e696b-34c0-4ed8-876c-b69b171f8400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:32.471484 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e696b-34c0-4ed8-876c-b69b171f8400 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:32.473266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e696b-34c0-4ed8-876c-b69b171f8400 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:32.473762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e696b-34c0-4ed8-876c-b69b171f8400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:32.478662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1f4e696b-34c0-4ed8-876c-b69b171f8400 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:32.499423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d7471-9538-45e3-86e4-8237f8a61046 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:32.505713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e0f03-ff21-4101-9a1b-a49f5529cec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:32.506422 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e0f03-ff21-4101-9a1b-a49f5529cec4 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:32.506708 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e0f03-ff21-4101-9a1b-a49f5529cec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:32.507017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e0f03-ff21-4101-9a1b-a49f5529cec4 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:32.508148 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e0f03-ff21-4101-9a1b-a49f5529cec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:32.510110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e0f03-ff21-4101-9a1b-a49f5529cec4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:32.543110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 864/1741] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:32 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:32.544116 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e0f03-ff21-4101-9a1b-a49f5529cec4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:32.547778 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-463e0f03-ff21-4101-9a1b-a49f5529cec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:32.570682 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e0f03-ff21-4101-9a1b-a49f5529cec4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:32.577869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6231c5-2748-41d7-8adb-60e825129119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:32.579050 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6231c5-2748-41d7-8adb-60e825129119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:32.579344 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6231c5-2748-41d7-8adb-60e825129119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:32.579807 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6231c5-2748-41d7-8adb-60e825129119 admin admin] PATH_INFO: `/v3/users/75a7facec5664d00ae1e78678f548598` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:32.581141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6231c5-2748-41d7-8adb-60e825129119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a7facec5664d00ae1e78678f548598)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:32.583562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6231c5-2748-41d7-8adb-60e825129119 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:32.644374 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e696b-34c0-4ed8-876c-b69b171f8400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:32.650652 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e696b-34c0-4ed8-876c-b69b171f8400 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:32.676933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fb6231c5-2748-41d7-8adb-60e825129119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a7facec5664d00ae1e78678f548598'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:32.683590 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 878/1742] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:32.684695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e696b-34c0-4ed8-876c-b69b171f8400 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:32.693566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fb6231c5-2748-41d7-8adb-60e825129119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a7facec5664d00ae1e78678f548598'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:32.719261 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fb6231c5-2748-41d7-8adb-60e825129119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a7facec5664d00ae1e78678f548598'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:32.736445 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e696b-34c0-4ed8-876c-b69b171f8400 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:32.743043 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fb6231c5-2748-41d7-8adb-60e825129119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a7facec5664d00ae1e78678f548598'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:32.743923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fb6231c5-2748-41d7-8adb-60e825129119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a7facec5664d00ae1e78678f548598'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:32.748129 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=78,keystone:DELETE=17,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:32.758575 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6af25-84df-4203-999e-3fe841ec7d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:32.767910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6af25-84df-4203-999e-3fe841ec7d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:32.768309 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6af25-84df-4203-999e-3fe841ec7d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:32.768595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6af25-84df-4203-999e-3fe841ec7d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:32.770115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6af25-84df-4203-999e-3fe841ec7d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:32.773595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 865/1743] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:31:32 2022] DELETE /identity/v3/users/75a7facec5664d00ae1e78678f548598 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:32.775667 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6af25-84df-4203-999e-3fe841ec7d6f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:32.794893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6231c5-2748-41d7-8adb-60e825129119 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:32.803111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 879/1744] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:32.804366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fb6231c5-2748-41d7-8adb-60e825129119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:32.812065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6af25-84df-4203-999e-3fe841ec7d6f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:32.814993 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3ec6af25-84df-4203-999e-3fe841ec7d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:32.846087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6af25-84df-4203-999e-3fe841ec7d6f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:32.981299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf44f8e-8a35-4301-8399-a5e8705a7eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:32.982203 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf44f8e-8a35-4301-8399-a5e8705a7eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:32.982476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf44f8e-8a35-4301-8399-a5e8705a7eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:32.982769 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf44f8e-8a35-4301-8399-a5e8705a7eb8 admin admin] PATH_INFO: `/v3/projects/6a38e7eba1c84937b47e8938c779e7df/users/78132faa91bd42029d0c8c2868b68763/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:33.021118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf44f8e-8a35-4301-8399-a5e8705a7eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a38e7eba1c84937b47e8938c779e7df, user_id=78132faa91bd42029d0c8c2868b68763, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:33.023829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf44f8e-8a35-4301-8399-a5e8705a7eb8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:33.024195 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6231c5-2748-41d7-8adb-60e825129119 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:33.043626 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110aa54-914f-4b9f-aaf1-9b6a0ab65c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:33.044606 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110aa54-914f-4b9f-aaf1-9b6a0ab65c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:33.044944 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110aa54-914f-4b9f-aaf1-9b6a0ab65c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:33.045370 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110aa54-914f-4b9f-aaf1-9b6a0ab65c3e admin admin] PATH_INFO: `/v3/projects/ff5f5e4c32d74cd99bd079d09a796907` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:33.046868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110aa54-914f-4b9f-aaf1-9b6a0ab65c3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff5f5e4c32d74cd99bd079d09a796907)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:33.048995 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110aa54-914f-4b9f-aaf1-9b6a0ab65c3e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:33.054846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:33.060863 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 880/1745] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:32 2022] PUT /identity/v3/projects/6a38e7eba1c84937b47e8938c779e7df/users/78132faa91bd42029d0c8c2868b68763/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:33.064920 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf44f8e-8a35-4301-8399-a5e8705a7eb8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:33.208840 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8110aa54-914f-4b9f-aaf1-9b6a0ab65c3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff5f5e4c32d74cd99bd079d09a796907', 'request_id': 'req-8110aa54-914f-4b9f-aaf1-9b6a0ab65c3e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:33.237673 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8110aa54-914f-4b9f-aaf1-9b6a0ab65c3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff5f5e4c32d74cd99bd079d09a796907', 'request_id': 'req-8110aa54-914f-4b9f-aaf1-9b6a0ab65c3e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:33.260724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8110aa54-914f-4b9f-aaf1-9b6a0ab65c3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff5f5e4c32d74cd99bd079d09a796907', 'request_id': 'req-8110aa54-914f-4b9f-aaf1-9b6a0ab65c3e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:33.311409 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8110aa54-914f-4b9f-aaf1-9b6a0ab65c3e admin admin] The token cache is being invalidate because project ff5f5e4c32d74cd99bd079d09a796907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:31:33.311711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8110aa54-914f-4b9f-aaf1-9b6a0ab65c3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:33.312458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8110aa54-914f-4b9f-aaf1-9b6a0ab65c3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:33.329742 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 866/1746] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:31:32 2022] DELETE /identity/v3/projects/ff5f5e4c32d74cd99bd079d09a796907 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:33.331230 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf44f8e-8a35-4301-8399-a5e8705a7eb8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:33.331647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8cca1-d4f4-4a2a-a942-32724af47d55 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:33.332006 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8cca1-d4f4-4a2a-a942-32724af47d55 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:33.332796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8cca1-d4f4-4a2a-a942-32724af47d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:33.406904 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d0a8cca1-d4f4-4a2a-a942-32724af47d55 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:33.408176 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d0a8cca1-d4f4-4a2a-a942-32724af47d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:33.536456 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c657205-f736-4384-b1fe-de539cf0e48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:33.538879 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c657205-f736-4384-b1fe-de539cf0e48d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:33.539897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c657205-f736-4384-b1fe-de539cf0e48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:33.541700 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c657205-f736-4384-b1fe-de539cf0e48d admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:33.543007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c657205-f736-4384-b1fe-de539cf0e48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:33.547838 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c657205-f736-4384-b1fe-de539cf0e48d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:33.627314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 881/1747] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 563 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:31:33.632450 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd6c79-a70f-4e8b-be64-665f6249a6c4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:33.632744 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd6c79-a70f-4e8b-be64-665f6249a6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:33.633029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd6c79-a70f-4e8b-be64-665f6249a6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:33.783024 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 867/1748] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:33.805283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8cca1-d4f4-4a2a-a942-32724af47d55 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:33.810441 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-82dd6c79-a70f-4e8b-be64-665f6249a6c4 None None] MFA Rules not processed for user `7713fb28e4884d4e903a40b867347b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:33.814954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d0a8cca1-d4f4-4a2a-a942-32724af47d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:33.838789 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-82dd6c79-a70f-4e8b-be64-665f6249a6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:33.875369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8cca1-d4f4-4a2a-a942-32724af47d55 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:33.899577 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f4f27-883d-4b4f-9694-fb2f8d999bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:33.900481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f4f27-883d-4b4f-9694-fb2f8d999bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:33.900763 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f4f27-883d-4b4f-9694-fb2f8d999bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:33.901044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f4f27-883d-4b4f-9694-fb2f8d999bb7 admin admin] PATH_INFO: `/v3/projects/8d1c559a773841819e14aa7b0d54d74f` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:33.903429 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f4f27-883d-4b4f-9694-fb2f8d999bb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d1c559a773841819e14aa7b0d54d74f)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:33.905888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f4f27-883d-4b4f-9694-fb2f8d999bb7 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:34.013233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:34.105130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-098f4f27-883d-4b4f-9694-fb2f8d999bb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d1c559a773841819e14aa7b0d54d74f', 'request_id': 'req-098f4f27-883d-4b4f-9694-fb2f8d999bb7'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:34.109366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 882/1749] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:34.110226 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd6c79-a70f-4e8b-be64-665f6249a6c4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:34.111588 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-82dd6c79-a70f-4e8b-be64-665f6249a6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:34.137404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-098f4f27-883d-4b4f-9694-fb2f8d999bb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d1c559a773841819e14aa7b0d54d74f', 'request_id': 'req-098f4f27-883d-4b4f-9694-fb2f8d999bb7'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:34.152467 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-098f4f27-883d-4b4f-9694-fb2f8d999bb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d1c559a773841819e14aa7b0d54d74f', 'request_id': 'req-098f4f27-883d-4b4f-9694-fb2f8d999bb7'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:34.162286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd6c79-a70f-4e8b-be64-665f6249a6c4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:34.178396 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-098f4f27-883d-4b4f-9694-fb2f8d999bb7 admin admin] The token cache is being invalidate because project 8d1c559a773841819e14aa7b0d54d74f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:31:34.178396 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-098f4f27-883d-4b4f-9694-fb2f8d999bb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:34.181733 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-098f4f27-883d-4b4f-9694-fb2f8d999bb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:34.189841 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 868/1750] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:31:33 2022] DELETE /identity/v3/projects/8d1c559a773841819e14aa7b0d54d74f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:34.189841 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e073b36-8d95-4fe4-b0ba-57dbbdd8b8b7 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:34.189841 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e073b36-8d95-4fe4-b0ba-57dbbdd8b8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:34.190955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e073b36-8d95-4fe4-b0ba-57dbbdd8b8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:34.218288 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4e073b36-8d95-4fe4-b0ba-57dbbdd8b8b7 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:34.219930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4e073b36-8d95-4fe4-b0ba-57dbbdd8b8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:34.273951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:34.311074 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e1b43-2863-43c2-9401-1efc05042c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:34.312271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e1b43-2863-43c2-9401-1efc05042c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:34.312552 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e1b43-2863-43c2-9401-1efc05042c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:34.335502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e1b43-2863-43c2-9401-1efc05042c1e admin admin] PATH_INFO: `/v3/projects/6a38e7eba1c84937b47e8938c779e7df/users/78132faa91bd42029d0c8c2868b68763/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:34.340413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e1b43-2863-43c2-9401-1efc05042c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a38e7eba1c84937b47e8938c779e7df, user_id=78132faa91bd42029d0c8c2868b68763, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:34.346291 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e1b43-2863-43c2-9401-1efc05042c1e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:34.366910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 883/1751] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:34 2022] PUT /identity/v3/projects/6a38e7eba1c84937b47e8938c779e7df/users/78132faa91bd42029d0c8c2868b68763/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:34.366910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e1b43-2863-43c2-9401-1efc05042c1e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:34.374155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-840e1b43-2863-43c2-9401-1efc05042c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:34.527780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 869/1752] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:34.531691 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93418b96-385b-4199-92cf-e2391f904df9 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:34.531993 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93418b96-385b-4199-92cf-e2391f904df9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:34.532282 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93418b96-385b-4199-92cf-e2391f904df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:34.542039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e1b43-2863-43c2-9401-1efc05042c1e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:34.559242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adeb1a-0fe3-45d7-b69c-b90c74001485 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:34.562603 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adeb1a-0fe3-45d7-b69c-b90c74001485 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:34.563135 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adeb1a-0fe3-45d7-b69c-b90c74001485 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:34.563552 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adeb1a-0fe3-45d7-b69c-b90c74001485 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:34.571266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-25adeb1a-0fe3-45d7-b69c-b90c74001485 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:34.608870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-93418b96-385b-4199-92cf-e2391f904df9 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:34.610175 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-93418b96-385b-4199-92cf-e2391f904df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:34.721644 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adeb1a-0fe3-45d7-b69c-b90c74001485 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:34.723774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adeb1a-0fe3-45d7-b69c-b90c74001485 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:34.767185 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 884/1753] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:34.768985 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc4eb1-60ce-422f-aba0-23ee5fc932b1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:34.769273 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc4eb1-60ce-422f-aba0-23ee5fc932b1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:34.769615 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc4eb1-60ce-422f-aba0-23ee5fc932b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:34.867139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-42cc4eb1-60ce-422f-aba0-23ee5fc932b1 None None] MFA Rules not processed for user `2410dc00847f42eb853780b399950899`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:34.868383 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-42cc4eb1-60ce-422f-aba0-23ee5fc932b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:34.890343 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 870/1754] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:34.890343 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db712a96-adfc-4764-afe7-bbd0c0001159 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:34.890343 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db712a96-adfc-4764-afe7-bbd0c0001159 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:34.890343 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db712a96-adfc-4764-afe7-bbd0c0001159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:35.084750 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:35.097228 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-db712a96-adfc-4764-afe7-bbd0c0001159 None None] MFA Rules not processed for user `18030043de1942779baf3ad94aec4071`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:35.099616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-db712a96-adfc-4764-afe7-bbd0c0001159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:35.131479 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 885/1755] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:35.132499 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc4eb1-60ce-422f-aba0-23ee5fc932b1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:35.159889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:35.170418 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc4eb1-60ce-422f-aba0-23ee5fc932b1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:35.182331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f180a1-de47-42d4-9ae4-7d8c721ee7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:35.183134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f180a1-de47-42d4-9ae4-7d8c721ee7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:35.183496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f180a1-de47-42d4-9ae4-7d8c721ee7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:35.183846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f180a1-de47-42d4-9ae4-7d8c721ee7d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:35.184842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f180a1-de47-42d4-9ae4-7d8c721ee7d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:31:35.185229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f180a1-de47-42d4-9ae4-7d8c721ee7d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:35.188273 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f180a1-de47-42d4-9ae4-7d8c721ee7d1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:35.216612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 886/1756] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:31:35.223614 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122b3b6-7bf9-4f5c-8b81-5ee1e8a56b94 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:35.223849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122b3b6-7bf9-4f5c-8b81-5ee1e8a56b94 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:35.224107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122b3b6-7bf9-4f5c-8b81-5ee1e8a56b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:35.234593 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 871/1757] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 19 12:31:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:35.236506 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abb064-8c7f-4e4b-af4d-ca1a8f2e5f93 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:35.236862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abb064-8c7f-4e4b-af4d-ca1a8f2e5f93 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:35.237212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abb064-8c7f-4e4b-af4d-ca1a8f2e5f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:35.283964 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d122b3b6-7bf9-4f5c-8b81-5ee1e8a56b94 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:35.285900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d122b3b6-7bf9-4f5c-8b81-5ee1e8a56b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:35.304989 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c8abb064-8c7f-4e4b-af4d-ca1a8f2e5f93 None None] MFA Rules not processed for user `2410dc00847f42eb853780b399950899`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:35.309457 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 887/1758] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:35.310380 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122b3b6-7bf9-4f5c-8b81-5ee1e8a56b94 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:35.312898 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c8abb064-8c7f-4e4b-af4d-ca1a8f2e5f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:35.329085 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122b3b6-7bf9-4f5c-8b81-5ee1e8a56b94 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:35.335518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 872/1759] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:35.336440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abb064-8c7f-4e4b-af4d-ca1a8f2e5f93 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:35.346797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfa4fc-5d47-4989-9b07-3fa6b7ffc4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:35.347514 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfa4fc-5d47-4989-9b07-3fa6b7ffc4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:35.347677 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfa4fc-5d47-4989-9b07-3fa6b7ffc4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:35.347935 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfa4fc-5d47-4989-9b07-3fa6b7ffc4f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:35.349434 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfa4fc-5d47-4989-9b07-3fa6b7ffc4f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:35.351429 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfa4fc-5d47-4989-9b07-3fa6b7ffc4f8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:35.352243 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abb064-8c7f-4e4b-af4d-ca1a8f2e5f93 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:35.370551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe31ad-aa76-43f3-8c45-fc18b86e5b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:35.373504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe31ad-aa76-43f3-8c45-fc18b86e5b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:35.373937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe31ad-aa76-43f3-8c45-fc18b86e5b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:35.374320 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe31ad-aa76-43f3-8c45-fc18b86e5b6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:35.380916 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe31ad-aa76-43f3-8c45-fc18b86e5b6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:31:35.382340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe31ad-aa76-43f3-8c45-fc18b86e5b6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:35.405640 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe31ad-aa76-43f3-8c45-fc18b86e5b6c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:35.428222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 888/1760] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:35 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:35.429262 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfa4fc-5d47-4989-9b07-3fa6b7ffc4f8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:35.438949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c0cfa4fc-5d47-4989-9b07-3fa6b7ffc4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:35.444507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 873/1761] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:31:35.446071 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe31ad-aa76-43f3-8c45-fc18b86e5b6c admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:35.472879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe31ad-aa76-43f3-8c45-fc18b86e5b6c admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:35.594417 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372530ad-aa5a-4be6-a530-74846ecce874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:35.596134 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372530ad-aa5a-4be6-a530-74846ecce874 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:35.597050 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372530ad-aa5a-4be6-a530-74846ecce874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:35.598171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372530ad-aa5a-4be6-a530-74846ecce874 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:35.599139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372530ad-aa5a-4be6-a530-74846ecce874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:35.601591 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372530ad-aa5a-4be6-a530-74846ecce874 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:35.627229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfa4fc-5d47-4989-9b07-3fa6b7ffc4f8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:35.633752 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 874/1762] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:35 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:35.634651 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372530ad-aa5a-4be6-a530-74846ecce874 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:35.647145 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73d77a-3347-46dc-9944-13c15e75b7ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:35.648603 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73d77a-3347-46dc-9944-13c15e75b7ba service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:35.648895 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73d77a-3347-46dc-9944-13c15e75b7ba service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:35.649177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73d77a-3347-46dc-9944-13c15e75b7ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:35.650608 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372530ad-aa5a-4be6-a530-74846ecce874 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:35.655732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285b1bf-71ce-451e-8697-e9971dc9e976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:35.656499 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285b1bf-71ce-451e-8697-e9971dc9e976 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:35.656870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285b1bf-71ce-451e-8697-e9971dc9e976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:35.657196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285b1bf-71ce-451e-8697-e9971dc9e976 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:35.657906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285b1bf-71ce-451e-8697-e9971dc9e976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:35.660486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285b1bf-71ce-451e-8697-e9971dc9e976 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:35.716584 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 875/1763] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:35 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:35.716584 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285b1bf-71ce-451e-8697-e9971dc9e976 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:35.718964 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1285b1bf-71ce-451e-8697-e9971dc9e976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:35.815615 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73d77a-3347-46dc-9944-13c15e75b7ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:35.817312 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73d77a-3347-46dc-9944-13c15e75b7ba service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:35.842266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 889/1764] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:35.842936 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73d77a-3347-46dc-9944-13c15e75b7ba service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:35.872288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73d77a-3347-46dc-9944-13c15e75b7ba service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:35.981226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:35.994838 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:36.040919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285b1bf-71ce-451e-8697-e9971dc9e976 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:36.042994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3bdfb-9f39-4206-a9f0-a6eb2651744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:36.043724 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3bdfb-9f39-4206-a9f0-a6eb2651744b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:36.044114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3bdfb-9f39-4206-a9f0-a6eb2651744b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:36.044426 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3bdfb-9f39-4206-a9f0-a6eb2651744b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:36.050257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3bdfb-9f39-4206-a9f0-a6eb2651744b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:36.052896 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3bdfb-9f39-4206-a9f0-a6eb2651744b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:36.083652 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 890/1765] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:36.083842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b27af1-7e11-44b1-bbad-1711834c72e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc2e1079d34745a279588028945c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:36.083842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b27af1-7e11-44b1-bbad-1711834c72e0 service swift] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:36.085222 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b27af1-7e11-44b1-bbad-1711834c72e0 service swift] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:36.086369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b27af1-7e11-44b1-bbad-1711834c72e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:36.097926 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3bdfb-9f39-4206-a9f0-a6eb2651744b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:36.133553 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3bdfb-9f39-4206-a9f0-a6eb2651744b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:36.156020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99420e58-72c4-43b1-a29e-15a5dcb4b47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:36.157610 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99420e58-72c4-43b1-a29e-15a5dcb4b47a admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:36.160584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99420e58-72c4-43b1-a29e-15a5dcb4b47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:36.163331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99420e58-72c4-43b1-a29e-15a5dcb4b47a admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:36.168019 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99420e58-72c4-43b1-a29e-15a5dcb4b47a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:36.173538 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99420e58-72c4-43b1-a29e-15a5dcb4b47a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:36.251259 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 891/1766] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:36 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:36.252347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99420e58-72c4-43b1-a29e-15a5dcb4b47a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:36.262201 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b27af1-7e11-44b1-bbad-1711834c72e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:36.264094 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b27af1-7e11-44b1-bbad-1711834c72e0 service swift] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:36.296998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99420e58-72c4-43b1-a29e-15a5dcb4b47a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:36.303526 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 876/1767] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 19 12:31:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:31:36.305871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b27af1-7e11-44b1-bbad-1711834c72e0 service swift] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:36.314309 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec84d58-4047-4853-aa64-902d0113c093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:36.314934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec84d58-4047-4853-aa64-902d0113c093 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:36.315223 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec84d58-4047-4853-aa64-902d0113c093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:36.315504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec84d58-4047-4853-aa64-902d0113c093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:36.316918 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec84d58-4047-4853-aa64-902d0113c093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:36.321848 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec84d58-4047-4853-aa64-902d0113c093 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:36.336900 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b27af1-7e11-44b1-bbad-1711834c72e0 service swift] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:36.349997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d8a6d-1aff-4811-9683-c403ce8bf54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:36.350905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d8a6d-1aff-4811-9683-c403ce8bf54f admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:36.351550 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d8a6d-1aff-4811-9683-c403ce8bf54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:36.352583 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d8a6d-1aff-4811-9683-c403ce8bf54f admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:36.353827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d8a6d-1aff-4811-9683-c403ce8bf54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:36.367954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 892/1768] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:36.381094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec84d58-4047-4853-aa64-902d0113c093 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:36.383741 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d8a6d-1aff-4811-9683-c403ce8bf54f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:36.407017 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec84d58-4047-4853-aa64-902d0113c093 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:36.429353 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc4d3e-d406-4f39-ad17-09f9b53cfa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:36.430502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc4d3e-d406-4f39-ad17-09f9b53cfa19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:36.430807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc4d3e-d406-4f39-ad17-09f9b53cfa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:36.431086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc4d3e-d406-4f39-ad17-09f9b53cfa19 admin admin] PATH_INFO: `/v3/projects/ff162f7e2adc4dd8a464bac5d0f4b313/users/b2062e2ea5564250ae838e538ce78565/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:36.438137 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 877/1769] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:36.445632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d8a6d-1aff-4811-9683-c403ce8bf54f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:36.481651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc4d3e-d406-4f39-ad17-09f9b53cfa19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff162f7e2adc4dd8a464bac5d0f4b313, user_id=b2062e2ea5564250ae838e538ce78565, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:36.484902 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc4d3e-d406-4f39-ad17-09f9b53cfa19 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:36.490516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d8a6d-1aff-4811-9683-c403ce8bf54f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:36.506608 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a541e68-0c9f-406e-9a6c-fa9af97f45d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:36.507580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a541e68-0c9f-406e-9a6c-fa9af97f45d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:36.508023 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a541e68-0c9f-406e-9a6c-fa9af97f45d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:36.508404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a541e68-0c9f-406e-9a6c-fa9af97f45d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:36.510483 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a541e68-0c9f-406e-9a6c-fa9af97f45d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:36.523604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 893/1770] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:36 2022] PUT /identity/v3/projects/ff162f7e2adc4dd8a464bac5d0f4b313/users/b2062e2ea5564250ae838e538ce78565/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:36.523832 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a541e68-0c9f-406e-9a6c-fa9af97f45d6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:36.525606 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90360e9-70ec-43af-ba66-efe95dababcb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:36.526054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90360e9-70ec-43af-ba66-efe95dababcb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:36.526463 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90360e9-70ec-43af-ba66-efe95dababcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:36.562512 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 878/1771] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:36.572075 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a541e68-0c9f-406e-9a6c-fa9af97f45d6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:36.612976 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a541e68-0c9f-406e-9a6c-fa9af97f45d6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:36.637554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d90360e9-70ec-43af-ba66-efe95dababcb None None] MFA Rules not processed for user `b2062e2ea5564250ae838e538ce78565`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:36.647356 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d90360e9-70ec-43af-ba66-efe95dababcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:36.887816 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735b313-25dc-43fb-972f-15cf3ec3ad93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:36.888607 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735b313-25dc-43fb-972f-15cf3ec3ad93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:36.900408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735b313-25dc-43fb-972f-15cf3ec3ad93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:36.900408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735b313-25dc-43fb-972f-15cf3ec3ad93 admin admin] PATH_INFO: `/v3/projects/0b0859c9d8e84a33ac2ef29333cf0ea1/users/1de6e25266a34216ba44d7581203705e/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:37.010603 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 894/1772] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:37.021394 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c14bdc-a50b-41d6-a5da-d1a0fb08b2ce None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:37.021680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c14bdc-a50b-41d6-a5da-d1a0fb08b2ce None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:37.022564 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c14bdc-a50b-41d6-a5da-d1a0fb08b2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:37.035093 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735b313-25dc-43fb-972f-15cf3ec3ad93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b0859c9d8e84a33ac2ef29333cf0ea1, user_id=1de6e25266a34216ba44d7581203705e, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:37.042312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735b313-25dc-43fb-972f-15cf3ec3ad93 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:37.087324 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 879/1773] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:36 2022] PUT /identity/v3/projects/0b0859c9d8e84a33ac2ef29333cf0ea1/users/1de6e25266a34216ba44d7581203705e/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:37.088852 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-28c14bdc-a50b-41d6-a5da-d1a0fb08b2ce None None] MFA Rules not processed for user `977392666b5a4076884416489b935ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:37.091600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-28c14bdc-a50b-41d6-a5da-d1a0fb08b2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:37.099918 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735b313-25dc-43fb-972f-15cf3ec3ad93 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:37.101575 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b735b313-25dc-43fb-972f-15cf3ec3ad93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:37.233193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:37.289831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735b313-25dc-43fb-972f-15cf3ec3ad93 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:37.298151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2295bd-a827-4743-a874-286039a93700 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1af8b237e2df41668bc5409d8fdd3f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:37.301916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 895/1774] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Jul 19 12:31:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:37.302430 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2295bd-a827-4743-a874-286039a93700 service glance] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:37.302798 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2295bd-a827-4743-a874-286039a93700 service glance] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:37.303961 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2295bd-a827-4743-a874-286039a93700 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:37.304828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad6f79-728a-473a-a22e-025abe782827 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:37.305131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad6f79-728a-473a-a22e-025abe782827 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:37.305407 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad6f79-728a-473a-a22e-025abe782827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:37.407996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-43ad6f79-728a-473a-a22e-025abe782827 None None] MFA Rules not processed for user `1de6e25266a34216ba44d7581203705e`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:37.413167 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-43ad6f79-728a-473a-a22e-025abe782827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:37.508911 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:37.532511 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2295bd-a827-4743-a874-286039a93700 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:37.534702 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2295bd-a827-4743-a874-286039a93700 service glance] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:37.571794 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 880/1775] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:37.576139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2295bd-a827-4743-a874-286039a93700 service glance] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:37.584887 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8b2295bd-a827-4743-a874-286039a93700 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:37.627151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2295bd-a827-4743-a874-286039a93700 service glance] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:37.640204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638a873-06a0-4ca0-9763-c8124a5a4040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:37.640886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638a873-06a0-4ca0-9763-c8124a5a4040 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:37.641234 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638a873-06a0-4ca0-9763-c8124a5a4040 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:37.641503 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638a873-06a0-4ca0-9763-c8124a5a4040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:37.663392 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 896/1776] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:37.668145 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad6f79-728a-473a-a22e-025abe782827 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:37.690123 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638a873-06a0-4ca0-9763-c8124a5a4040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:37.715532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638a873-06a0-4ca0-9763-c8124a5a4040 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:37.758261 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 881/1777] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:37.882463 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad6f79-728a-473a-a22e-025abe782827 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:37.891694 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f105f-ad9c-4b8e-bc48-2a177666a977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:37.893355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f105f-ad9c-4b8e-bc48-2a177666a977 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:37.897218 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f105f-ad9c-4b8e-bc48-2a177666a977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:37.897606 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f105f-ad9c-4b8e-bc48-2a177666a977 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:37.898573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f105f-ad9c-4b8e-bc48-2a177666a977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:37.902292 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f105f-ad9c-4b8e-bc48-2a177666a977 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:37.962931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 897/1778] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:37 2022] POST /identity/v3/projects => generated 387 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:37.964923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638a873-06a0-4ca0-9763-c8124a5a4040 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:37.999034 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638a873-06a0-4ca0-9763-c8124a5a4040 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:38.292240 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b789f-7c0a-4210-a102-acd3a14787ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:38.293880 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b789f-7c0a-4210-a102-acd3a14787ac admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:38.294460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b789f-7c0a-4210-a102-acd3a14787ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:38.297026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b789f-7c0a-4210-a102-acd3a14787ac admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:38.297982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b789f-7c0a-4210-a102-acd3a14787ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:38.302392 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b789f-7c0a-4210-a102-acd3a14787ac admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:38.373250 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f105f-ad9c-4b8e-bc48-2a177666a977 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:38.373695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 882/1779] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:37 2022] POST /identity/v3/users => generated 294 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:38.404507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd57580-fc90-4faa-90dd-c33e93478a4d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:38.406719 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f105f-ad9c-4b8e-bc48-2a177666a977 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:38.407117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd57580-fc90-4faa-90dd-c33e93478a4d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:38.407549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd57580-fc90-4faa-90dd-c33e93478a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:38.430042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9b68f-b22f-4764-9b65-49a4b961a7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:38.431147 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9b68f-b22f-4764-9b65-49a4b961a7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:38.432950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9b68f-b22f-4764-9b65-49a4b961a7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:38.435955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9b68f-b22f-4764-9b65-49a4b961a7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:38.438556 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9b68f-b22f-4764-9b65-49a4b961a7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:38.447560 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9b68f-b22f-4764-9b65-49a4b961a7c0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:38.490118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 898/1780] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:31:38.492940 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9b68f-b22f-4764-9b65-49a4b961a7c0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:38.497018 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4fd57580-fc90-4faa-90dd-c33e93478a4d None None] MFA Rules not processed for user `78132faa91bd42029d0c8c2868b68763`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:38.498032 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4fd57580-fc90-4faa-90dd-c33e93478a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:38.545009 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9b68f-b22f-4764-9b65-49a4b961a7c0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:38.569023 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635d401-0da3-44c1-9ad1-6452fa1d464f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:38.572217 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635d401-0da3-44c1-9ad1-6452fa1d464f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:38.577918 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635d401-0da3-44c1-9ad1-6452fa1d464f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:38.579620 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635d401-0da3-44c1-9ad1-6452fa1d464f admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:38.581200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635d401-0da3-44c1-9ad1-6452fa1d464f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:38.595329 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635d401-0da3-44c1-9ad1-6452fa1d464f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:38.708943 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 899/1781] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:38.715105 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635d401-0da3-44c1-9ad1-6452fa1d464f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:38.764542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635d401-0da3-44c1-9ad1-6452fa1d464f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:38.807729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8192dbd-2e15-4827-9e46-fe9d99310f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:38.814483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8192dbd-2e15-4827-9e46-fe9d99310f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:38.815123 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8192dbd-2e15-4827-9e46-fe9d99310f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:38.815404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8192dbd-2e15-4827-9e46-fe9d99310f17 admin admin] PATH_INFO: `/v3/projects/8da0a5d66bef4a8aa3879c61cfa1f5e7/users/6969c8970419420d9aad0b785f850adb/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:38.839264 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:38.870408 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8192dbd-2e15-4827-9e46-fe9d99310f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8da0a5d66bef4a8aa3879c61cfa1f5e7, user_id=6969c8970419420d9aad0b785f850adb, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:38.898101 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8192dbd-2e15-4827-9e46-fe9d99310f17 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:38.945702 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 900/1782] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:38 2022] PUT /identity/v3/projects/8da0a5d66bef4a8aa3879c61cfa1f5e7/users/6969c8970419420d9aad0b785f850adb/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:38.968980 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 883/1783] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 565 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:38.969285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0e790-1052-4c82-9e03-ed6fc1b00531 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:38.969864 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0e790-1052-4c82-9e03-ed6fc1b00531 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:38.970868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0e790-1052-4c82-9e03-ed6fc1b00531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:38.974680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bfb91-a8f3-4bfb-8eb8-ddc2b46319cb None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:38.975003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bfb91-a8f3-4bfb-8eb8-ddc2b46319cb None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:38.984698 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bfb91-a8f3-4bfb-8eb8-ddc2b46319cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:39.031123 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-00d0e790-1052-4c82-9e03-ed6fc1b00531 None None] MFA Rules not processed for user `2410dc00847f42eb853780b399950899`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:39.040899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-00d0e790-1052-4c82-9e03-ed6fc1b00531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:39.065984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-5e0bfb91-a8f3-4bfb-8eb8-ddc2b46319cb None None] MFA Rules not processed for user `6969c8970419420d9aad0b785f850adb`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:39.071335 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5e0bfb91-a8f3-4bfb-8eb8-ddc2b46319cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:39.268805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 901/1784] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:39.281357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c71a89-bd2e-463d-b849-7a317b58194d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:39.281829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c71a89-bd2e-463d-b849-7a317b58194d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:39.287212 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c71a89-bd2e-463d-b849-7a317b58194d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:39.334902 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:39.403778 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 884/1785] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:39.406067 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bfb91-a8f3-4bfb-8eb8-ddc2b46319cb None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:39.416570 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-94c71a89-bd2e-463d-b849-7a317b58194d None None] MFA Rules not processed for user `0999b7fe05a141508c52c70a3cf46a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:39.428947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-94c71a89-bd2e-463d-b849-7a317b58194d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:39.836735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 902/1786] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 556 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:39.850454 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bfb91-a8f3-4bfb-8eb8-ddc2b46319cb None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:39.879109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4dbe8-8e8d-4c28-8d30-c11149c3afd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:39.883819 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4dbe8-8e8d-4c28-8d30-c11149c3afd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:39.884112 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4dbe8-8e8d-4c28-8d30-c11149c3afd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:39.884401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4dbe8-8e8d-4c28-8d30-c11149c3afd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:39.887436 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4dbe8-8e8d-4c28-8d30-c11149c3afd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:39.895124 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4dbe8-8e8d-4c28-8d30-c11149c3afd1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:40.015495 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c71a89-bd2e-463d-b849-7a317b58194d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:40.024102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 885/1787] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:39 2022] POST /identity/v3/projects => generated 385 bytes in 617 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:40.038849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c71a89-bd2e-463d-b849-7a317b58194d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:40.065258 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11921bac-df24-4872-8549-11f5757201b5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:40.065553 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11921bac-df24-4872-8549-11f5757201b5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:40.066684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11921bac-df24-4872-8549-11f5757201b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:40.163094 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-11921bac-df24-4872-8549-11f5757201b5 None None] MFA Rules not processed for user `18030043de1942779baf3ad94aec4071`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:40.165158 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-11921bac-df24-4872-8549-11f5757201b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:40.404245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc723f1-2917-4b2d-87f2-d10518637ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:40.405014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc723f1-2917-4b2d-87f2-d10518637ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:40.405473 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc723f1-2917-4b2d-87f2-d10518637ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:40.405772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc723f1-2917-4b2d-87f2-d10518637ae4 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:40.409276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc723f1-2917-4b2d-87f2-d10518637ae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:40.419244 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc723f1-2917-4b2d-87f2-d10518637ae4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:40.449535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 886/1788] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 19 12:31:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:40.472313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 903/1789] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:40 2022] POST /identity/v3/users => generated 299 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:40.476678 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11921bac-df24-4872-8549-11f5757201b5 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:40.481029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc723f1-2917-4b2d-87f2-d10518637ae4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:40.502541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11921bac-df24-4872-8549-11f5757201b5 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:40.523771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fbe2b-6d49-4bfc-90d7-f0f59a61d91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:40.526788 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fbe2b-6d49-4bfc-90d7-f0f59a61d91f admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:40.530384 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fbe2b-6d49-4bfc-90d7-f0f59a61d91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:40.530794 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fbe2b-6d49-4bfc-90d7-f0f59a61d91f admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:40.533714 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fbe2b-6d49-4bfc-90d7-f0f59a61d91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:40.540929 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fbe2b-6d49-4bfc-90d7-f0f59a61d91f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:40.562676 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:40.587078 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 887/1790] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:40.588250 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fbe2b-6d49-4bfc-90d7-f0f59a61d91f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:40.617561 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fbe2b-6d49-4bfc-90d7-f0f59a61d91f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:40.632951 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda84b05-03a6-4d7e-b431-003ae25da59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:40.634053 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda84b05-03a6-4d7e-b431-003ae25da59b admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:40.636768 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda84b05-03a6-4d7e-b431-003ae25da59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:40.637746 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda84b05-03a6-4d7e-b431-003ae25da59b admin admin] PATH_INFO: `/v3/projects/0cb409d8ff8746a9a58385612199390c/users/6700f790d7514e7b8fc7ec53366c3a1c/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:40.712860 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda84b05-03a6-4d7e-b431-003ae25da59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb409d8ff8746a9a58385612199390c, user_id=6700f790d7514e7b8fc7ec53366c3a1c, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:40.724680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda84b05-03a6-4d7e-b431-003ae25da59b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:40.760336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 888/1791] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:40 2022] PUT /identity/v3/projects/0cb409d8ff8746a9a58385612199390c/users/6700f790d7514e7b8fc7ec53366c3a1c/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:40.765653 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda84b05-03a6-4d7e-b431-003ae25da59b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:40.790790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc723f1-2917-4b2d-87f2-d10518637ae4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:41.076351 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:41.087273 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda84b05-03a6-4d7e-b431-003ae25da59b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:41.105798 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f73b0-0153-420c-b3bd-1212042c6996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:41.106496 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f73b0-0153-420c-b3bd-1212042c6996 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:41.106815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f73b0-0153-420c-b3bd-1212042c6996 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:41.107099 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f73b0-0153-420c-b3bd-1212042c6996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:41.112209 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-397f73b0-0153-420c-b3bd-1212042c6996 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:41.158441 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ffbbd-9ded-49f1-aa74-fdd43b4e488b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc2e1079d34745a279588028945c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:41.159547 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ffbbd-9ded-49f1-aa74-fdd43b4e488b service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:41.160224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ffbbd-9ded-49f1-aa74-fdd43b4e488b service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:41.160814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ffbbd-9ded-49f1-aa74-fdd43b4e488b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:41.271473 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f73b0-0153-420c-b3bd-1212042c6996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:41.276303 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f73b0-0153-420c-b3bd-1212042c6996 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:41.315973 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 889/1792] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:41.319797 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f73b0-0153-420c-b3bd-1212042c6996 service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:41.426970 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ffbbd-9ded-49f1-aa74-fdd43b4e488b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:41.428587 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ffbbd-9ded-49f1-aa74-fdd43b4e488b service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:41.441548 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 904/1793] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 19 12:31:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 964 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:31:41.444563 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ed590-af74-4f8c-8139-9b65492c598e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:41.445050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ed590-af74-4f8c-8139-9b65492c598e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:41.445347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ed590-af74-4f8c-8139-9b65492c598e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:41.446794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 905/1794] 10.222.0.25 () {54 vars in 912 bytes} [Tue Jul 19 12:31:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:31:41.467430 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff7762-db70-4cf9-8973-d9aa4b84f15a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:41.467772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff7762-db70-4cf9-8973-d9aa4b84f15a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:41.467988 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff7762-db70-4cf9-8973-d9aa4b84f15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:41.524426 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f73b0-0153-420c-b3bd-1212042c6996 service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:41.541140 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae88ae0-95cd-4f85-be13-cf1ac91a1b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:41.543407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae88ae0-95cd-4f85-be13-cf1ac91a1b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:41.544915 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae88ae0-95cd-4f85-be13-cf1ac91a1b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:41.545784 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae88ae0-95cd-4f85-be13-cf1ac91a1b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:41.548062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae88ae0-95cd-4f85-be13-cf1ac91a1b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:41.554395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae88ae0-95cd-4f85-be13-cf1ac91a1b30 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:41.596426 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-82ff7762-db70-4cf9-8973-d9aa4b84f15a None None] MFA Rules not processed for user `977392666b5a4076884416489b935ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:41.602368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-82ff7762-db70-4cf9-8973-d9aa4b84f15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:41.611785 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 890/1795] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:41.614644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae88ae0-95cd-4f85-be13-cf1ac91a1b30 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:41.652223 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae88ae0-95cd-4f85-be13-cf1ac91a1b30 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:41.666467 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5b346-9b23-4013-8261-8cb33a24ab0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:41.671696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5b346-9b23-4013-8261-8cb33a24ab0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:41.672389 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5b346-9b23-4013-8261-8cb33a24ab0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:41.673063 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5b346-9b23-4013-8261-8cb33a24ab0f admin admin] PATH_INFO: `/v3/projects/0cb409d8ff8746a9a58385612199390c/users/6700f790d7514e7b8fc7ec53366c3a1c/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:41.682603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5b346-9b23-4013-8261-8cb33a24ab0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb409d8ff8746a9a58385612199390c, user_id=6700f790d7514e7b8fc7ec53366c3a1c, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:41.716661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5b346-9b23-4013-8261-8cb33a24ab0f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:41.732997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:41.757611 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 891/1796] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:41 2022] PUT /identity/v3/projects/0cb409d8ff8746a9a58385612199390c/users/6700f790d7514e7b8fc7ec53366c3a1c/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:41.769424 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b02d04-54dd-4680-965c-337fb5109716 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:41.769775 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b02d04-54dd-4680-965c-337fb5109716 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:41.770527 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b02d04-54dd-4680-965c-337fb5109716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:41.846793 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-17b02d04-54dd-4680-965c-337fb5109716 None None] MFA Rules not processed for user `6700f790d7514e7b8fc7ec53366c3a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:41.862441 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-17b02d04-54dd-4680-965c-337fb5109716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:41.890771 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 906/1797] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 19 12:31:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:41.972110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff7762-db70-4cf9-8973-d9aa4b84f15a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:41.973416 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-82ff7762-db70-4cf9-8973-d9aa4b84f15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:41.996441 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff7762-db70-4cf9-8973-d9aa4b84f15a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:42.135334 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 892/1798] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:31:42.137620 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617ab73-94b5-45ab-bcc3-c6d021b1261e None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:42.146316 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617ab73-94b5-45ab-bcc3-c6d021b1261e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:42.150170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617ab73-94b5-45ab-bcc3-c6d021b1261e None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:42.153670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 893/1799] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 19 12:31:42 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:31:42.156265 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617ab73-94b5-45ab-bcc3-c6d021b1261e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:42.163655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8617ab73-94b5-45ab-bcc3-c6d021b1261e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:42.171801 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b357c56-f7b4-43dc-97a1-a4ad95b3400d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:42.172439 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b357c56-f7b4-43dc-97a1-a4ad95b3400d service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:42.172715 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b357c56-f7b4-43dc-97a1-a4ad95b3400d service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:42.172982 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b357c56-f7b4-43dc-97a1-a4ad95b3400d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:42.211710 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b357c56-f7b4-43dc-97a1-a4ad95b3400d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:42.213189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b357c56-f7b4-43dc-97a1-a4ad95b3400d service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:42.231745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 907/1800] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:31:42.233020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee723765-354e-498a-8e02-7771cecf8317 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:42.233300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee723765-354e-498a-8e02-7771cecf8317 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:42.233567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee723765-354e-498a-8e02-7771cecf8317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:42.282796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ee723765-354e-498a-8e02-7771cecf8317 None None] MFA Rules not processed for user `5d9543657e1e4a6d85632bf57f6ba6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:42.290983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ee723765-354e-498a-8e02-7771cecf8317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:42.431834 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:42.451896 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617ab73-94b5-45ab-bcc3-c6d021b1261e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:42.461534 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594329e0-fa12-404d-a08d-f145d79f4c13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:42.462376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594329e0-fa12-404d-a08d-f145d79f4c13 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:42.463056 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594329e0-fa12-404d-a08d-f145d79f4c13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:42.464385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594329e0-fa12-404d-a08d-f145d79f4c13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:42.488810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594329e0-fa12-404d-a08d-f145d79f4c13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:42.490577 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594329e0-fa12-404d-a08d-f145d79f4c13 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:42.529929 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 894/1801] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:42.591054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 908/1802] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 19 12:31:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:43.743447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594329e0-fa12-404d-a08d-f145d79f4c13 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:43.745108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-594329e0-fa12-404d-a08d-f145d79f4c13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:43.807199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594329e0-fa12-404d-a08d-f145d79f4c13 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:43.833666 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c4281-4e7a-440e-ab04-e23863ab5427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:43.834813 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c4281-4e7a-440e-ab04-e23863ab5427 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:43.835875 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c4281-4e7a-440e-ab04-e23863ab5427 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:43.837981 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c4281-4e7a-440e-ab04-e23863ab5427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:44.146869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c4281-4e7a-440e-ab04-e23863ab5427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:44.152459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c4281-4e7a-440e-ab04-e23863ab5427 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:44.181212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 895/1803] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:44.569880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc1552-7100-4869-bd01-322278bc4403 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:44.570465 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc1552-7100-4869-bd01-322278bc4403 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:44.570465 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc1552-7100-4869-bd01-322278bc4403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:44.635321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cfbc1552-7100-4869-bd01-322278bc4403 None None] MFA Rules not processed for user `7713fb28e4884d4e903a40b867347b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:44.646962 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cfbc1552-7100-4869-bd01-322278bc4403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:44.953262 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 909/1804] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:45.479284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c4281-4e7a-440e-ab04-e23863ab5427 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:45.512090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c4281-4e7a-440e-ab04-e23863ab5427 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:45.527416 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847d7e0-dadf-417d-bd0d-0a34768cfe33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:45.528075 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847d7e0-dadf-417d-bd0d-0a34768cfe33 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:45.530969 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847d7e0-dadf-417d-bd0d-0a34768cfe33 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:45.532684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847d7e0-dadf-417d-bd0d-0a34768cfe33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:45.580233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847d7e0-dadf-417d-bd0d-0a34768cfe33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:45.588102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847d7e0-dadf-417d-bd0d-0a34768cfe33 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:45.629909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 896/1805] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:49.647553 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc1552-7100-4869-bd01-322278bc4403 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:49.658944 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc1552-7100-4869-bd01-322278bc4403 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:49.663808 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76070928-8dfb-406d-a4d6-3b6fc02e8a8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:49.664767 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76070928-8dfb-406d-a4d6-3b6fc02e8a8e service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:49.665054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76070928-8dfb-406d-a4d6-3b6fc02e8a8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:49.665328 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76070928-8dfb-406d-a4d6-3b6fc02e8a8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:49.728870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76070928-8dfb-406d-a4d6-3b6fc02e8a8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:49.730347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76070928-8dfb-406d-a4d6-3b6fc02e8a8e service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:49.748864 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 910/1806] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:52.561407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847d7e0-dadf-417d-bd0d-0a34768cfe33 service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:52.584452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:52.654800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847d7e0-dadf-417d-bd0d-0a34768cfe33 service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:52.662297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c89b56-29dd-4e83-94dc-d93ddceb5900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:52.663216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c89b56-29dd-4e83-94dc-d93ddceb5900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:52.663503 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c89b56-29dd-4e83-94dc-d93ddceb5900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:52.663785 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c89b56-29dd-4e83-94dc-d93ddceb5900 admin admin] PATH_INFO: `/v3/users/1de6e25266a34216ba44d7581203705e` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:52.665125 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c89b56-29dd-4e83-94dc-d93ddceb5900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de6e25266a34216ba44d7581203705e)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:52.667261 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c89b56-29dd-4e83-94dc-d93ddceb5900 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:52.745069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-56c89b56-29dd-4e83-94dc-d93ddceb5900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de6e25266a34216ba44d7581203705e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:52.754088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-56c89b56-29dd-4e83-94dc-d93ddceb5900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de6e25266a34216ba44d7581203705e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:52.766628 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-56c89b56-29dd-4e83-94dc-d93ddceb5900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de6e25266a34216ba44d7581203705e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:52.776115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-56c89b56-29dd-4e83-94dc-d93ddceb5900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de6e25266a34216ba44d7581203705e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:52.776911 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-56c89b56-29dd-4e83-94dc-d93ddceb5900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de6e25266a34216ba44d7581203705e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:52.783625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 897/1807] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:31:52 2022] DELETE /identity/v3/users/1de6e25266a34216ba44d7581203705e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:52.788664 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b31940-7376-47a7-8d50-429cc9658a55 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:52.789122 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b31940-7376-47a7-8d50-429cc9658a55 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:52.789192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b31940-7376-47a7-8d50-429cc9658a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:52.807156 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-99b31940-7376-47a7-8d50-429cc9658a55 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:52.808398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-99b31940-7376-47a7-8d50-429cc9658a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:52.869260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 911/1808] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:52.878978 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c89b56-29dd-4e83-94dc-d93ddceb5900 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:52.880361 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-56c89b56-29dd-4e83-94dc-d93ddceb5900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:52.940011 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c89b56-29dd-4e83-94dc-d93ddceb5900 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:52.943857 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8fca5-ca08-4cfa-b97b-c7f9a2ebc8a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:52.944517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8fca5-ca08-4cfa-b97b-c7f9a2ebc8a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:52.944801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8fca5-ca08-4cfa-b97b-c7f9a2ebc8a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:52.945081 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8fca5-ca08-4cfa-b97b-c7f9a2ebc8a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:52.956166 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8fca5-ca08-4cfa-b97b-c7f9a2ebc8a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:52.958164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8fca5-ca08-4cfa-b97b-c7f9a2ebc8a9 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:52.968101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 898/1809] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:31:53.310123 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b31940-7376-47a7-8d50-429cc9658a55 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:53.314067 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-99b31940-7376-47a7-8d50-429cc9658a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:53.380334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b31940-7376-47a7-8d50-429cc9658a55 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:53.392303 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df57b1-90f8-4cc7-9f6c-1bab65f10bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:53.395571 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df57b1-90f8-4cc7-9f6c-1bab65f10bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:53.396162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df57b1-90f8-4cc7-9f6c-1bab65f10bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:53.396670 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df57b1-90f8-4cc7-9f6c-1bab65f10bd7 admin admin] PATH_INFO: `/v3/projects/0b0859c9d8e84a33ac2ef29333cf0ea1` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:53.399998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df57b1-90f8-4cc7-9f6c-1bab65f10bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b0859c9d8e84a33ac2ef29333cf0ea1)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:53.408152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df57b1-90f8-4cc7-9f6c-1bab65f10bd7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:53.419613 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:53.467251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c0df57b1-90f8-4cc7-9f6c-1bab65f10bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b0859c9d8e84a33ac2ef29333cf0ea1', 'request_id': 'req-c0df57b1-90f8-4cc7-9f6c-1bab65f10bd7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:53.474351 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c0df57b1-90f8-4cc7-9f6c-1bab65f10bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b0859c9d8e84a33ac2ef29333cf0ea1', 'request_id': 'req-c0df57b1-90f8-4cc7-9f6c-1bab65f10bd7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:53.482699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c0df57b1-90f8-4cc7-9f6c-1bab65f10bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b0859c9d8e84a33ac2ef29333cf0ea1', 'request_id': 'req-c0df57b1-90f8-4cc7-9f6c-1bab65f10bd7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:53.498659 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c0df57b1-90f8-4cc7-9f6c-1bab65f10bd7 admin admin] The token cache is being invalidate because project 0b0859c9d8e84a33ac2ef29333cf0ea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:31:53.501611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c0df57b1-90f8-4cc7-9f6c-1bab65f10bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:53.502348 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c0df57b1-90f8-4cc7-9f6c-1bab65f10bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:53.504099 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 912/1810] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:31:53 2022] DELETE /identity/v3/projects/0b0859c9d8e84a33ac2ef29333cf0ea1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:53.508134 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8fca5-ca08-4cfa-b97b-c7f9a2ebc8a9 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:53.518328 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8fca5-ca08-4cfa-b97b-c7f9a2ebc8a9 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:53.552955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:53.582776 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e2d3c-0932-4ab2-bbd3-cc978d6244fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:53.583582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e2d3c-0932-4ab2-bbd3-cc978d6244fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:53.583859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e2d3c-0932-4ab2-bbd3-cc978d6244fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:53.584127 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e2d3c-0932-4ab2-bbd3-cc978d6244fa admin admin] PATH_INFO: `/v3/users/6969c8970419420d9aad0b785f850adb` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:53.585318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e2d3c-0932-4ab2-bbd3-cc978d6244fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6969c8970419420d9aad0b785f850adb)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:53.587257 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e2d3c-0932-4ab2-bbd3-cc978d6244fa admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:53.637653 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4b5e2d3c-0932-4ab2-bbd3-cc978d6244fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6969c8970419420d9aad0b785f850adb'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:53.647419 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4b5e2d3c-0932-4ab2-bbd3-cc978d6244fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6969c8970419420d9aad0b785f850adb'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:53.660897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4b5e2d3c-0932-4ab2-bbd3-cc978d6244fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6969c8970419420d9aad0b785f850adb'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:53.669020 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4b5e2d3c-0932-4ab2-bbd3-cc978d6244fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6969c8970419420d9aad0b785f850adb'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:53.669698 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4b5e2d3c-0932-4ab2-bbd3-cc978d6244fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6969c8970419420d9aad0b785f850adb'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:53.675911 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 899/1811] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:31:53 2022] DELETE /identity/v3/users/6969c8970419420d9aad0b785f850adb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:31:53.971484 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df57b1-90f8-4cc7-9f6c-1bab65f10bd7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:53.973625 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c0df57b1-90f8-4cc7-9f6c-1bab65f10bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:53.989170 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df57b1-90f8-4cc7-9f6c-1bab65f10bd7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:54.047328 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea19b3c-8d20-4d6c-9ebe-7e5b2ddc200d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:54.048185 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea19b3c-8d20-4d6c-9ebe-7e5b2ddc200d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:54.048464 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea19b3c-8d20-4d6c-9ebe-7e5b2ddc200d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:54.048733 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea19b3c-8d20-4d6c-9ebe-7e5b2ddc200d admin admin] PATH_INFO: `/v3/projects/8da0a5d66bef4a8aa3879c61cfa1f5e7` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:54.049908 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea19b3c-8d20-4d6c-9ebe-7e5b2ddc200d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8da0a5d66bef4a8aa3879c61cfa1f5e7)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:54.053801 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea19b3c-8d20-4d6c-9ebe-7e5b2ddc200d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:54.100417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bea19b3c-8d20-4d6c-9ebe-7e5b2ddc200d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8da0a5d66bef4a8aa3879c61cfa1f5e7', 'request_id': 'req-bea19b3c-8d20-4d6c-9ebe-7e5b2ddc200d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:54.105779 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bea19b3c-8d20-4d6c-9ebe-7e5b2ddc200d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8da0a5d66bef4a8aa3879c61cfa1f5e7', 'request_id': 'req-bea19b3c-8d20-4d6c-9ebe-7e5b2ddc200d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:54.114096 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bea19b3c-8d20-4d6c-9ebe-7e5b2ddc200d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8da0a5d66bef4a8aa3879c61cfa1f5e7', 'request_id': 'req-bea19b3c-8d20-4d6c-9ebe-7e5b2ddc200d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:54.125037 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bea19b3c-8d20-4d6c-9ebe-7e5b2ddc200d admin admin] The token cache is being invalidate because project 8da0a5d66bef4a8aa3879c61cfa1f5e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:31:54.125324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bea19b3c-8d20-4d6c-9ebe-7e5b2ddc200d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:54.125957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bea19b3c-8d20-4d6c-9ebe-7e5b2ddc200d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:54.127533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 913/1812] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:31:53 2022] DELETE /identity/v3/projects/8da0a5d66bef4a8aa3879c61cfa1f5e7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:54.132069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e2d3c-0932-4ab2-bbd3-cc978d6244fa admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:54.133503 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4b5e2d3c-0932-4ab2-bbd3-cc978d6244fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:54.146452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e2d3c-0932-4ab2-bbd3-cc978d6244fa admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:54.203415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5eb16-5d1a-4184-b38d-5f604a281d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:54.204291 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5eb16-5d1a-4184-b38d-5f604a281d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:54.204570 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5eb16-5d1a-4184-b38d-5f604a281d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:54.204844 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5eb16-5d1a-4184-b38d-5f604a281d93 admin admin] PATH_INFO: `/v3/users/6700f790d7514e7b8fc7ec53366c3a1c` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:54.206024 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5eb16-5d1a-4184-b38d-5f604a281d93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6700f790d7514e7b8fc7ec53366c3a1c)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:54.208244 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5eb16-5d1a-4184-b38d-5f604a281d93 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:54.253397 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-07d5eb16-5d1a-4184-b38d-5f604a281d93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6700f790d7514e7b8fc7ec53366c3a1c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:54.257794 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:54.261377 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-07d5eb16-5d1a-4184-b38d-5f604a281d93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6700f790d7514e7b8fc7ec53366c3a1c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:54.274407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-07d5eb16-5d1a-4184-b38d-5f604a281d93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6700f790d7514e7b8fc7ec53366c3a1c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:54.281271 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-07d5eb16-5d1a-4184-b38d-5f604a281d93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6700f790d7514e7b8fc7ec53366c3a1c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:54.282139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-07d5eb16-5d1a-4184-b38d-5f604a281d93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6700f790d7514e7b8fc7ec53366c3a1c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:54.288641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 900/1813] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:31:54 2022] DELETE /identity/v3/users/6700f790d7514e7b8fc7ec53366c3a1c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:31:54.755692 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea19b3c-8d20-4d6c-9ebe-7e5b2ddc200d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:54.757921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bea19b3c-8d20-4d6c-9ebe-7e5b2ddc200d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:54.773090 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea19b3c-8d20-4d6c-9ebe-7e5b2ddc200d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:54.798256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:54.838988 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd4437-1f6b-4fbe-9cd8-23e3085c408e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:54.839879 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd4437-1f6b-4fbe-9cd8-23e3085c408e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:54.840297 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd4437-1f6b-4fbe-9cd8-23e3085c408e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:54.840578 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd4437-1f6b-4fbe-9cd8-23e3085c408e admin admin] PATH_INFO: `/v3/projects/0cb409d8ff8746a9a58385612199390c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:54.841767 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd4437-1f6b-4fbe-9cd8-23e3085c408e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb409d8ff8746a9a58385612199390c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:54.843736 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd4437-1f6b-4fbe-9cd8-23e3085c408e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:54.901713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-35bd4437-1f6b-4fbe-9cd8-23e3085c408e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb409d8ff8746a9a58385612199390c', 'request_id': 'req-35bd4437-1f6b-4fbe-9cd8-23e3085c408e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:54.907175 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-35bd4437-1f6b-4fbe-9cd8-23e3085c408e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb409d8ff8746a9a58385612199390c', 'request_id': 'req-35bd4437-1f6b-4fbe-9cd8-23e3085c408e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:54.916718 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-35bd4437-1f6b-4fbe-9cd8-23e3085c408e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb409d8ff8746a9a58385612199390c', 'request_id': 'req-35bd4437-1f6b-4fbe-9cd8-23e3085c408e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:54.928824 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-35bd4437-1f6b-4fbe-9cd8-23e3085c408e admin admin] The token cache is being invalidate because project 0cb409d8ff8746a9a58385612199390c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:31:54.929109 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-35bd4437-1f6b-4fbe-9cd8-23e3085c408e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:54.929774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-35bd4437-1f6b-4fbe-9cd8-23e3085c408e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:54.931342 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 914/1814] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:31:54 2022] DELETE /identity/v3/projects/0cb409d8ff8746a9a58385612199390c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:54.937671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccfc86-5ad0-4a51-abbe-8bd372f1e603 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:54.938131 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccfc86-5ad0-4a51-abbe-8bd372f1e603 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:54.938237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccfc86-5ad0-4a51-abbe-8bd372f1e603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:54.956546 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-aeccfc86-5ad0-4a51-abbe-8bd372f1e603 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:54.957761 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-aeccfc86-5ad0-4a51-abbe-8bd372f1e603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:55.021972 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 901/1815] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:31:55.030587 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11872932-fa28-431f-97f1-239e71df1992 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:55.031090 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11872932-fa28-431f-97f1-239e71df1992 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:55.031220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11872932-fa28-431f-97f1-239e71df1992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:55.049799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-11872932-fa28-431f-97f1-239e71df1992 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:55.051760 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-11872932-fa28-431f-97f1-239e71df1992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:55.059563 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 915/1816] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:55.063671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccfc86-5ad0-4a51-abbe-8bd372f1e603 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:55.073595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccfc86-5ad0-4a51-abbe-8bd372f1e603 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:55.078790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f5650-defc-4881-8835-7b2dfc4dd43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:55.079447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f5650-defc-4881-8835-7b2dfc4dd43a admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:55.079724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f5650-defc-4881-8835-7b2dfc4dd43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:55.079996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f5650-defc-4881-8835-7b2dfc4dd43a admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:55.080706 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f5650-defc-4881-8835-7b2dfc4dd43a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:31:55.081003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f5650-defc-4881-8835-7b2dfc4dd43a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:55.082914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f5650-defc-4881-8835-7b2dfc4dd43a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:55.094362 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 902/1817] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:31:55.099103 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11872932-fa28-431f-97f1-239e71df1992 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:55.108260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11872932-fa28-431f-97f1-239e71df1992 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:55.113421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04acfe-2ded-4748-87ed-c5edbaa278d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:55.114059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04acfe-2ded-4748-87ed-c5edbaa278d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:55.114334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04acfe-2ded-4748-87ed-c5edbaa278d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:55.114598 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04acfe-2ded-4748-87ed-c5edbaa278d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:55.115315 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04acfe-2ded-4748-87ed-c5edbaa278d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:55.117188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04acfe-2ded-4748-87ed-c5edbaa278d1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:55.144971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 916/1818] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:55 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:55.147965 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f5650-defc-4881-8835-7b2dfc4dd43a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:55.157939 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f5650-defc-4881-8835-7b2dfc4dd43a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:55.213797 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0056d-3645-40a9-bfb2-350a7206fc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:55.214455 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0056d-3645-40a9-bfb2-350a7206fc09 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:55.214765 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0056d-3645-40a9-bfb2-350a7206fc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:55.215036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0056d-3645-40a9-bfb2-350a7206fc09 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:55.215714 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0056d-3645-40a9-bfb2-350a7206fc09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:55.217609 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0056d-3645-40a9-bfb2-350a7206fc09 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:55.240794 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 903/1819] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:55 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:31:55.245170 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04acfe-2ded-4748-87ed-c5edbaa278d1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:55.255565 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04acfe-2ded-4748-87ed-c5edbaa278d1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:55.260346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40d555-d24f-4418-b40b-1dcab6bbf5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:55.261037 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40d555-d24f-4418-b40b-1dcab6bbf5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:55.261321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40d555-d24f-4418-b40b-1dcab6bbf5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:55.261594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40d555-d24f-4418-b40b-1dcab6bbf5d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:55.262313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40d555-d24f-4418-b40b-1dcab6bbf5d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:55.263950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40d555-d24f-4418-b40b-1dcab6bbf5d4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:55.276828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 917/1820] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:55.280726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0056d-3645-40a9-bfb2-350a7206fc09 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:55.291691 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0056d-3645-40a9-bfb2-350a7206fc09 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:55.296551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da6504-1aaa-480f-b69e-ffddd5f2ff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:55.297213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da6504-1aaa-480f-b69e-ffddd5f2ff90 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:55.297492 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da6504-1aaa-480f-b69e-ffddd5f2ff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:55.297764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da6504-1aaa-480f-b69e-ffddd5f2ff90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:55.298479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da6504-1aaa-480f-b69e-ffddd5f2ff90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:55.300285 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da6504-1aaa-480f-b69e-ffddd5f2ff90 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:55.310700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 904/1821] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:55.314711 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40d555-d24f-4418-b40b-1dcab6bbf5d4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:55.324566 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40d555-d24f-4418-b40b-1dcab6bbf5d4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:55.329156 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7740cbd-8672-4c40-a0e9-6d71ba5bad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:55.330015 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7740cbd-8672-4c40-a0e9-6d71ba5bad27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:55.330286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7740cbd-8672-4c40-a0e9-6d71ba5bad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:55.330549 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7740cbd-8672-4c40-a0e9-6d71ba5bad27 admin admin] PATH_INFO: `/v3/projects/c3cbb4797b6a4d72b8ae07bfae559992/users/577f4a2298bc4b378d7996ec179ce0ca/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:55.345377 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7740cbd-8672-4c40-a0e9-6d71ba5bad27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3cbb4797b6a4d72b8ae07bfae559992, user_id=577f4a2298bc4b378d7996ec179ce0ca, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:55.348901 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7740cbd-8672-4c40-a0e9-6d71ba5bad27 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:55.361510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 918/1822] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:55 2022] PUT /identity/v3/projects/c3cbb4797b6a4d72b8ae07bfae559992/users/577f4a2298bc4b378d7996ec179ce0ca/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:55.373251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d73d8-66f1-4bb2-be5a-ef3aedddfdf5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:55.373549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d73d8-66f1-4bb2-be5a-ef3aedddfdf5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:55.373829 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d73d8-66f1-4bb2-be5a-ef3aedddfdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:55.400755 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-766d73d8-66f1-4bb2-be5a-ef3aedddfdf5 None None] MFA Rules not processed for user `577f4a2298bc4b378d7996ec179ce0ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:55.401998 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-766d73d8-66f1-4bb2-be5a-ef3aedddfdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:55.431888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:55.474539 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 905/1823] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:55.479040 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7740cbd-8672-4c40-a0e9-6d71ba5bad27 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:55.529822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:55.542984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7740cbd-8672-4c40-a0e9-6d71ba5bad27 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:55.547764 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaba1d-8398-497e-9828-7b16043b5541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:55.548420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaba1d-8398-497e-9828-7b16043b5541 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:55.548723 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaba1d-8398-497e-9828-7b16043b5541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:55.548997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaba1d-8398-497e-9828-7b16043b5541 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:55.549681 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aaba1d-8398-497e-9828-7b16043b5541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:55.551698 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aaba1d-8398-497e-9828-7b16043b5541 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:55.579000 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 919/1824] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:55 2022] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:55.584344 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d73d8-66f1-4bb2-be5a-ef3aedddfdf5 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:55.595715 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d73d8-66f1-4bb2-be5a-ef3aedddfdf5 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:55.811765 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063abe77-4641-431c-866a-b2a78eff7644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:55.812619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063abe77-4641-431c-866a-b2a78eff7644 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:55.813053 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063abe77-4641-431c-866a-b2a78eff7644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:55.813431 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063abe77-4641-431c-866a-b2a78eff7644 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:55.814228 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063abe77-4641-431c-866a-b2a78eff7644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:55.817600 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063abe77-4641-431c-866a-b2a78eff7644 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:55.858362 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 906/1825] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:55 2022] POST /identity/v3/users => generated 303 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:55.863008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaba1d-8398-497e-9828-7b16043b5541 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:55.881175 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaba1d-8398-497e-9828-7b16043b5541 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:55.898569 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce72eef-3335-4565-b268-0b66f92f2ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:55.901044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce72eef-3335-4565-b268-0b66f92f2ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:55.901563 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce72eef-3335-4565-b268-0b66f92f2ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:55.902880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce72eef-3335-4565-b268-0b66f92f2ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:55.905156 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce72eef-3335-4565-b268-0b66f92f2ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:55.912721 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce72eef-3335-4565-b268-0b66f92f2ad0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:55.942266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 920/1826] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:55.948632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063abe77-4641-431c-866a-b2a78eff7644 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:55.965334 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063abe77-4641-431c-866a-b2a78eff7644 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:55.978072 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01799900-7235-49fe-aabb-bf64540a3623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:55.979726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01799900-7235-49fe-aabb-bf64540a3623 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:55.980351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01799900-7235-49fe-aabb-bf64540a3623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:55.980825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01799900-7235-49fe-aabb-bf64540a3623 admin admin] PATH_INFO: `/v3/projects/1f34fa7dc1264b2c87059147f95430cc/users/876e010897794a50810dba34da1df35f/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:56.013095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01799900-7235-49fe-aabb-bf64540a3623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f34fa7dc1264b2c87059147f95430cc, user_id=876e010897794a50810dba34da1df35f, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:56.032987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01799900-7235-49fe-aabb-bf64540a3623 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:56.066509 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 907/1827] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:55 2022] PUT /identity/v3/projects/1f34fa7dc1264b2c87059147f95430cc/users/876e010897794a50810dba34da1df35f/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:56.072290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce72eef-3335-4565-b268-0b66f92f2ad0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:56.096692 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce72eef-3335-4565-b268-0b66f92f2ad0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:56.210974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777aa8f2-e803-458a-b2f1-e27b3e20c0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:56.212052 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aa8f2-e803-458a-b2f1-e27b3e20c0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:56.212717 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aa8f2-e803-458a-b2f1-e27b3e20c0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:56.213359 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aa8f2-e803-458a-b2f1-e27b3e20c0e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:56.214293 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777aa8f2-e803-458a-b2f1-e27b3e20c0e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:56.216967 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777aa8f2-e803-458a-b2f1-e27b3e20c0e7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:56.232753 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 921/1828] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:56.237013 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01799900-7235-49fe-aabb-bf64540a3623 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:56.250064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01799900-7235-49fe-aabb-bf64540a3623 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:56.256205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734d0ed-5801-40d1-bd72-d2cebc3bb1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:56.257427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734d0ed-5801-40d1-bd72-d2cebc3bb1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:56.257914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734d0ed-5801-40d1-bd72-d2cebc3bb1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:56.258526 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734d0ed-5801-40d1-bd72-d2cebc3bb1d1 admin admin] PATH_INFO: `/v3/projects/1f34fa7dc1264b2c87059147f95430cc/users/876e010897794a50810dba34da1df35f/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:56.261192 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734d0ed-5801-40d1-bd72-d2cebc3bb1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f34fa7dc1264b2c87059147f95430cc, user_id=876e010897794a50810dba34da1df35f, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:56.263880 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734d0ed-5801-40d1-bd72-d2cebc3bb1d1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:56.276570 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 908/1829] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:56 2022] PUT /identity/v3/projects/1f34fa7dc1264b2c87059147f95430cc/users/876e010897794a50810dba34da1df35f/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:56.288990 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2165ad-16bf-4d64-94cf-a374d141abc0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:56.289518 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2165ad-16bf-4d64-94cf-a374d141abc0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:56.289959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2165ad-16bf-4d64-94cf-a374d141abc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:56.323065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5f2165ad-16bf-4d64-94cf-a374d141abc0 None None] MFA Rules not processed for user `876e010897794a50810dba34da1df35f`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:56.324532 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5f2165ad-16bf-4d64-94cf-a374d141abc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:56.417535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 922/1830] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:56.430069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734d0ed-5801-40d1-bd72-d2cebc3bb1d1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:56.431991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9734d0ed-5801-40d1-bd72-d2cebc3bb1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:56.535292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734d0ed-5801-40d1-bd72-d2cebc3bb1d1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:56.541556 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f959bdd-2d0b-4e04-a217-267e92a5911d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:56.542333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f959bdd-2d0b-4e04-a217-267e92a5911d service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:56.542621 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f959bdd-2d0b-4e04-a217-267e92a5911d service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:56.542931 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f959bdd-2d0b-4e04-a217-267e92a5911d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:56.554937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f959bdd-2d0b-4e04-a217-267e92a5911d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:56.557048 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f959bdd-2d0b-4e04-a217-267e92a5911d service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:56.574885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 909/1831] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:56.620643 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2165ad-16bf-4d64-94cf-a374d141abc0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:56.622046 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5f2165ad-16bf-4d64-94cf-a374d141abc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:56.634483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2165ad-16bf-4d64-94cf-a374d141abc0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:56.638090 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182fe35-1548-42bf-b27e-01572935c7b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:56.638760 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182fe35-1548-42bf-b27e-01572935c7b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:56.639047 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182fe35-1548-42bf-b27e-01572935c7b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:56.639324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182fe35-1548-42bf-b27e-01572935c7b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:56.684449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:56.699813 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182fe35-1548-42bf-b27e-01572935c7b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:56.701284 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182fe35-1548-42bf-b27e-01572935c7b7 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:56.711384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 923/1832] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:56.954293 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f959bdd-2d0b-4e04-a217-267e92a5911d service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:56.963701 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5f959bdd-2d0b-4e04-a217-267e92a5911d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:57.000805 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:57.060344 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f959bdd-2d0b-4e04-a217-267e92a5911d service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:57.065050 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4183324-0719-4545-9625-18070b2c658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:57.066907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4183324-0719-4545-9625-18070b2c658b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:57.067258 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4183324-0719-4545-9625-18070b2c658b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:57.067603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4183324-0719-4545-9625-18070b2c658b admin admin] PATH_INFO: `/v3/users/8a948b4e5aea480693b50bafc26cb5f9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:57.068896 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4183324-0719-4545-9625-18070b2c658b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a948b4e5aea480693b50bafc26cb5f9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:57.071009 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4183324-0719-4545-9625-18070b2c658b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:57.124893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c4183324-0719-4545-9625-18070b2c658b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a948b4e5aea480693b50bafc26cb5f9'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:57.131683 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c4183324-0719-4545-9625-18070b2c658b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a948b4e5aea480693b50bafc26cb5f9'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:57.143436 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c4183324-0719-4545-9625-18070b2c658b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a948b4e5aea480693b50bafc26cb5f9'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:57.150605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c4183324-0719-4545-9625-18070b2c658b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a948b4e5aea480693b50bafc26cb5f9'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:57.151250 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c4183324-0719-4545-9625-18070b2c658b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a948b4e5aea480693b50bafc26cb5f9'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:57.157225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 910/1833] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:31:56 2022] DELETE /identity/v3/users/8a948b4e5aea480693b50bafc26cb5f9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:57.162347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcabe0-c2c5-4329-a34d-f63b5f41b88e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:57.162821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcabe0-c2c5-4329-a34d-f63b5f41b88e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:57.162943 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcabe0-c2c5-4329-a34d-f63b5f41b88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:57.180960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-62fcabe0-c2c5-4329-a34d-f63b5f41b88e None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:57.182159 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-62fcabe0-c2c5-4329-a34d-f63b5f41b88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:57.242982 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 924/1834] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:57.252427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4183324-0719-4545-9625-18070b2c658b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:57.254147 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c4183324-0719-4545-9625-18070b2c658b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:57.312274 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4183324-0719-4545-9625-18070b2c658b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:57.315966 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a4efd-0909-4a17-a1fa-92b5cc6ea67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:57.316655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a4efd-0909-4a17-a1fa-92b5cc6ea67d service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:57.316930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a4efd-0909-4a17-a1fa-92b5cc6ea67d service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:57.317199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a4efd-0909-4a17-a1fa-92b5cc6ea67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:57.326369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a4efd-0909-4a17-a1fa-92b5cc6ea67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:57.327946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a4efd-0909-4a17-a1fa-92b5cc6ea67d service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:57.338094 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 911/1835] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:57.661122 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcabe0-c2c5-4329-a34d-f63b5f41b88e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:57.662699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-62fcabe0-c2c5-4329-a34d-f63b5f41b88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:57.677679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcabe0-c2c5-4329-a34d-f63b5f41b88e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:57.682624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdbb06-4bbb-4bf4-bf95-f94b0c1434f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:57.683535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdbb06-4bbb-4bf4-bf95-f94b0c1434f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:57.683815 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdbb06-4bbb-4bf4-bf95-f94b0c1434f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:57.684123 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdbb06-4bbb-4bf4-bf95-f94b0c1434f6 admin admin] PATH_INFO: `/v3/projects/a3dad02a7ed9484fa42c2718b3ea54c5` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:57.685488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdbb06-4bbb-4bf4-bf95-f94b0c1434f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3dad02a7ed9484fa42c2718b3ea54c5)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:57.687438 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdbb06-4bbb-4bf4-bf95-f94b0c1434f6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:57.746365 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6acdbb06-4bbb-4bf4-bf95-f94b0c1434f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3dad02a7ed9484fa42c2718b3ea54c5', 'request_id': 'req-6acdbb06-4bbb-4bf4-bf95-f94b0c1434f6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:57.752243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6acdbb06-4bbb-4bf4-bf95-f94b0c1434f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3dad02a7ed9484fa42c2718b3ea54c5', 'request_id': 'req-6acdbb06-4bbb-4bf4-bf95-f94b0c1434f6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:57.759621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6acdbb06-4bbb-4bf4-bf95-f94b0c1434f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3dad02a7ed9484fa42c2718b3ea54c5', 'request_id': 'req-6acdbb06-4bbb-4bf4-bf95-f94b0c1434f6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:57.771782 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6acdbb06-4bbb-4bf4-bf95-f94b0c1434f6 admin admin] The token cache is being invalidate because project a3dad02a7ed9484fa42c2718b3ea54c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:31:57.772066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6acdbb06-4bbb-4bf4-bf95-f94b0c1434f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:57.772726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6acdbb06-4bbb-4bf4-bf95-f94b0c1434f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:31:57.774330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 925/1836] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:31:57 2022] DELETE /identity/v3/projects/a3dad02a7ed9484fa42c2718b3ea54c5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:57.779396 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d8261-505a-4665-8f1e-a791308ba9ed None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:57.779711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d8261-505a-4665-8f1e-a791308ba9ed None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:57.779989 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d8261-505a-4665-8f1e-a791308ba9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:57.798947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-221d8261-505a-4665-8f1e-a791308ba9ed None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:57.800264 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-221d8261-505a-4665-8f1e-a791308ba9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:57.844870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:57.898431 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 912/1837] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:31:57.907692 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47c881-99d9-484e-8de2-06ee43fbf938 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:57.907987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47c881-99d9-484e-8de2-06ee43fbf938 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:57.908270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47c881-99d9-484e-8de2-06ee43fbf938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:57.931468 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8d47c881-99d9-484e-8de2-06ee43fbf938 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:57.933289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8d47c881-99d9-484e-8de2-06ee43fbf938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:57.944572 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 926/1838] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:57.946350 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d8261-505a-4665-8f1e-a791308ba9ed None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:57.958197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d8261-505a-4665-8f1e-a791308ba9ed None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:57.967027 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c209c-5404-4bec-86d6-884a445aa3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:57.967769 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c209c-5404-4bec-86d6-884a445aa3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:57.968055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c209c-5404-4bec-86d6-884a445aa3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:57.968326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c209c-5404-4bec-86d6-884a445aa3b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:57.969082 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c209c-5404-4bec-86d6-884a445aa3b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:31:57.969465 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c209c-5404-4bec-86d6-884a445aa3b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:57.971122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c209c-5404-4bec-86d6-884a445aa3b3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:57.984293 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 913/1839] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:31:57.989114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47c881-99d9-484e-8de2-06ee43fbf938 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:57.998601 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47c881-99d9-484e-8de2-06ee43fbf938 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:58.003404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af9a4f-947a-4d83-bf23-9581340d0d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:58.004053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af9a4f-947a-4d83-bf23-9581340d0d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:58.004336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af9a4f-947a-4d83-bf23-9581340d0d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:58.004614 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af9a4f-947a-4d83-bf23-9581340d0d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:58.005310 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af9a4f-947a-4d83-bf23-9581340d0d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:58.007225 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af9a4f-947a-4d83-bf23-9581340d0d7d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:58.037049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 927/1840] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:57 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:31:58.038114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c209c-5404-4bec-86d6-884a445aa3b3 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:58.048113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c209c-5404-4bec-86d6-884a445aa3b3 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:58.110859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e031c-f311-44ee-8d84-410be380fdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:58.111647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e031c-f311-44ee-8d84-410be380fdec admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:58.112016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e031c-f311-44ee-8d84-410be380fdec admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:58.112213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e031c-f311-44ee-8d84-410be380fdec admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:58.113839 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e031c-f311-44ee-8d84-410be380fdec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:58.116281 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e031c-f311-44ee-8d84-410be380fdec admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:58.139992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 914/1841] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:58 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:31:58.145344 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af9a4f-947a-4d83-bf23-9581340d0d7d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:58.157000 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af9a4f-947a-4d83-bf23-9581340d0d7d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:58.164308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa90c0-49b0-4253-ab7c-710186a3f13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:58.165134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa90c0-49b0-4253-ab7c-710186a3f13b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:58.165484 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa90c0-49b0-4253-ab7c-710186a3f13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:58.165754 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa90c0-49b0-4253-ab7c-710186a3f13b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:58.166482 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa90c0-49b0-4253-ab7c-710186a3f13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:58.168462 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa90c0-49b0-4253-ab7c-710186a3f13b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:58.182082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 928/1842] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:58.186082 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e031c-f311-44ee-8d84-410be380fdec admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:58.197739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e031c-f311-44ee-8d84-410be380fdec admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:58.202464 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b29676-4d4f-4b61-b37a-c65c85997e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:58.203165 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b29676-4d4f-4b61-b37a-c65c85997e00 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:58.203477 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b29676-4d4f-4b61-b37a-c65c85997e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:58.203719 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b29676-4d4f-4b61-b37a-c65c85997e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:58.204442 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b29676-4d4f-4b61-b37a-c65c85997e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:58.206011 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b29676-4d4f-4b61-b37a-c65c85997e00 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:58.218040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 915/1843] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:58.222388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa90c0-49b0-4253-ab7c-710186a3f13b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:58.232415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa90c0-49b0-4253-ab7c-710186a3f13b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:58.237042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595ae3d-c1fd-442b-b20d-55b498d19c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:58.239095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595ae3d-c1fd-442b-b20d-55b498d19c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:58.239594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595ae3d-c1fd-442b-b20d-55b498d19c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:58.239936 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595ae3d-c1fd-442b-b20d-55b498d19c92 admin admin] PATH_INFO: `/v3/projects/614473241f47453780af6712442a3fb2/users/a84dbfb0611843f8888147d2eaef0073/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:58.256599 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595ae3d-c1fd-442b-b20d-55b498d19c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=614473241f47453780af6712442a3fb2, user_id=a84dbfb0611843f8888147d2eaef0073, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:58.259301 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595ae3d-c1fd-442b-b20d-55b498d19c92 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:58.273196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 929/1844] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:58 2022] PUT /identity/v3/projects/614473241f47453780af6712442a3fb2/users/a84dbfb0611843f8888147d2eaef0073/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:58.283718 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5a3c9-f138-48ec-8aaa-d683130d3277 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:58.284010 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5a3c9-f138-48ec-8aaa-d683130d3277 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:58.284392 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5a3c9-f138-48ec-8aaa-d683130d3277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:58.311429 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-08a5a3c9-f138-48ec-8aaa-d683130d3277 None None] MFA Rules not processed for user `a84dbfb0611843f8888147d2eaef0073`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:58.312627 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-08a5a3c9-f138-48ec-8aaa-d683130d3277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:58.376904 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 916/1845] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:58.381845 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595ae3d-c1fd-442b-b20d-55b498d19c92 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:58.388405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:58.474145 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595ae3d-c1fd-442b-b20d-55b498d19c92 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:58.479416 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4419e-6e70-41dd-8649-a37a8c268109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:58.480077 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4419e-6e70-41dd-8649-a37a8c268109 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:58.480527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4419e-6e70-41dd-8649-a37a8c268109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:58.480940 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4419e-6e70-41dd-8649-a37a8c268109 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:58.481778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4419e-6e70-41dd-8649-a37a8c268109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:58.483884 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4419e-6e70-41dd-8649-a37a8c268109 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:58.519185 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 930/1846] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:31:58 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:58.520892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5a3c9-f138-48ec-8aaa-d683130d3277 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:58.533855 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5a3c9-f138-48ec-8aaa-d683130d3277 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:58.574972 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:58.605845 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f7d13-73f7-4c47-923b-d68160e824d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:58.606663 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f7d13-73f7-4c47-923b-d68160e824d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:58.606986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f7d13-73f7-4c47-923b-d68160e824d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:58.607262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f7d13-73f7-4c47-923b-d68160e824d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:58.607954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f7d13-73f7-4c47-923b-d68160e824d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:58.610275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f7d13-73f7-4c47-923b-d68160e824d4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:58.649083 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 917/1847] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:31:58 2022] POST /identity/v3/users => generated 297 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:31:58.653030 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4419e-6e70-41dd-8649-a37a8c268109 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:58.664643 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4419e-6e70-41dd-8649-a37a8c268109 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:58.670133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1074eac-ce41-439d-a164-7110dc910663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:58.671182 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1074eac-ce41-439d-a164-7110dc910663 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:58.672703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1074eac-ce41-439d-a164-7110dc910663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:58.673063 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1074eac-ce41-439d-a164-7110dc910663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:58.675157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1074eac-ce41-439d-a164-7110dc910663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:58.677336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1074eac-ce41-439d-a164-7110dc910663 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:58.690384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 931/1848] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:58.695150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f7d13-73f7-4c47-923b-d68160e824d4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:58.713156 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f7d13-73f7-4c47-923b-d68160e824d4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:58.720071 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b14a0f-1666-4ad9-a997-b5e3e4080bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:58.721282 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b14a0f-1666-4ad9-a997-b5e3e4080bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:58.721645 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b14a0f-1666-4ad9-a997-b5e3e4080bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:58.722050 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b14a0f-1666-4ad9-a997-b5e3e4080bb3 admin admin] PATH_INFO: `/v3/projects/b5f1b88939784226abb2dd6039699c96/users/0bf48516d1dd4aa4ab48786ec60284f0/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:58.742287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b14a0f-1666-4ad9-a997-b5e3e4080bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f1b88939784226abb2dd6039699c96, user_id=0bf48516d1dd4aa4ab48786ec60284f0, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:58.744992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b14a0f-1666-4ad9-a997-b5e3e4080bb3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:58.760721 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 918/1849] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:58 2022] PUT /identity/v3/projects/b5f1b88939784226abb2dd6039699c96/users/0bf48516d1dd4aa4ab48786ec60284f0/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:58.764781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1074eac-ce41-439d-a164-7110dc910663 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:58.775585 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1074eac-ce41-439d-a164-7110dc910663 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:58.838354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ccd8a-a629-43ca-aad9-5428c91a9554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:58.839054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ccd8a-a629-43ca-aad9-5428c91a9554 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:58.839382 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ccd8a-a629-43ca-aad9-5428c91a9554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:58.839660 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ccd8a-a629-43ca-aad9-5428c91a9554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:58.840384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ccd8a-a629-43ca-aad9-5428c91a9554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:58.842066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ccd8a-a629-43ca-aad9-5428c91a9554 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:58.853548 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 932/1850] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:31:58.857601 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b14a0f-1666-4ad9-a997-b5e3e4080bb3 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:58.868764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b14a0f-1666-4ad9-a997-b5e3e4080bb3 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:58.873529 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06f723-34c6-4336-ba56-28573f8e173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:58.874412 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06f723-34c6-4336-ba56-28573f8e173c admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:58.874684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06f723-34c6-4336-ba56-28573f8e173c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:58.874994 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06f723-34c6-4336-ba56-28573f8e173c admin admin] PATH_INFO: `/v3/projects/b5f1b88939784226abb2dd6039699c96/users/0bf48516d1dd4aa4ab48786ec60284f0/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:58.877047 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06f723-34c6-4336-ba56-28573f8e173c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f1b88939784226abb2dd6039699c96, user_id=0bf48516d1dd4aa4ab48786ec60284f0, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:58.879869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06f723-34c6-4336-ba56-28573f8e173c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:58.892209 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 919/1851] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:31:58 2022] PUT /identity/v3/projects/b5f1b88939784226abb2dd6039699c96/users/0bf48516d1dd4aa4ab48786ec60284f0/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:31:58.904930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419546ae-f003-4e61-bd63-97d966199bc9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:58.905234 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419546ae-f003-4e61-bd63-97d966199bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:58.905535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419546ae-f003-4e61-bd63-97d966199bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:58.947230 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-419546ae-f003-4e61-bd63-97d966199bc9 None None] MFA Rules not processed for user `0bf48516d1dd4aa4ab48786ec60284f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:31:58.948577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-419546ae-f003-4e61-bd63-97d966199bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:59.038264 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:31:59.047950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 933/1852] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:31:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:31:59.064806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06f723-34c6-4336-ba56-28573f8e173c admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:59.066856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7f06f723-34c6-4336-ba56-28573f8e173c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:31:59.132934 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06f723-34c6-4336-ba56-28573f8e173c admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:59.136821 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ac0a9-6796-457e-99d5-4c3acf2f7165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:59.137475 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ac0a9-6796-457e-99d5-4c3acf2f7165 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:59.137756 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ac0a9-6796-457e-99d5-4c3acf2f7165 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:59.138062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ac0a9-6796-457e-99d5-4c3acf2f7165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:59.148441 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ac0a9-6796-457e-99d5-4c3acf2f7165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:59.149918 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ac0a9-6796-457e-99d5-4c3acf2f7165 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:59.161333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 920/1853] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:31:59.265102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419546ae-f003-4e61-bd63-97d966199bc9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:31:59.277045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419546ae-f003-4e61-bd63-97d966199bc9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:31:59.280974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a6580-6ba0-4068-a2f8-a95ffa9aba53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:31:59.281731 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a6580-6ba0-4068-a2f8-a95ffa9aba53 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:31:59.282010 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a6580-6ba0-4068-a2f8-a95ffa9aba53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:31:59.282284 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a6580-6ba0-4068-a2f8-a95ffa9aba53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:31:59.373476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a6580-6ba0-4068-a2f8-a95ffa9aba53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:31:59.375394 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a6580-6ba0-4068-a2f8-a95ffa9aba53 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:31:59.387257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 934/1854] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:31:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:00.347486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ac0a9-6796-457e-99d5-4c3acf2f7165 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:00.350948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a18ac0a9-6796-457e-99d5-4c3acf2f7165 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:00.463831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ac0a9-6796-457e-99d5-4c3acf2f7165 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:00.484746 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905c9bc-a3a5-4540-9884-f0cb8d6f7fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:00.485856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905c9bc-a3a5-4540-9884-f0cb8d6f7fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:00.486153 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905c9bc-a3a5-4540-9884-f0cb8d6f7fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:00.486433 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905c9bc-a3a5-4540-9884-f0cb8d6f7fb0 admin admin] PATH_INFO: `/v3/users/577f4a2298bc4b378d7996ec179ce0ca` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:00.487969 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905c9bc-a3a5-4540-9884-f0cb8d6f7fb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=577f4a2298bc4b378d7996ec179ce0ca)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:00.491271 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905c9bc-a3a5-4540-9884-f0cb8d6f7fb0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:00.561801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:00.578959 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4905c9bc-a3a5-4540-9884-f0cb8d6f7fb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '577f4a2298bc4b378d7996ec179ce0ca'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:00.592886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4905c9bc-a3a5-4540-9884-f0cb8d6f7fb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '577f4a2298bc4b378d7996ec179ce0ca'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:00.630897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4905c9bc-a3a5-4540-9884-f0cb8d6f7fb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '577f4a2298bc4b378d7996ec179ce0ca'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:00.647304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4905c9bc-a3a5-4540-9884-f0cb8d6f7fb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '577f4a2298bc4b378d7996ec179ce0ca'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:00.648056 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4905c9bc-a3a5-4540-9884-f0cb8d6f7fb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '577f4a2298bc4b378d7996ec179ce0ca'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:00.663769 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 921/1855] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:00 2022] DELETE /identity/v3/users/577f4a2298bc4b378d7996ec179ce0ca => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:00.666102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126eb0af-33e8-4c0a-aaab-8a3a423c4bf8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:00.666665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126eb0af-33e8-4c0a-aaab-8a3a423c4bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:00.666665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126eb0af-33e8-4c0a-aaab-8a3a423c4bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:00.707589 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-126eb0af-33e8-4c0a-aaab-8a3a423c4bf8 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:00.708883 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-126eb0af-33e8-4c0a-aaab-8a3a423c4bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:00.902538 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 935/1856] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:00.915213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905c9bc-a3a5-4540-9884-f0cb8d6f7fb0 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:00.916756 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4905c9bc-a3a5-4540-9884-f0cb8d6f7fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:01.012751 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905c9bc-a3a5-4540-9884-f0cb8d6f7fb0 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:01.016691 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe08a00-2b15-4a58-8acb-2230957bfa0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:01.017438 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe08a00-2b15-4a58-8acb-2230957bfa0b service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:01.018087 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe08a00-2b15-4a58-8acb-2230957bfa0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:01.018364 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe08a00-2b15-4a58-8acb-2230957bfa0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:01.035549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe08a00-2b15-4a58-8acb-2230957bfa0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:01.037438 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe08a00-2b15-4a58-8acb-2230957bfa0b service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:01.051470 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 922/1857] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:01.462461 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126eb0af-33e8-4c0a-aaab-8a3a423c4bf8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:01.464147 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-126eb0af-33e8-4c0a-aaab-8a3a423c4bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:01.477412 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126eb0af-33e8-4c0a-aaab-8a3a423c4bf8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:01.482758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd9fba-a420-4da2-91e4-a76373490c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:01.483669 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd9fba-a420-4da2-91e4-a76373490c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:01.483952 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd9fba-a420-4da2-91e4-a76373490c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:01.484225 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd9fba-a420-4da2-91e4-a76373490c13 admin admin] PATH_INFO: `/v3/projects/c3cbb4797b6a4d72b8ae07bfae559992` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:01.485612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd9fba-a420-4da2-91e4-a76373490c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3cbb4797b6a4d72b8ae07bfae559992)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:01.488213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd9fba-a420-4da2-91e4-a76373490c13 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:01.566587 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-80dd9fba-a420-4da2-91e4-a76373490c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3cbb4797b6a4d72b8ae07bfae559992', 'request_id': 'req-80dd9fba-a420-4da2-91e4-a76373490c13'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:01.573596 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-80dd9fba-a420-4da2-91e4-a76373490c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3cbb4797b6a4d72b8ae07bfae559992', 'request_id': 'req-80dd9fba-a420-4da2-91e4-a76373490c13'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:01.584588 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-80dd9fba-a420-4da2-91e4-a76373490c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3cbb4797b6a4d72b8ae07bfae559992', 'request_id': 'req-80dd9fba-a420-4da2-91e4-a76373490c13'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:01.597135 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-80dd9fba-a420-4da2-91e4-a76373490c13 admin admin] The token cache is being invalidate because project c3cbb4797b6a4d72b8ae07bfae559992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:01.597430 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-80dd9fba-a420-4da2-91e4-a76373490c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:01.598249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-80dd9fba-a420-4da2-91e4-a76373490c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:01.600066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 936/1858] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:01 2022] DELETE /identity/v3/projects/c3cbb4797b6a4d72b8ae07bfae559992 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:01.603829 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe08a00-2b15-4a58-8acb-2230957bfa0b service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:01.614018 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe08a00-2b15-4a58-8acb-2230957bfa0b service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:01.673016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01accc1a-9729-4c1e-a742-a7ee77912eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:01.673894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01accc1a-9729-4c1e-a742-a7ee77912eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:01.674180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01accc1a-9729-4c1e-a742-a7ee77912eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:01.674460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01accc1a-9729-4c1e-a742-a7ee77912eb1 admin admin] PATH_INFO: `/v3/users/876e010897794a50810dba34da1df35f` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:01.676318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01accc1a-9729-4c1e-a742-a7ee77912eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=876e010897794a50810dba34da1df35f)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:01.678264 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01accc1a-9729-4c1e-a742-a7ee77912eb1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:01.726544 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-01accc1a-9729-4c1e-a742-a7ee77912eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876e010897794a50810dba34da1df35f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:01.733326 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-01accc1a-9729-4c1e-a742-a7ee77912eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876e010897794a50810dba34da1df35f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:01.734426 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:01.748263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-01accc1a-9729-4c1e-a742-a7ee77912eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876e010897794a50810dba34da1df35f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:01.755575 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-01accc1a-9729-4c1e-a742-a7ee77912eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876e010897794a50810dba34da1df35f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:01.756202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-01accc1a-9729-4c1e-a742-a7ee77912eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876e010897794a50810dba34da1df35f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:01.762244 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 923/1859] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:01 2022] DELETE /identity/v3/users/876e010897794a50810dba34da1df35f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:02.051811 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd9fba-a420-4da2-91e4-a76373490c13 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:02.053975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-80dd9fba-a420-4da2-91e4-a76373490c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:02.077341 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd9fba-a420-4da2-91e4-a76373490c13 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:02.100559 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:02.143110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13c10e-223e-47c6-ba08-1f2fc95398cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:02.144727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13c10e-223e-47c6-ba08-1f2fc95398cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:02.145215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13c10e-223e-47c6-ba08-1f2fc95398cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:02.145492 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13c10e-223e-47c6-ba08-1f2fc95398cd admin admin] PATH_INFO: `/v3/projects/1f34fa7dc1264b2c87059147f95430cc` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:02.146695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13c10e-223e-47c6-ba08-1f2fc95398cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f34fa7dc1264b2c87059147f95430cc)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:02.148624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13c10e-223e-47c6-ba08-1f2fc95398cd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:02.217640 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a13c10e-223e-47c6-ba08-1f2fc95398cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f34fa7dc1264b2c87059147f95430cc', 'request_id': 'req-1a13c10e-223e-47c6-ba08-1f2fc95398cd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:02.244341 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a13c10e-223e-47c6-ba08-1f2fc95398cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f34fa7dc1264b2c87059147f95430cc', 'request_id': 'req-1a13c10e-223e-47c6-ba08-1f2fc95398cd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:02.256159 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a13c10e-223e-47c6-ba08-1f2fc95398cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f34fa7dc1264b2c87059147f95430cc', 'request_id': 'req-1a13c10e-223e-47c6-ba08-1f2fc95398cd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:02.273595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a13c10e-223e-47c6-ba08-1f2fc95398cd admin admin] The token cache is being invalidate because project 1f34fa7dc1264b2c87059147f95430cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:02.274650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a13c10e-223e-47c6-ba08-1f2fc95398cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:02.275376 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a13c10e-223e-47c6-ba08-1f2fc95398cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:02.280430 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 937/1860] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:02 2022] DELETE /identity/v3/projects/1f34fa7dc1264b2c87059147f95430cc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:02.282537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98740c0-67d9-4f79-92dc-f173ac72ffda None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:02.282915 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98740c0-67d9-4f79-92dc-f173ac72ffda None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:02.283481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98740c0-67d9-4f79-92dc-f173ac72ffda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:02.308568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b98740c0-67d9-4f79-92dc-f173ac72ffda None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:02.309950 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b98740c0-67d9-4f79-92dc-f173ac72ffda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:02.466278 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 924/1861] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:02.479345 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a15ac-3f1b-45fb-9843-7d1cce81b752 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:02.479636 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a15ac-3f1b-45fb-9843-7d1cce81b752 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:02.479918 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a15ac-3f1b-45fb-9843-7d1cce81b752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:02.515770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-291a15ac-3f1b-45fb-9843-7d1cce81b752 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:02.522668 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-291a15ac-3f1b-45fb-9843-7d1cce81b752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:02.573184 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 938/1862] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:02.577428 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98740c0-67d9-4f79-92dc-f173ac72ffda None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:02.590934 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98740c0-67d9-4f79-92dc-f173ac72ffda None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:02.606984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef793a-386e-4992-b3fe-2db700a5f0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:02.608498 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef793a-386e-4992-b3fe-2db700a5f0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:02.608990 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef793a-386e-4992-b3fe-2db700a5f0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:02.609484 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef793a-386e-4992-b3fe-2db700a5f0d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:02.610656 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef793a-386e-4992-b3fe-2db700a5f0d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:32:02.611209 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef793a-386e-4992-b3fe-2db700a5f0d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:02.616044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef793a-386e-4992-b3fe-2db700a5f0d9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:02.673235 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a15ac-3f1b-45fb-9843-7d1cce81b752 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:02.693912 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 925/1863] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:32:02.706692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd3da8-6f6a-4bfd-afcf-a2762491f108 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:02.709974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a15ac-3f1b-45fb-9843-7d1cce81b752 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:02.711364 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd3da8-6f6a-4bfd-afcf-a2762491f108 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:02.711999 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd3da8-6f6a-4bfd-afcf-a2762491f108 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:02.716582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 926/1864] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 19 12:32:02 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:32:02.719600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb42ce8-0c48-432a-9d5c-9914838de01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:02.720532 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb42ce8-0c48-432a-9d5c-9914838de01f admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:02.720963 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb42ce8-0c48-432a-9d5c-9914838de01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:02.721431 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb42ce8-0c48-432a-9d5c-9914838de01f admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:02.722339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb42ce8-0c48-432a-9d5c-9914838de01f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:02.724759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb42ce8-0c48-432a-9d5c-9914838de01f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:02.759873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 939/1865] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:02 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:02.761146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd3da8-6f6a-4bfd-afcf-a2762491f108 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:02.778989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6d630-aeaf-4727-964c-d8d042ec86ef None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:02.779319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6d630-aeaf-4727-964c-d8d042ec86ef None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:02.779605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6d630-aeaf-4727-964c-d8d042ec86ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:02.854376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd3da8-6f6a-4bfd-afcf-a2762491f108 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:02.859857 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80881aba-b5a8-49f8-8a65-edb3da889977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:02.860540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80881aba-b5a8-49f8-8a65-edb3da889977 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:02.860838 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80881aba-b5a8-49f8-8a65-edb3da889977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:02.861105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80881aba-b5a8-49f8-8a65-edb3da889977 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:02.861802 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80881aba-b5a8-49f8-8a65-edb3da889977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:02.864636 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cff6d630-aeaf-4727-964c-d8d042ec86ef None None] MFA Rules not processed for user `5d9543657e1e4a6d85632bf57f6ba6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:02.864773 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80881aba-b5a8-49f8-8a65-edb3da889977 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:02.865900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cff6d630-aeaf-4727-964c-d8d042ec86ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:02.890917 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 927/1866] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:02 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:02.894198 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80881aba-b5a8-49f8-8a65-edb3da889977 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:02.911192 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80881aba-b5a8-49f8-8a65-edb3da889977 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:02.918847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3921c8b-ec57-4039-a547-c421d08515a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:02.920083 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3921c8b-ec57-4039-a547-c421d08515a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:02.920645 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3921c8b-ec57-4039-a547-c421d08515a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:02.920923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3921c8b-ec57-4039-a547-c421d08515a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:02.921750 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3921c8b-ec57-4039-a547-c421d08515a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:02.923655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3921c8b-ec57-4039-a547-c421d08515a6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:02.941419 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 928/1867] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:02.947336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3921c8b-ec57-4039-a547-c421d08515a6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:02.960666 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3921c8b-ec57-4039-a547-c421d08515a6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:02.967062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c31305-304f-4ec7-8732-520eb778f87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:02.968248 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c31305-304f-4ec7-8732-520eb778f87b admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:02.968599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c31305-304f-4ec7-8732-520eb778f87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:02.969009 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c31305-304f-4ec7-8732-520eb778f87b admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:02.969919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c31305-304f-4ec7-8732-520eb778f87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:02.972880 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c31305-304f-4ec7-8732-520eb778f87b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:02.990910 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 929/1868] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:02.994399 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c31305-304f-4ec7-8732-520eb778f87b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:03.007281 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c31305-304f-4ec7-8732-520eb778f87b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:03.009962 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 940/1869] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 19 12:32:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:03.016835 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6d630-aeaf-4727-964c-d8d042ec86ef None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:03.019025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cff6d630-aeaf-4727-964c-d8d042ec86ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:03.020977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b3d45-2fa5-4e61-8826-a624c06a766c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:03.022046 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b3d45-2fa5-4e61-8826-a624c06a766c admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:03.022398 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b3d45-2fa5-4e61-8826-a624c06a766c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:03.022778 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b3d45-2fa5-4e61-8826-a624c06a766c admin admin] PATH_INFO: `/v3/projects/a6746190647b427a9b54b2841178e112/users/7e1f182c349b410d9148be9158093687/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:03.040732 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6d630-aeaf-4727-964c-d8d042ec86ef None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:03.042651 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b3d45-2fa5-4e61-8826-a624c06a766c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6746190647b427a9b54b2841178e112, user_id=7e1f182c349b410d9148be9158093687, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:03.046224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b3d45-2fa5-4e61-8826-a624c06a766c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:03.047784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f940c-376e-49e5-90c5-91672f91efde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:03.048689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f940c-376e-49e5-90c5-91672f91efde service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:03.049455 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f940c-376e-49e5-90c5-91672f91efde service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:03.050561 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f940c-376e-49e5-90c5-91672f91efde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:03.062941 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f940c-376e-49e5-90c5-91672f91efde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:03.066232 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 930/1870] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:02 2022] PUT /identity/v3/projects/a6746190647b427a9b54b2841178e112/users/7e1f182c349b410d9148be9158093687/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:03.066757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f940c-376e-49e5-90c5-91672f91efde service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:03.077960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d872fc9-2227-45bb-bbb1-da8f8008995f None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:03.078158 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d872fc9-2227-45bb-bbb1-da8f8008995f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:03.078349 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d872fc9-2227-45bb-bbb1-da8f8008995f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:03.087346 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:03.087898 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 941/1871] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:03.114099 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-5d872fc9-2227-45bb-bbb1-da8f8008995f None None] MFA Rules not processed for user `7e1f182c349b410d9148be9158093687`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:03.115395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5d872fc9-2227-45bb-bbb1-da8f8008995f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:03.198217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 931/1872] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:03.199155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f940c-376e-49e5-90c5-91672f91efde service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:03.208360 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:03.217072 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f940c-376e-49e5-90c5-91672f91efde service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:03.343769 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f90fc-601e-4aa9-a9ce-cb2e208858b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:03.344668 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f90fc-601e-4aa9-a9ce-cb2e208858b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:03.344960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f90fc-601e-4aa9-a9ce-cb2e208858b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:03.345236 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f90fc-601e-4aa9-a9ce-cb2e208858b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:03.346013 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f90fc-601e-4aa9-a9ce-cb2e208858b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:03.358889 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f90fc-601e-4aa9-a9ce-cb2e208858b7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:03.402749 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d872fc9-2227-45bb-bbb1-da8f8008995f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:03.426054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 942/1873] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:03 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:03.430888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d872fc9-2227-45bb-bbb1-da8f8008995f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:03.532807 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc18f7-e9c5-44e4-83c6-35dec56875ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:03.533587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc18f7-e9c5-44e4-83c6-35dec56875ea admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:03.533869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc18f7-e9c5-44e4-83c6-35dec56875ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:03.534201 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc18f7-e9c5-44e4-83c6-35dec56875ea admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:03.535445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc18f7-e9c5-44e4-83c6-35dec56875ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:03.537380 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc18f7-e9c5-44e4-83c6-35dec56875ea admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:03.584128 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 932/1874] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:03 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:03.588085 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f90fc-601e-4aa9-a9ce-cb2e208858b7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:03.600803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f90fc-601e-4aa9-a9ce-cb2e208858b7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:03.606827 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b78a8-bc00-46e3-9816-ddeba121b77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:03.607869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b78a8-bc00-46e3-9816-ddeba121b77d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:03.608327 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b78a8-bc00-46e3-9816-ddeba121b77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:03.609709 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b78a8-bc00-46e3-9816-ddeba121b77d admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:03.612015 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b78a8-bc00-46e3-9816-ddeba121b77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:03.614724 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b78a8-bc00-46e3-9816-ddeba121b77d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:03.630198 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 943/1875] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:03.634561 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc18f7-e9c5-44e4-83c6-35dec56875ea admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:03.646304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc18f7-e9c5-44e4-83c6-35dec56875ea admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:03.651924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861da04-6011-4cee-a3cf-75727a2bb990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:03.653151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861da04-6011-4cee-a3cf-75727a2bb990 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:03.653464 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861da04-6011-4cee-a3cf-75727a2bb990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:03.653753 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861da04-6011-4cee-a3cf-75727a2bb990 admin admin] PATH_INFO: `/v3/projects/408c291910a14a2fa4d87b8687ccb699/users/c21adcd7c0c847aaaae77561b74f150f/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:03.672631 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861da04-6011-4cee-a3cf-75727a2bb990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=408c291910a14a2fa4d87b8687ccb699, user_id=c21adcd7c0c847aaaae77561b74f150f, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:03.677218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861da04-6011-4cee-a3cf-75727a2bb990 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:03.702791 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 933/1876] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:03 2022] PUT /identity/v3/projects/408c291910a14a2fa4d87b8687ccb699/users/c21adcd7c0c847aaaae77561b74f150f/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:03.707978 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b78a8-bc00-46e3-9816-ddeba121b77d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:03.724819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b78a8-bc00-46e3-9816-ddeba121b77d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:03.810833 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbfb6f-1d2c-499e-9d17-5fe4f9867632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:03.811754 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbfb6f-1d2c-499e-9d17-5fe4f9867632 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:03.812306 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbfb6f-1d2c-499e-9d17-5fe4f9867632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:03.812725 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbfb6f-1d2c-499e-9d17-5fe4f9867632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:03.813617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbfb6f-1d2c-499e-9d17-5fe4f9867632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:03.817096 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbfb6f-1d2c-499e-9d17-5fe4f9867632 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:03.858201 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861da04-6011-4cee-a3cf-75727a2bb990 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:03.863482 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 944/1877] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:03.883571 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861da04-6011-4cee-a3cf-75727a2bb990 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:03.901967 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cac5bc-c357-4eb4-ad03-5d31ff881248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:03.902909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cac5bc-c357-4eb4-ad03-5d31ff881248 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:03.903305 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cac5bc-c357-4eb4-ad03-5d31ff881248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:03.903569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cac5bc-c357-4eb4-ad03-5d31ff881248 admin admin] PATH_INFO: `/v3/projects/408c291910a14a2fa4d87b8687ccb699/users/c21adcd7c0c847aaaae77561b74f150f/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:03.907130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cac5bc-c357-4eb4-ad03-5d31ff881248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=408c291910a14a2fa4d87b8687ccb699, user_id=c21adcd7c0c847aaaae77561b74f150f, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:03.921849 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cac5bc-c357-4eb4-ad03-5d31ff881248 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:03.948770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 934/1878] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:03 2022] PUT /identity/v3/projects/408c291910a14a2fa4d87b8687ccb699/users/c21adcd7c0c847aaaae77561b74f150f/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:03.963776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1960c2a-27fb-4e1d-bf52-b01886766f63 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:03.963776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1960c2a-27fb-4e1d-bf52-b01886766f63 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:03.963776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1960c2a-27fb-4e1d-bf52-b01886766f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:04.018538 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d1960c2a-27fb-4e1d-bf52-b01886766f63 None None] MFA Rules not processed for user `c21adcd7c0c847aaaae77561b74f150f`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:04.022483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d1960c2a-27fb-4e1d-bf52-b01886766f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:04.129420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:04.142043 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 945/1879] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:04.150311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cac5bc-c357-4eb4-ad03-5d31ff881248 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:04.152856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-51cac5bc-c357-4eb4-ad03-5d31ff881248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:04.212464 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:04.219988 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cac5bc-c357-4eb4-ad03-5d31ff881248 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:04.227064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5bba6d-7bba-4d8b-8ee1-387a57aeca1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:04.227912 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bba6d-7bba-4d8b-8ee1-387a57aeca1c service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:04.228729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bba6d-7bba-4d8b-8ee1-387a57aeca1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:04.229071 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5bba6d-7bba-4d8b-8ee1-387a57aeca1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:04.240927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bba6d-7bba-4d8b-8ee1-387a57aeca1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:04.242512 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5bba6d-7bba-4d8b-8ee1-387a57aeca1c service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:04.261112 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 935/1880] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:05.222460 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1960c2a-27fb-4e1d-bf52-b01886766f63 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:05.325212 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1960c2a-27fb-4e1d-bf52-b01886766f63 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:05.331658 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bdd38-59a3-41ed-81a1-169fe08ae489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:05.333195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bdd38-59a3-41ed-81a1-169fe08ae489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:05.333823 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bdd38-59a3-41ed-81a1-169fe08ae489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:05.334547 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bdd38-59a3-41ed-81a1-169fe08ae489 admin admin] PATH_INFO: `/v3/users/7e1f182c349b410d9148be9158093687` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:05.336371 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bdd38-59a3-41ed-81a1-169fe08ae489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1f182c349b410d9148be9158093687)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:05.338570 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bdd38-59a3-41ed-81a1-169fe08ae489 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:05.426513 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5b9bdd38-59a3-41ed-81a1-169fe08ae489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1f182c349b410d9148be9158093687'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:05.436582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5b9bdd38-59a3-41ed-81a1-169fe08ae489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1f182c349b410d9148be9158093687'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:05.462097 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5b9bdd38-59a3-41ed-81a1-169fe08ae489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1f182c349b410d9148be9158093687'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:05.473581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5b9bdd38-59a3-41ed-81a1-169fe08ae489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1f182c349b410d9148be9158093687'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:05.474543 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5b9bdd38-59a3-41ed-81a1-169fe08ae489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1f182c349b410d9148be9158093687'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:05.512918 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 946/1881] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:05 2022] DELETE /identity/v3/users/7e1f182c349b410d9148be9158093687 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:05.517356 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee4ffc-b0c2-432f-aae8-ff7e8e9eff5d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:05.518099 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee4ffc-b0c2-432f-aae8-ff7e8e9eff5d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:05.518214 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee4ffc-b0c2-432f-aae8-ff7e8e9eff5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:05.584574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b9ee4ffc-b0c2-432f-aae8-ff7e8e9eff5d None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:05.586636 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b9ee4ffc-b0c2-432f-aae8-ff7e8e9eff5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:05.673399 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 936/1882] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:05.689160 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bdd38-59a3-41ed-81a1-169fe08ae489 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:05.690718 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5b9bdd38-59a3-41ed-81a1-169fe08ae489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:05.771940 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bdd38-59a3-41ed-81a1-169fe08ae489 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:05.776001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8064b4-fd8f-4f7b-8c55-8073e95c4cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:05.776674 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8064b4-fd8f-4f7b-8c55-8073e95c4cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:05.776955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8064b4-fd8f-4f7b-8c55-8073e95c4cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:05.777237 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8064b4-fd8f-4f7b-8c55-8073e95c4cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:05.789558 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8064b4-fd8f-4f7b-8c55-8073e95c4cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:05.791108 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8064b4-fd8f-4f7b-8c55-8073e95c4cd9 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:05.804466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 947/1883] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:05.873141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd8c40-3283-4934-949a-286457884226 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:05.879619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd8c40-3283-4934-949a-286457884226 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:05.879960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd8c40-3283-4934-949a-286457884226 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:05.882030 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 937/1884] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 19 12:32:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:32:05.963394 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84320c25-613c-49b0-88f1-31f050f51bd2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:05.963696 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84320c25-613c-49b0-88f1-31f050f51bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:05.964135 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84320c25-613c-49b0-88f1-31f050f51bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:05.995593 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-84320c25-613c-49b0-88f1-31f050f51bd2 None None] MFA Rules not processed for user `5d9543657e1e4a6d85632bf57f6ba6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:05.996985 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-84320c25-613c-49b0-88f1-31f050f51bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:06.027372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:06.136829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 948/1885] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 19 12:32:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:06.252231 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd8c40-3283-4934-949a-286457884226 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:06.256674 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-54cd8c40-3283-4934-949a-286457884226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:06.305673 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd8c40-3283-4934-949a-286457884226 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:06.312750 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84320c25-613c-49b0-88f1-31f050f51bd2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:06.314277 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-84320c25-613c-49b0-88f1-31f050f51bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:06.331216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c138e85-a511-45ca-96fd-98dfa0939f23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:06.332006 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c138e85-a511-45ca-96fd-98dfa0939f23 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:06.332360 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c138e85-a511-45ca-96fd-98dfa0939f23 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:06.332617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c138e85-a511-45ca-96fd-98dfa0939f23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:06.349740 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c138e85-a511-45ca-96fd-98dfa0939f23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:06.351486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c138e85-a511-45ca-96fd-98dfa0939f23 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:06.353130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84320c25-613c-49b0-88f1-31f050f51bd2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:06.358947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f74f4-8465-4a95-ad27-64b90801de94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:06.359889 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f74f4-8465-4a95-ad27-64b90801de94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:06.360164 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f74f4-8465-4a95-ad27-64b90801de94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:06.360448 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f74f4-8465-4a95-ad27-64b90801de94 admin admin] PATH_INFO: `/v3/projects/a6746190647b427a9b54b2841178e112` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:06.361769 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f74f4-8465-4a95-ad27-64b90801de94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6746190647b427a9b54b2841178e112)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:06.364381 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f74f4-8465-4a95-ad27-64b90801de94 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:06.365053 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 938/1886] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:06.462370 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c53f74f4-8465-4a95-ad27-64b90801de94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6746190647b427a9b54b2841178e112', 'request_id': 'req-c53f74f4-8465-4a95-ad27-64b90801de94'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:06.484225 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c53f74f4-8465-4a95-ad27-64b90801de94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6746190647b427a9b54b2841178e112', 'request_id': 'req-c53f74f4-8465-4a95-ad27-64b90801de94'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:06.503492 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c53f74f4-8465-4a95-ad27-64b90801de94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6746190647b427a9b54b2841178e112', 'request_id': 'req-c53f74f4-8465-4a95-ad27-64b90801de94'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:06.540774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c53f74f4-8465-4a95-ad27-64b90801de94 admin admin] The token cache is being invalidate because project a6746190647b427a9b54b2841178e112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:06.541162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c53f74f4-8465-4a95-ad27-64b90801de94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:06.542231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c53f74f4-8465-4a95-ad27-64b90801de94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:06.543968 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 949/1887] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:06 2022] DELETE /identity/v3/projects/a6746190647b427a9b54b2841178e112 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:06.548439 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c138e85-a511-45ca-96fd-98dfa0939f23 service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:06.561167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c138e85-a511-45ca-96fd-98dfa0939f23 service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:06.748235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1225ae-f155-40d4-aade-d64c822a3318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:06.748235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1225ae-f155-40d4-aade-d64c822a3318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:06.748235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1225ae-f155-40d4-aade-d64c822a3318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:06.748235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1225ae-f155-40d4-aade-d64c822a3318 admin admin] PATH_INFO: `/v3/users/c21adcd7c0c847aaaae77561b74f150f` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:06.748627 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1225ae-f155-40d4-aade-d64c822a3318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21adcd7c0c847aaaae77561b74f150f)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:06.749570 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1225ae-f155-40d4-aade-d64c822a3318 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:06.843193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-7d1225ae-f155-40d4-aade-d64c822a3318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21adcd7c0c847aaaae77561b74f150f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:06.856099 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-7d1225ae-f155-40d4-aade-d64c822a3318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21adcd7c0c847aaaae77561b74f150f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:06.882149 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-7d1225ae-f155-40d4-aade-d64c822a3318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21adcd7c0c847aaaae77561b74f150f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:06.897110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:06.905229 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-7d1225ae-f155-40d4-aade-d64c822a3318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21adcd7c0c847aaaae77561b74f150f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:06.906338 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-7d1225ae-f155-40d4-aade-d64c822a3318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21adcd7c0c847aaaae77561b74f150f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:06.917718 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 939/1888] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:06 2022] DELETE /identity/v3/users/c21adcd7c0c847aaaae77561b74f150f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:07.425486 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f74f4-8465-4a95-ad27-64b90801de94 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:07.427591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c53f74f4-8465-4a95-ad27-64b90801de94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:07.441978 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f74f4-8465-4a95-ad27-64b90801de94 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:07.541958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dba547-8d79-41b3-805a-42c1a9c6382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:07.543256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dba547-8d79-41b3-805a-42c1a9c6382c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:07.543544 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dba547-8d79-41b3-805a-42c1a9c6382c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:07.543821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dba547-8d79-41b3-805a-42c1a9c6382c admin admin] PATH_INFO: `/v3/projects/408c291910a14a2fa4d87b8687ccb699` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:07.545090 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dba547-8d79-41b3-805a-42c1a9c6382c admin admin] RBAC: Authorizing `identity:delete_project(project_id=408c291910a14a2fa4d87b8687ccb699)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:07.547321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dba547-8d79-41b3-805a-42c1a9c6382c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:07.582644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1225ae-f155-40d4-aade-d64c822a3318 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:07.584708 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7d1225ae-f155-40d4-aade-d64c822a3318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:07.608882 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1225ae-f155-40d4-aade-d64c822a3318 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:07.614684 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:07.639067 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b8dba547-8d79-41b3-805a-42c1a9c6382c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408c291910a14a2fa4d87b8687ccb699', 'request_id': 'req-b8dba547-8d79-41b3-805a-42c1a9c6382c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:07.654647 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b8dba547-8d79-41b3-805a-42c1a9c6382c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408c291910a14a2fa4d87b8687ccb699', 'request_id': 'req-b8dba547-8d79-41b3-805a-42c1a9c6382c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:07.709747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b8dba547-8d79-41b3-805a-42c1a9c6382c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408c291910a14a2fa4d87b8687ccb699', 'request_id': 'req-b8dba547-8d79-41b3-805a-42c1a9c6382c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:07.727431 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b8dba547-8d79-41b3-805a-42c1a9c6382c admin admin] The token cache is being invalidate because project 408c291910a14a2fa4d87b8687ccb699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:07.727762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b8dba547-8d79-41b3-805a-42c1a9c6382c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:07.728507 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b8dba547-8d79-41b3-805a-42c1a9c6382c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:07.733688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 950/1889] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:07 2022] DELETE /identity/v3/projects/408c291910a14a2fa4d87b8687ccb699 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:07.735608 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758bf0a-b7ca-41fe-95c8-43a97af32461 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:07.735976 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758bf0a-b7ca-41fe-95c8-43a97af32461 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:07.736395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758bf0a-b7ca-41fe-95c8-43a97af32461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:07.766547 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8758bf0a-b7ca-41fe-95c8-43a97af32461 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:07.780646 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8758bf0a-b7ca-41fe-95c8-43a97af32461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:07.806881 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddf8d7-e60f-4f67-9193-a6be59e6346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:07.808254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddf8d7-e60f-4f67-9193-a6be59e6346c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:07.808539 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddf8d7-e60f-4f67-9193-a6be59e6346c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:07.808816 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddf8d7-e60f-4f67-9193-a6be59e6346c admin admin] PATH_INFO: `/v3/users/a84dbfb0611843f8888147d2eaef0073` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:07.810198 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddf8d7-e60f-4f67-9193-a6be59e6346c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a84dbfb0611843f8888147d2eaef0073)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:07.813986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddf8d7-e60f-4f67-9193-a6be59e6346c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:07.889494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d6ddf8d7-e60f-4f67-9193-a6be59e6346c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a84dbfb0611843f8888147d2eaef0073'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:07.898997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 951/1890] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:07.906135 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d6ddf8d7-e60f-4f67-9193-a6be59e6346c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a84dbfb0611843f8888147d2eaef0073'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:07.907019 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a3658-d7cf-4ca4-beb3-ded54155919a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:07.907315 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a3658-d7cf-4ca4-beb3-ded54155919a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:07.907594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a3658-d7cf-4ca4-beb3-ded54155919a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:07.926406 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d6ddf8d7-e60f-4f67-9193-a6be59e6346c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a84dbfb0611843f8888147d2eaef0073'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:07.933585 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-804a3658-d7cf-4ca4-beb3-ded54155919a None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:07.935262 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-804a3658-d7cf-4ca4-beb3-ded54155919a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:07.935935 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d6ddf8d7-e60f-4f67-9193-a6be59e6346c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a84dbfb0611843f8888147d2eaef0073'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:07.936590 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d6ddf8d7-e60f-4f67-9193-a6be59e6346c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a84dbfb0611843f8888147d2eaef0073'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:07.944582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 940/1891] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:07 2022] DELETE /identity/v3/users/a84dbfb0611843f8888147d2eaef0073 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:07.950573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 952/1892] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:07.950686 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da37ea-27b8-464b-b650-98b836adc74f None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:07.950686 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da37ea-27b8-464b-b650-98b836adc74f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:07.950686 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da37ea-27b8-464b-b650-98b836adc74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:07.951461 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a3658-d7cf-4ca4-beb3-ded54155919a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:07.970593 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a3658-d7cf-4ca4-beb3-ded54155919a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:07.973258 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-87da37ea-27b8-464b-b650-98b836adc74f None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:07.974432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-87da37ea-27b8-464b-b650-98b836adc74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:08.083735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fb262-ba4d-4617-b88c-306381ae537e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:08.084533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fb262-ba4d-4617-b88c-306381ae537e admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:08.084825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fb262-ba4d-4617-b88c-306381ae537e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:08.085101 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fb262-ba4d-4617-b88c-306381ae537e admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:08.085899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fb262-ba4d-4617-b88c-306381ae537e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:32:08.086208 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fb262-ba4d-4617-b88c-306381ae537e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:08.087788 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 941/1893] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:08.091852 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fb262-ba4d-4617-b88c-306381ae537e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:08.102111 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da37ea-27b8-464b-b650-98b836adc74f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:08.104097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-87da37ea-27b8-464b-b650-98b836adc74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:08.113307 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 953/1894] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:32:08.115059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fb262-ba4d-4617-b88c-306381ae537e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:08.130882 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fb262-ba4d-4617-b88c-306381ae537e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:08.131891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:08.137999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce285e-c770-4319-9488-00b4d0ef6ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:08.139348 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce285e-c770-4319-9488-00b4d0ef6ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:08.139915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce285e-c770-4319-9488-00b4d0ef6ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:08.140393 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce285e-c770-4319-9488-00b4d0ef6ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:08.142229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce285e-c770-4319-9488-00b4d0ef6ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:08.145385 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce285e-c770-4319-9488-00b4d0ef6ea8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:08.216582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 954/1895] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:08 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:08.220595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce285e-c770-4319-9488-00b4d0ef6ea8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:08.260655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da37ea-27b8-464b-b650-98b836adc74f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:08.296313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:08.374307 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce285e-c770-4319-9488-00b4d0ef6ea8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:08.385605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77274e0b-5c49-457a-a1fa-969d1443f47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:08.386302 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77274e0b-5c49-457a-a1fa-969d1443f47e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:08.386789 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77274e0b-5c49-457a-a1fa-969d1443f47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:08.387079 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77274e0b-5c49-457a-a1fa-969d1443f47e admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:08.387814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77274e0b-5c49-457a-a1fa-969d1443f47e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:08.391471 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77274e0b-5c49-457a-a1fa-969d1443f47e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:08.429958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 955/1896] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:08 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:08.432443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77274e0b-5c49-457a-a1fa-969d1443f47e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:08.466707 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36edb3-6684-4e1f-8962-54bf77e1a5d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:08.467689 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36edb3-6684-4e1f-8962-54bf77e1a5d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:08.467791 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36edb3-6684-4e1f-8962-54bf77e1a5d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:08.468050 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36edb3-6684-4e1f-8962-54bf77e1a5d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:08.472414 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77274e0b-5c49-457a-a1fa-969d1443f47e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:08.492396 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd4c80-8ca4-49b2-a61d-944c9c243dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:08.495277 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd4c80-8ca4-49b2-a61d-944c9c243dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:08.495613 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd4c80-8ca4-49b2-a61d-944c9c243dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:08.496729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36edb3-6684-4e1f-8962-54bf77e1a5d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:08.500845 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36edb3-6684-4e1f-8962-54bf77e1a5d6 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:08.501080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd4c80-8ca4-49b2-a61d-944c9c243dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:08.501080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd4c80-8ca4-49b2-a61d-944c9c243dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:08.501450 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd4c80-8ca4-49b2-a61d-944c9c243dcb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:08.522207 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 942/1897] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:08.535525 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36edb3-6684-4e1f-8962-54bf77e1a5d6 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:08.536099 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 956/1898] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:08.555151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36edb3-6684-4e1f-8962-54bf77e1a5d6 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:08.560593 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629e08f-f515-48c1-8cc9-dddbe6883950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:08.561496 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629e08f-f515-48c1-8cc9-dddbe6883950 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:08.561914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629e08f-f515-48c1-8cc9-dddbe6883950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:08.562366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629e08f-f515-48c1-8cc9-dddbe6883950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:08.563775 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629e08f-f515-48c1-8cc9-dddbe6883950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:08.565801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629e08f-f515-48c1-8cc9-dddbe6883950 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:08.582417 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 943/1899] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:08.587119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd4c80-8ca4-49b2-a61d-944c9c243dcb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:08.607180 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd4c80-8ca4-49b2-a61d-944c9c243dcb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:08.619117 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ed004-c1c3-44de-9df9-63b53fa41e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:08.620035 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ed004-c1c3-44de-9df9-63b53fa41e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:08.620398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ed004-c1c3-44de-9df9-63b53fa41e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:08.620675 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ed004-c1c3-44de-9df9-63b53fa41e64 admin admin] PATH_INFO: `/v3/projects/f38c6cbb85184a358c98842f010cf71f/users/1101ae45c2b84f218484f5016329512b/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:08.646966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ed004-c1c3-44de-9df9-63b53fa41e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38c6cbb85184a358c98842f010cf71f, user_id=1101ae45c2b84f218484f5016329512b, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:08.652337 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ed004-c1c3-44de-9df9-63b53fa41e64 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:08.677744 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 957/1900] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:08 2022] PUT /identity/v3/projects/f38c6cbb85184a358c98842f010cf71f/users/1101ae45c2b84f218484f5016329512b/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:08.689319 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb94dca-9549-4ec6-b106-8fd3fb8467be None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:08.690473 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb94dca-9549-4ec6-b106-8fd3fb8467be None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:08.691316 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb94dca-9549-4ec6-b106-8fd3fb8467be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:08.755489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-bcb94dca-9549-4ec6-b106-8fd3fb8467be None None] MFA Rules not processed for user `1101ae45c2b84f218484f5016329512b`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:08.757685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bcb94dca-9549-4ec6-b106-8fd3fb8467be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:08.898805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ed004-c1c3-44de-9df9-63b53fa41e64 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:08.903262 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6e2ed004-c1c3-44de-9df9-63b53fa41e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:08.949938 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 944/1901] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:08.962894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb94dca-9549-4ec6-b106-8fd3fb8467be None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:08.966082 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bcb94dca-9549-4ec6-b106-8fd3fb8467be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:08.996189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ed004-c1c3-44de-9df9-63b53fa41e64 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:09.001496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58d43e-f0e8-4c36-b641-aabe4c3a285c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:09.002525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58d43e-f0e8-4c36-b641-aabe4c3a285c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:09.003524 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58d43e-f0e8-4c36-b641-aabe4c3a285c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:09.003854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58d43e-f0e8-4c36-b641-aabe4c3a285c admin admin] PATH_INFO: `/v3/users/00cd3d12efab46c79d84c202fb0a4681` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:09.005095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58d43e-f0e8-4c36-b641-aabe4c3a285c admin admin] RBAC: Authorizing `identity:delete_user(user_id=00cd3d12efab46c79d84c202fb0a4681)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:09.007117 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58d43e-f0e8-4c36-b641-aabe4c3a285c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:09.044427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb94dca-9549-4ec6-b106-8fd3fb8467be None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:09.050769 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1aee1-936f-4ba3-aa5d-54eda1215006 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1af8b237e2df41668bc5409d8fdd3f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:09.051500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1aee1-936f-4ba3-aa5d-54eda1215006 service glance] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:09.051783 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1aee1-936f-4ba3-aa5d-54eda1215006 service glance] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:09.052146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1aee1-936f-4ba3-aa5d-54eda1215006 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:09.060167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:09.065888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1aee1-936f-4ba3-aa5d-54eda1215006 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:09.068839 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1aee1-936f-4ba3-aa5d-54eda1215006 service glance] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:09.069028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8e58d43e-f0e8-4c36-b641-aabe4c3a285c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00cd3d12efab46c79d84c202fb0a4681'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:09.076539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8e58d43e-f0e8-4c36-b641-aabe4c3a285c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00cd3d12efab46c79d84c202fb0a4681'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:09.086825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 945/1902] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:09.092349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8e58d43e-f0e8-4c36-b641-aabe4c3a285c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00cd3d12efab46c79d84c202fb0a4681'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:09.100444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8e58d43e-f0e8-4c36-b641-aabe4c3a285c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00cd3d12efab46c79d84c202fb0a4681'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:09.101143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8e58d43e-f0e8-4c36-b641-aabe4c3a285c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00cd3d12efab46c79d84c202fb0a4681'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:09.109303 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 958/1903] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:08 2022] DELETE /identity/v3/users/00cd3d12efab46c79d84c202fb0a4681 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:09.116094 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5b3e2-5477-4f32-beeb-8cae04d47bc4 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:09.116409 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5b3e2-5477-4f32-beeb-8cae04d47bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:09.116685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5b3e2-5477-4f32-beeb-8cae04d47bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:09.157437 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58d43e-f0e8-4c36-b641-aabe4c3a285c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:09.159146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8e58d43e-f0e8-4c36-b641-aabe4c3a285c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:09.162554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7bb5b3e2-5477-4f32-beeb-8cae04d47bc4 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:09.163848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7bb5b3e2-5477-4f32-beeb-8cae04d47bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:09.166565 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:09.237322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 946/1904] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:09.243370 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58d43e-f0e8-4c36-b641-aabe4c3a285c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:09.246907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5b3e2-5477-4f32-beeb-8cae04d47bc4 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:09.248262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7bb5b3e2-5477-4f32-beeb-8cae04d47bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:09.249059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a3936-1f49-4e9c-8510-84dfff0ae986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:09.249997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a3936-1f49-4e9c-8510-84dfff0ae986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:09.250387 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a3936-1f49-4e9c-8510-84dfff0ae986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:09.250658 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a3936-1f49-4e9c-8510-84dfff0ae986 admin admin] PATH_INFO: `/v3/projects/614473241f47453780af6712442a3fb2` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:09.252208 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a3936-1f49-4e9c-8510-84dfff0ae986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=614473241f47453780af6712442a3fb2)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:09.255660 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a3936-1f49-4e9c-8510-84dfff0ae986 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:09.311207 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5b3e2-5477-4f32-beeb-8cae04d47bc4 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:09.316732 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-253a3936-1f49-4e9c-8510-84dfff0ae986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '614473241f47453780af6712442a3fb2', 'request_id': 'req-253a3936-1f49-4e9c-8510-84dfff0ae986'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:09.324399 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-253a3936-1f49-4e9c-8510-84dfff0ae986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '614473241f47453780af6712442a3fb2', 'request_id': 'req-253a3936-1f49-4e9c-8510-84dfff0ae986'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:09.334454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-253a3936-1f49-4e9c-8510-84dfff0ae986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '614473241f47453780af6712442a3fb2', 'request_id': 'req-253a3936-1f49-4e9c-8510-84dfff0ae986'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:09.346864 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-253a3936-1f49-4e9c-8510-84dfff0ae986 admin admin] The token cache is being invalidate because project 614473241f47453780af6712442a3fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:09.347221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-253a3936-1f49-4e9c-8510-84dfff0ae986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:09.347902 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-253a3936-1f49-4e9c-8510-84dfff0ae986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:09.349629 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 959/1905] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:09 2022] DELETE /identity/v3/projects/614473241f47453780af6712442a3fb2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:09.353917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a3936-1f49-4e9c-8510-84dfff0ae986 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:09.355595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-253a3936-1f49-4e9c-8510-84dfff0ae986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:09.369480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3c0b8-28ff-4d9e-b3b5-933952655330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:09.370221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3c0b8-28ff-4d9e-b3b5-933952655330 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:09.370650 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3c0b8-28ff-4d9e-b3b5-933952655330 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:09.371012 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3c0b8-28ff-4d9e-b3b5-933952655330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:09.374161 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e8b3c0b8-28ff-4d9e-b3b5-933952655330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:09.447339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a3936-1f49-4e9c-8510-84dfff0ae986 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:09.453547 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba76878-b00e-48b2-8335-0eacd125bba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:09.454569 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba76878-b00e-48b2-8335-0eacd125bba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:09.454687 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba76878-b00e-48b2-8335-0eacd125bba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:09.454999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba76878-b00e-48b2-8335-0eacd125bba7 admin admin] PATH_INFO: `/v3/users/0bf48516d1dd4aa4ab48786ec60284f0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:09.456798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba76878-b00e-48b2-8335-0eacd125bba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf48516d1dd4aa4ab48786ec60284f0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:09.458926 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba76878-b00e-48b2-8335-0eacd125bba7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:09.464138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3c0b8-28ff-4d9e-b3b5-933952655330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:09.465585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3c0b8-28ff-4d9e-b3b5-933952655330 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:09.477233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 947/1906] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:32:09.539229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:09.561522 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cba76878-b00e-48b2-8335-0eacd125bba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf48516d1dd4aa4ab48786ec60284f0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:09.579043 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cba76878-b00e-48b2-8335-0eacd125bba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf48516d1dd4aa4ab48786ec60284f0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:09.603437 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cba76878-b00e-48b2-8335-0eacd125bba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf48516d1dd4aa4ab48786ec60284f0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:09.609167 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cba76878-b00e-48b2-8335-0eacd125bba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf48516d1dd4aa4ab48786ec60284f0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:09.610582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cba76878-b00e-48b2-8335-0eacd125bba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf48516d1dd4aa4ab48786ec60284f0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:09.622169 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 960/1907] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:09 2022] DELETE /identity/v3/users/0bf48516d1dd4aa4ab48786ec60284f0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:09.934517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3c0b8-28ff-4d9e-b3b5-933952655330 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:09.936100 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e8b3c0b8-28ff-4d9e-b3b5-933952655330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:09.948715 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:09.956118 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3c0b8-28ff-4d9e-b3b5-933952655330 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:10.059887 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cb8db-a211-4721-a278-74e06206626f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:10.060968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cb8db-a211-4721-a278-74e06206626f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:10.061376 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cb8db-a211-4721-a278-74e06206626f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:10.061714 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cb8db-a211-4721-a278-74e06206626f admin admin] PATH_INFO: `/v3/projects/7b5aada4886c410d98acdc136bfe5d66` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:10.063450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250cb8db-a211-4721-a278-74e06206626f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b5aada4886c410d98acdc136bfe5d66)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:10.066415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250cb8db-a211-4721-a278-74e06206626f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:10.077474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba76878-b00e-48b2-8335-0eacd125bba7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:10.079024 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cba76878-b00e-48b2-8335-0eacd125bba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:10.099857 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba76878-b00e-48b2-8335-0eacd125bba7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:10.111621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f6fff-9bf7-44b9-8de6-56eb68bd1cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:10.113635 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f6fff-9bf7-44b9-8de6-56eb68bd1cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:10.114055 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f6fff-9bf7-44b9-8de6-56eb68bd1cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:10.114386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f6fff-9bf7-44b9-8de6-56eb68bd1cdc admin admin] PATH_INFO: `/v3/projects/b5f1b88939784226abb2dd6039699c96` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:10.117984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f6fff-9bf7-44b9-8de6-56eb68bd1cdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f1b88939784226abb2dd6039699c96)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:10.120924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f6fff-9bf7-44b9-8de6-56eb68bd1cdc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:10.166205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-250cb8db-a211-4721-a278-74e06206626f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b5aada4886c410d98acdc136bfe5d66', 'request_id': 'req-250cb8db-a211-4721-a278-74e06206626f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:10.194892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-250cb8db-a211-4721-a278-74e06206626f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b5aada4886c410d98acdc136bfe5d66', 'request_id': 'req-250cb8db-a211-4721-a278-74e06206626f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:10.224952 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-486f6fff-9bf7-44b9-8de6-56eb68bd1cdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f1b88939784226abb2dd6039699c96', 'request_id': 'req-486f6fff-9bf7-44b9-8de6-56eb68bd1cdc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:10.240365 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-486f6fff-9bf7-44b9-8de6-56eb68bd1cdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f1b88939784226abb2dd6039699c96', 'request_id': 'req-486f6fff-9bf7-44b9-8de6-56eb68bd1cdc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:10.247393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-250cb8db-a211-4721-a278-74e06206626f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b5aada4886c410d98acdc136bfe5d66', 'request_id': 'req-250cb8db-a211-4721-a278-74e06206626f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:10.254780 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-486f6fff-9bf7-44b9-8de6-56eb68bd1cdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f1b88939784226abb2dd6039699c96', 'request_id': 'req-486f6fff-9bf7-44b9-8de6-56eb68bd1cdc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:10.265586 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-250cb8db-a211-4721-a278-74e06206626f admin admin] The token cache is being invalidate because project 7b5aada4886c410d98acdc136bfe5d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:10.265793 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-250cb8db-a211-4721-a278-74e06206626f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:10.266535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-250cb8db-a211-4721-a278-74e06206626f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:10.269033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 948/1908] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:09 2022] DELETE /identity/v3/projects/7b5aada4886c410d98acdc136bfe5d66 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:10.273383 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cb8db-a211-4721-a278-74e06206626f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:10.275183 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-250cb8db-a211-4721-a278-74e06206626f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:10.281951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-486f6fff-9bf7-44b9-8de6-56eb68bd1cdc admin admin] The token cache is being invalidate because project b5f1b88939784226abb2dd6039699c96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:10.282480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-486f6fff-9bf7-44b9-8de6-56eb68bd1cdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:10.284200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-486f6fff-9bf7-44b9-8de6-56eb68bd1cdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:10.286752 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 961/1909] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:10 2022] DELETE /identity/v3/projects/b5f1b88939784226abb2dd6039699c96 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:10.291929 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcea256-c216-43be-af3c-40f555b5e0d3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:10.292226 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcea256-c216-43be-af3c-40f555b5e0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:10.292505 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcea256-c216-43be-af3c-40f555b5e0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:10.315954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4dcea256-c216-43be-af3c-40f555b5e0d3 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:10.317176 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4dcea256-c216-43be-af3c-40f555b5e0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:10.368644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cb8db-a211-4721-a278-74e06206626f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:10.390476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 962/1910] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:10.398975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e6c7b-642e-46f7-ae4d-ebb1bfdea7cc None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:10.399285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e6c7b-642e-46f7-ae4d-ebb1bfdea7cc None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:10.399548 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e6c7b-642e-46f7-ae4d-ebb1bfdea7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:10.410274 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:10.421302 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-816e6c7b-642e-46f7-ae4d-ebb1bfdea7cc None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:10.422466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-816e6c7b-642e-46f7-ae4d-ebb1bfdea7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:10.431500 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 963/1911] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:10.435510 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af121be8-a4ed-4bb4-8177-3c4caeef5635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:10.435688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e6c7b-642e-46f7-ae4d-ebb1bfdea7cc None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:10.436537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af121be8-a4ed-4bb4-8177-3c4caeef5635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:10.436816 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af121be8-a4ed-4bb4-8177-3c4caeef5635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:10.437088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af121be8-a4ed-4bb4-8177-3c4caeef5635 admin admin] PATH_INFO: `/v3/users/a0142f734d80450fb2f0e7f45e015904` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:10.438292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af121be8-a4ed-4bb4-8177-3c4caeef5635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0142f734d80450fb2f0e7f45e015904)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:10.440317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af121be8-a4ed-4bb4-8177-3c4caeef5635 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:10.446549 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e6c7b-642e-46f7-ae4d-ebb1bfdea7cc None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:10.452977 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901263a-67fb-4af2-a813-c35d7b313bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:10.453634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901263a-67fb-4af2-a813-c35d7b313bec admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:10.453912 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901263a-67fb-4af2-a813-c35d7b313bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:10.454181 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901263a-67fb-4af2-a813-c35d7b313bec admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:10.454927 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901263a-67fb-4af2-a813-c35d7b313bec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:32:10.455473 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901263a-67fb-4af2-a813-c35d7b313bec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:10.457510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901263a-67fb-4af2-a813-c35d7b313bec admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:10.470701 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 964/1912] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:32:10.475846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901263a-67fb-4af2-a813-c35d7b313bec admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:10.487321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901263a-67fb-4af2-a813-c35d7b313bec admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:10.492552 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1173e4-503b-4408-b647-aeccffed1794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:10.493215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1173e4-503b-4408-b647-aeccffed1794 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:10.493494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1173e4-503b-4408-b647-aeccffed1794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:10.493764 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1173e4-503b-4408-b647-aeccffed1794 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:10.494444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1173e4-503b-4408-b647-aeccffed1794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:10.496378 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1173e4-503b-4408-b647-aeccffed1794 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:10.496875 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-af121be8-a4ed-4bb4-8177-3c4caeef5635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0142f734d80450fb2f0e7f45e015904'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:10.504263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-af121be8-a4ed-4bb4-8177-3c4caeef5635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0142f734d80450fb2f0e7f45e015904'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:10.517161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:10.521775 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-af121be8-a4ed-4bb4-8177-3c4caeef5635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0142f734d80450fb2f0e7f45e015904'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:10.531210 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-af121be8-a4ed-4bb4-8177-3c4caeef5635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0142f734d80450fb2f0e7f45e015904'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:10.531998 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-af121be8-a4ed-4bb4-8177-3c4caeef5635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0142f734d80450fb2f0e7f45e015904'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:10.536755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 965/1913] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:10 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:32:10.540657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 949/1914] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:10 2022] DELETE /identity/v3/users/a0142f734d80450fb2f0e7f45e015904 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:10.541695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1173e4-503b-4408-b647-aeccffed1794 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:10.543411 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ed1173e4-503b-4408-b647-aeccffed1794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:10.624581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1173e4-503b-4408-b647-aeccffed1794 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:10.726293 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba1d34-0644-41bd-a02d-242d67b00eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:10.727557 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba1d34-0644-41bd-a02d-242d67b00eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:10.727894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba1d34-0644-41bd-a02d-242d67b00eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:10.728170 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba1d34-0644-41bd-a02d-242d67b00eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:10.728964 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba1d34-0644-41bd-a02d-242d67b00eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:10.731122 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba1d34-0644-41bd-a02d-242d67b00eb1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:10.765164 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 966/1915] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:10 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:32:10.766511 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af121be8-a4ed-4bb4-8177-3c4caeef5635 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:10.778592 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af121be8-a4ed-4bb4-8177-3c4caeef5635 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:10.789617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214d60f-8d37-47c6-a6ca-a911e58960e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:10.790329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214d60f-8d37-47c6-a6ca-a911e58960e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:10.790625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214d60f-8d37-47c6-a6ca-a911e58960e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:10.790928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214d60f-8d37-47c6-a6ca-a911e58960e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:10.791680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214d60f-8d37-47c6-a6ca-a911e58960e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:10.793670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214d60f-8d37-47c6-a6ca-a911e58960e3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:10.816361 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 950/1916] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:10.818374 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba1d34-0644-41bd-a02d-242d67b00eb1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:10.832815 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba1d34-0644-41bd-a02d-242d67b00eb1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:10.838131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb223316-5c58-4170-9ad7-b9e0ce0f0cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:10.838962 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223316-5c58-4170-9ad7-b9e0ce0f0cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:10.839305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223316-5c58-4170-9ad7-b9e0ce0f0cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:10.839641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223316-5c58-4170-9ad7-b9e0ce0f0cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:10.840429 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb223316-5c58-4170-9ad7-b9e0ce0f0cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:10.842312 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb223316-5c58-4170-9ad7-b9e0ce0f0cc5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:10.854221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 967/1917] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:10.858665 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214d60f-8d37-47c6-a6ca-a911e58960e3 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:10.870081 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214d60f-8d37-47c6-a6ca-a911e58960e3 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:10.878725 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76873b2d-606f-4de1-a60c-fd282c8dc9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:10.880038 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873b2d-606f-4de1-a60c-fd282c8dc9c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:10.880357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873b2d-606f-4de1-a60c-fd282c8dc9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:10.880642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873b2d-606f-4de1-a60c-fd282c8dc9c8 admin admin] PATH_INFO: `/v3/projects/8fe1c6f069ea438494b97a819f072251/users/96559cbdc16c45fab6b7a6d5a0b7f0ba/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:10.900298 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76873b2d-606f-4de1-a60c-fd282c8dc9c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe1c6f069ea438494b97a819f072251, user_id=96559cbdc16c45fab6b7a6d5a0b7f0ba, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:10.903106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76873b2d-606f-4de1-a60c-fd282c8dc9c8 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:10.924142 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 951/1918] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:10 2022] PUT /identity/v3/projects/8fe1c6f069ea438494b97a819f072251/users/96559cbdc16c45fab6b7a6d5a0b7f0ba/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:10.939449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f588ef5-9d85-4d6d-98b2-3c2d6872d2f0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:10.939449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f588ef5-9d85-4d6d-98b2-3c2d6872d2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:10.939449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f588ef5-9d85-4d6d-98b2-3c2d6872d2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:10.964844 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9f588ef5-9d85-4d6d-98b2-3c2d6872d2f0 None None] MFA Rules not processed for user `96559cbdc16c45fab6b7a6d5a0b7f0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:10.966101 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9f588ef5-9d85-4d6d-98b2-3c2d6872d2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:10.991453 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76873b2d-606f-4de1-a60c-fd282c8dc9c8 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:10.993837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-76873b2d-606f-4de1-a60c-fd282c8dc9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:11.063762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 968/1919] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:11.065110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f588ef5-9d85-4d6d-98b2-3c2d6872d2f0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:11.074350 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76873b2d-606f-4de1-a60c-fd282c8dc9c8 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:11.079528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fcd7d-97c3-464f-8a40-83b8483c5fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:11.080563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fcd7d-97c3-464f-8a40-83b8483c5fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:11.081273 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f588ef5-9d85-4d6d-98b2-3c2d6872d2f0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:11.081507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fcd7d-97c3-464f-8a40-83b8483c5fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:11.081911 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fcd7d-97c3-464f-8a40-83b8483c5fdf admin admin] PATH_INFO: `/v3/projects/47ece91aedc64e6cb4d5fdb2bdbfeb32` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:11.083154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2fcd7d-97c3-464f-8a40-83b8483c5fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=47ece91aedc64e6cb4d5fdb2bdbfeb32)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:11.085291 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2fcd7d-97c3-464f-8a40-83b8483c5fdf admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:11.086641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184eb8e2-d0c6-4081-95f0-7a4ef5a15db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:11.087751 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eb8e2-d0c6-4081-95f0-7a4ef5a15db6 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:11.088618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eb8e2-d0c6-4081-95f0-7a4ef5a15db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:11.088900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eb8e2-d0c6-4081-95f0-7a4ef5a15db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:11.089606 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184eb8e2-d0c6-4081-95f0-7a4ef5a15db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:11.091900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184eb8e2-d0c6-4081-95f0-7a4ef5a15db6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:11.108492 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:11.129400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:11.157751 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5b2fcd7d-97c3-464f-8a40-83b8483c5fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47ece91aedc64e6cb4d5fdb2bdbfeb32', 'request_id': 'req-5b2fcd7d-97c3-464f-8a40-83b8483c5fdf'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:11.158523 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 969/1920] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:11 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:32:11.160852 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184eb8e2-d0c6-4081-95f0-7a4ef5a15db6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:11.173632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5b2fcd7d-97c3-464f-8a40-83b8483c5fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47ece91aedc64e6cb4d5fdb2bdbfeb32', 'request_id': 'req-5b2fcd7d-97c3-464f-8a40-83b8483c5fdf'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:11.189959 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5b2fcd7d-97c3-464f-8a40-83b8483c5fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47ece91aedc64e6cb4d5fdb2bdbfeb32', 'request_id': 'req-5b2fcd7d-97c3-464f-8a40-83b8483c5fdf'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:11.219886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5b2fcd7d-97c3-464f-8a40-83b8483c5fdf admin admin] The token cache is being invalidate because project 47ece91aedc64e6cb4d5fdb2bdbfeb32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:11.220180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5b2fcd7d-97c3-464f-8a40-83b8483c5fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:11.223192 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5b2fcd7d-97c3-464f-8a40-83b8483c5fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:11.233979 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 952/1921] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:10 2022] DELETE /identity/v3/projects/47ece91aedc64e6cb4d5fdb2bdbfeb32 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:11.239144 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d227c6a-39db-4bb7-b56e-a03f5337f51b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:11.239435 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d227c6a-39db-4bb7-b56e-a03f5337f51b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:11.239709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d227c6a-39db-4bb7-b56e-a03f5337f51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:11.290727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184eb8e2-d0c6-4081-95f0-7a4ef5a15db6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:11.293088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3d227c6a-39db-4bb7-b56e-a03f5337f51b None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:11.294341 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3d227c6a-39db-4bb7-b56e-a03f5337f51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:11.310009 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b028c7e-beb7-4e26-a891-926d281e7dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:11.311786 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b028c7e-beb7-4e26-a891-926d281e7dea admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:11.313030 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b028c7e-beb7-4e26-a891-926d281e7dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:11.313282 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b028c7e-beb7-4e26-a891-926d281e7dea admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:11.318528 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b028c7e-beb7-4e26-a891-926d281e7dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:11.321019 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 953/1922] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:11.324640 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b028c7e-beb7-4e26-a891-926d281e7dea admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:11.329574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53fa2d-f43a-45a0-a995-0d82c16437f3 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:11.330285 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53fa2d-f43a-45a0-a995-0d82c16437f3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:11.330285 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53fa2d-f43a-45a0-a995-0d82c16437f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:11.379077 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 970/1923] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:11 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:11.379077 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b028c7e-beb7-4e26-a891-926d281e7dea admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:11.379077 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0b028c7e-beb7-4e26-a891-926d281e7dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:11.381496 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ce53fa2d-f43a-45a0-a995-0d82c16437f3 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:11.382253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ce53fa2d-f43a-45a0-a995-0d82c16437f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:11.404507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 954/1924] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:11.406947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53fa2d-f43a-45a0-a995-0d82c16437f3 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:11.414356 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b028c7e-beb7-4e26-a891-926d281e7dea admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:11.422663 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53fa2d-f43a-45a0-a995-0d82c16437f3 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:11.423148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6e5e1-c64e-4a8a-b0e6-7ec023b89174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:11.423843 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6e5e1-c64e-4a8a-b0e6-7ec023b89174 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:11.424122 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6e5e1-c64e-4a8a-b0e6-7ec023b89174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:11.424398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6e5e1-c64e-4a8a-b0e6-7ec023b89174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:11.425279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6e5e1-c64e-4a8a-b0e6-7ec023b89174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:11.428748 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6e5e1-c64e-4a8a-b0e6-7ec023b89174 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:11.431030 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a326f-76aa-4147-94d3-f09a44de9ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:11.431894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a326f-76aa-4147-94d3-f09a44de9ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:11.432442 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a326f-76aa-4147-94d3-f09a44de9ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:11.432922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a326f-76aa-4147-94d3-f09a44de9ef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:11.433701 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a326f-76aa-4147-94d3-f09a44de9ef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:32:11.434010 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a326f-76aa-4147-94d3-f09a44de9ef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:11.436992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a326f-76aa-4147-94d3-f09a44de9ef4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:11.455568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 971/1925] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:11.458243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6e5e1-c64e-4a8a-b0e6-7ec023b89174 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:11.486176 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6e5e1-c64e-4a8a-b0e6-7ec023b89174 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:11.492311 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd706b73-7f78-4fbe-b120-66f570dbd3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:11.494245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd706b73-7f78-4fbe-b120-66f570dbd3af admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:11.494960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd706b73-7f78-4fbe-b120-66f570dbd3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:11.495432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd706b73-7f78-4fbe-b120-66f570dbd3af admin admin] PATH_INFO: `/v3/projects/aa18376ee3094dceae76db0214d39d44/users/81673028696443bba9009e437203fac3/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:11.506062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 955/1926] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:32:11.511611 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a326f-76aa-4147-94d3-f09a44de9ef4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:11.533695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd706b73-7f78-4fbe-b120-66f570dbd3af admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa18376ee3094dceae76db0214d39d44, user_id=81673028696443bba9009e437203fac3, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:11.537741 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd706b73-7f78-4fbe-b120-66f570dbd3af admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:11.552421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a326f-76aa-4147-94d3-f09a44de9ef4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:11.573005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 972/1927] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:11 2022] PUT /identity/v3/projects/aa18376ee3094dceae76db0214d39d44/users/81673028696443bba9009e437203fac3/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:11.579777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd706b73-7f78-4fbe-b120-66f570dbd3af admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:11.632095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8c8a8-4134-45f2-a8c7-002e8aa229fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:11.633494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8c8a8-4134-45f2-a8c7-002e8aa229fb admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:11.633784 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8c8a8-4134-45f2-a8c7-002e8aa229fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:11.634060 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8c8a8-4134-45f2-a8c7-002e8aa229fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:11.634824 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8c8a8-4134-45f2-a8c7-002e8aa229fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:11.637186 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8c8a8-4134-45f2-a8c7-002e8aa229fb admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:11.677736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 956/1928] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:11 2022] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:11.680360 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8c8a8-4134-45f2-a8c7-002e8aa229fb admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:11.690500 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd706b73-7f78-4fbe-b120-66f570dbd3af admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:11.764002 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:11.768953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8c8a8-4134-45f2-a8c7-002e8aa229fb admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:11.774782 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a25dd-8142-438c-ae25-4422ab3e30e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:11.775809 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a25dd-8142-438c-ae25-4422ab3e30e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:11.776101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a25dd-8142-438c-ae25-4422ab3e30e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:11.776381 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a25dd-8142-438c-ae25-4422ab3e30e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:11.777091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a25dd-8142-438c-ae25-4422ab3e30e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:11.778469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c5b05-ca43-448d-8239-b777950fcd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:11.779138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a25dd-8142-438c-ae25-4422ab3e30e8 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:11.779291 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c5b05-ca43-448d-8239-b777950fcd04 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:11.779697 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c5b05-ca43-448d-8239-b777950fcd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:11.780044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c5b05-ca43-448d-8239-b777950fcd04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:11.781036 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c5b05-ca43-448d-8239-b777950fcd04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:11.782776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c5b05-ca43-448d-8239-b777950fcd04 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:11.798457 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 973/1929] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:11.804058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c5b05-ca43-448d-8239-b777950fcd04 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:11.810277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 957/1930] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:11 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:11.814195 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a25dd-8142-438c-ae25-4422ab3e30e8 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:11.819169 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c5b05-ca43-448d-8239-b777950fcd04 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:11.823911 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:11.824580 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e7782-096e-4136-8aa1-ff4f737a3c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:11.825549 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e7782-096e-4136-8aa1-ff4f737a3c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:11.825813 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e7782-096e-4136-8aa1-ff4f737a3c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:11.826066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e7782-096e-4136-8aa1-ff4f737a3c7a admin admin] PATH_INFO: `/v3/projects/aa18376ee3094dceae76db0214d39d44/users/81673028696443bba9009e437203fac3/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:11.828584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e7782-096e-4136-8aa1-ff4f737a3c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa18376ee3094dceae76db0214d39d44, user_id=81673028696443bba9009e437203fac3, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:11.828801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a25dd-8142-438c-ae25-4422ab3e30e8 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:11.832146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e7782-096e-4136-8aa1-ff4f737a3c7a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:11.838591 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee44844-6170-4db4-8be3-1b3ac1a46e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:11.842477 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee44844-6170-4db4-8be3-1b3ac1a46e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:11.842477 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee44844-6170-4db4-8be3-1b3ac1a46e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:11.842477 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee44844-6170-4db4-8be3-1b3ac1a46e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:11.842477 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee44844-6170-4db4-8be3-1b3ac1a46e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:11.843825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee44844-6170-4db4-8be3-1b3ac1a46e16 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:11.855130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 974/1931] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:11 2022] PUT /identity/v3/projects/aa18376ee3094dceae76db0214d39d44/users/81673028696443bba9009e437203fac3/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:11.861889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 958/1932] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:32:11.867032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e7782-096e-4136-8aa1-ff4f737a3c7a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:11.871412 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81141965-1f71-4020-8d3a-093a8ed6f9df None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:11.871712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81141965-1f71-4020-8d3a-093a8ed6f9df None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:11.872032 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81141965-1f71-4020-8d3a-093a8ed6f9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:11.917576 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-81141965-1f71-4020-8d3a-093a8ed6f9df None None] MFA Rules not processed for user `81673028696443bba9009e437203fac3`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:11.919407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-81141965-1f71-4020-8d3a-093a8ed6f9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:11.992711 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e7782-096e-4136-8aa1-ff4f737a3c7a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:11.998078 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7234925-fe79-4f89-9806-b367d4389f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:11.998809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7234925-fe79-4f89-9806-b367d4389f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:11.999106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7234925-fe79-4f89-9806-b367d4389f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:11.999383 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7234925-fe79-4f89-9806-b367d4389f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:12.000115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7234925-fe79-4f89-9806-b367d4389f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:12.001729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7234925-fe79-4f89-9806-b367d4389f1b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:12.013281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 975/1933] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:12.017409 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7234925-fe79-4f89-9806-b367d4389f1b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:12.028387 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 959/1934] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:12.031261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7234925-fe79-4f89-9806-b367d4389f1b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:12.040979 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81141965-1f71-4020-8d3a-093a8ed6f9df None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:12.042044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae235510-8239-4aa5-8e0f-e5f497c1aeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:12.042432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-81141965-1f71-4020-8d3a-093a8ed6f9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:12.043401 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae235510-8239-4aa5-8e0f-e5f497c1aeee admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:12.043903 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae235510-8239-4aa5-8e0f-e5f497c1aeee admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:12.044346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae235510-8239-4aa5-8e0f-e5f497c1aeee admin admin] PATH_INFO: `/v3/projects/5edf717b864049e19db1b026c7fd9004/users/ba86c26135df41f7a79e5ff1d713a571/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:12.061267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae235510-8239-4aa5-8e0f-e5f497c1aeee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5edf717b864049e19db1b026c7fd9004, user_id=ba86c26135df41f7a79e5ff1d713a571, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:12.064304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae235510-8239-4aa5-8e0f-e5f497c1aeee admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:12.084265 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 976/1935] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:12 2022] PUT /identity/v3/projects/5edf717b864049e19db1b026c7fd9004/users/ba86c26135df41f7a79e5ff1d713a571/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:12.097673 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8a354-c286-4691-9cc4-aab837ed3cd3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:12.098030 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8a354-c286-4691-9cc4-aab837ed3cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:12.098401 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8a354-c286-4691-9cc4-aab837ed3cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:12.130131 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81141965-1f71-4020-8d3a-093a8ed6f9df None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:12.131916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e3b8a354-c286-4691-9cc4-aab837ed3cd3 None None] MFA Rules not processed for user `ba86c26135df41f7a79e5ff1d713a571`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:12.133181 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e3b8a354-c286-4691-9cc4-aab837ed3cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:12.191560 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b669fc-df17-4332-b180-6afef96f6a6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:12.192299 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b669fc-df17-4332-b180-6afef96f6a6d service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:12.192581 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b669fc-df17-4332-b180-6afef96f6a6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:12.192854 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b669fc-df17-4332-b180-6afef96f6a6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:12.194755 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a6b669fc-df17-4332-b180-6afef96f6a6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:12.214881 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 977/1936] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:12.220021 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8a354-c286-4691-9cc4-aab837ed3cd3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:12.255031 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:12.270484 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:12.271517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b669fc-df17-4332-b180-6afef96f6a6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:12.273147 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b669fc-df17-4332-b180-6afef96f6a6d service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:12.287799 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 960/1937] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:32:12.302107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8a354-c286-4691-9cc4-aab837ed3cd3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:12.307811 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77187514-351d-4c74-8872-4baae1248dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:12.308699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77187514-351d-4c74-8872-4baae1248dea admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:12.309098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77187514-351d-4c74-8872-4baae1248dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:12.309472 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77187514-351d-4c74-8872-4baae1248dea admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:12.310318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77187514-351d-4c74-8872-4baae1248dea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:12.312571 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77187514-351d-4c74-8872-4baae1248dea admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:12.348151 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 978/1938] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:12 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:12.349247 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b669fc-df17-4332-b180-6afef96f6a6d service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:12.367239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b669fc-df17-4332-b180-6afef96f6a6d service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:12.483310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4ec9c-84a3-43f6-a55d-6ece540f78e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:12.484361 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4ec9c-84a3-43f6-a55d-6ece540f78e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:12.485086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4ec9c-84a3-43f6-a55d-6ece540f78e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:12.485630 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4ec9c-84a3-43f6-a55d-6ece540f78e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:12.486509 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4ec9c-84a3-43f6-a55d-6ece540f78e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:12.490803 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4ec9c-84a3-43f6-a55d-6ece540f78e5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:12.523363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 961/1939] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:12 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:32:12.527514 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77187514-351d-4c74-8872-4baae1248dea admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:12.543600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77187514-351d-4c74-8872-4baae1248dea admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:12.552259 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10a076-b5da-4f2f-af87-4d63430372ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:12.553396 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10a076-b5da-4f2f-af87-4d63430372ff admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:12.553782 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10a076-b5da-4f2f-af87-4d63430372ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:12.554219 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10a076-b5da-4f2f-af87-4d63430372ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:12.555667 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10a076-b5da-4f2f-af87-4d63430372ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:12.558061 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10a076-b5da-4f2f-af87-4d63430372ff admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:12.576376 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 979/1940] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:12.583232 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4ec9c-84a3-43f6-a55d-6ece540f78e5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:12.599779 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4ec9c-84a3-43f6-a55d-6ece540f78e5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:12.607115 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de45b1-ebeb-4688-a811-a50d6f7abcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:12.608024 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de45b1-ebeb-4688-a811-a50d6f7abcc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:12.608441 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de45b1-ebeb-4688-a811-a50d6f7abcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:12.608716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de45b1-ebeb-4688-a811-a50d6f7abcc0 admin admin] PATH_INFO: `/v3/projects/9136d6e372aa4d33b88d26e78f40af31/users/1911f45fd7174d0f8af5e958b1ffa632/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:12.638180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de45b1-ebeb-4688-a811-a50d6f7abcc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9136d6e372aa4d33b88d26e78f40af31, user_id=1911f45fd7174d0f8af5e958b1ffa632, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:12.641308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de45b1-ebeb-4688-a811-a50d6f7abcc0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:12.670826 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 962/1941] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:12 2022] PUT /identity/v3/projects/9136d6e372aa4d33b88d26e78f40af31/users/1911f45fd7174d0f8af5e958b1ffa632/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:12.676396 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10a076-b5da-4f2f-af87-4d63430372ff admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:12.689021 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10a076-b5da-4f2f-af87-4d63430372ff admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:12.881774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e8493-7a1e-4ba6-bd34-9e98bdaf8c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:12.882651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8493-7a1e-4ba6-bd34-9e98bdaf8c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:12.883049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8493-7a1e-4ba6-bd34-9e98bdaf8c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:12.883467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8493-7a1e-4ba6-bd34-9e98bdaf8c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:12.884380 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e8493-7a1e-4ba6-bd34-9e98bdaf8c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:12.888232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e8493-7a1e-4ba6-bd34-9e98bdaf8c51 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:12.902510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 980/1942] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:12.903770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de45b1-ebeb-4688-a811-a50d6f7abcc0 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:12.916055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de45b1-ebeb-4688-a811-a50d6f7abcc0 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:12.920950 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7c9a1-936f-4c9d-815b-20cdb360b5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:12.921847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7c9a1-936f-4c9d-815b-20cdb360b5c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:12.922199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7c9a1-936f-4c9d-815b-20cdb360b5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:12.922459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7c9a1-936f-4c9d-815b-20cdb360b5c4 admin admin] PATH_INFO: `/v3/projects/9136d6e372aa4d33b88d26e78f40af31/users/1911f45fd7174d0f8af5e958b1ffa632/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:12.925251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7c9a1-936f-4c9d-815b-20cdb360b5c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9136d6e372aa4d33b88d26e78f40af31, user_id=1911f45fd7174d0f8af5e958b1ffa632, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:12.928070 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7c9a1-936f-4c9d-815b-20cdb360b5c4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:12.944063 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 963/1943] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:12 2022] PUT /identity/v3/projects/9136d6e372aa4d33b88d26e78f40af31/users/1911f45fd7174d0f8af5e958b1ffa632/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:12.954485 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec7e6f-a1e1-41a1-a6ca-c1cc7c48eec5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:12.954845 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec7e6f-a1e1-41a1-a6ca-c1cc7c48eec5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:12.955082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec7e6f-a1e1-41a1-a6ca-c1cc7c48eec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:12.992308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6fec7e6f-a1e1-41a1-a6ca-c1cc7c48eec5 None None] MFA Rules not processed for user `1911f45fd7174d0f8af5e958b1ffa632`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:12.993736 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6fec7e6f-a1e1-41a1-a6ca-c1cc7c48eec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:13.069313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 981/1944] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:13.080558 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7c9a1-936f-4c9d-815b-20cdb360b5c4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:13.082926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-28f7c9a1-936f-4c9d-815b-20cdb360b5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:13.141272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7c9a1-936f-4c9d-815b-20cdb360b5c4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:13.145281 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3872b5-ad5e-4dbc-a4cd-169f62895148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:13.145935 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3872b5-ad5e-4dbc-a4cd-169f62895148 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:13.146222 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3872b5-ad5e-4dbc-a4cd-169f62895148 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:13.146498 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3872b5-ad5e-4dbc-a4cd-169f62895148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:13.156259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3872b5-ad5e-4dbc-a4cd-169f62895148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:13.157689 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3872b5-ad5e-4dbc-a4cd-169f62895148 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:13.167700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 964/1945] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:32:13.575781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec7e6f-a1e1-41a1-a6ca-c1cc7c48eec5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:13.616253 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:13.648061 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec7e6f-a1e1-41a1-a6ca-c1cc7c48eec5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:13.652939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd5c66-d6db-4964-b64f-5a0ecf098d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:13.653808 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd5c66-d6db-4964-b64f-5a0ecf098d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:13.654091 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd5c66-d6db-4964-b64f-5a0ecf098d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:13.654393 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd5c66-d6db-4964-b64f-5a0ecf098d8f admin admin] PATH_INFO: `/v3/users/ba86c26135df41f7a79e5ff1d713a571` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:13.655653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd5c66-d6db-4964-b64f-5a0ecf098d8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba86c26135df41f7a79e5ff1d713a571)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:13.657626 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd5c66-d6db-4964-b64f-5a0ecf098d8f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:13.714692 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fdd5c66-d6db-4964-b64f-5a0ecf098d8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba86c26135df41f7a79e5ff1d713a571'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:13.722609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fdd5c66-d6db-4964-b64f-5a0ecf098d8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba86c26135df41f7a79e5ff1d713a571'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:13.734576 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fdd5c66-d6db-4964-b64f-5a0ecf098d8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba86c26135df41f7a79e5ff1d713a571'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:13.743342 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fdd5c66-d6db-4964-b64f-5a0ecf098d8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba86c26135df41f7a79e5ff1d713a571'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:13.744435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fdd5c66-d6db-4964-b64f-5a0ecf098d8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba86c26135df41f7a79e5ff1d713a571'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:13.759471 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 982/1946] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:13 2022] DELETE /identity/v3/users/ba86c26135df41f7a79e5ff1d713a571 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:13.764197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86342d30-5261-4827-9ac5-9b2abd02fc0c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:13.764485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86342d30-5261-4827-9ac5-9b2abd02fc0c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:13.764766 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86342d30-5261-4827-9ac5-9b2abd02fc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:13.786729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-86342d30-5261-4827-9ac5-9b2abd02fc0c None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:13.788015 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-86342d30-5261-4827-9ac5-9b2abd02fc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:13.828316 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:13.852137 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 965/1947] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:13.861792 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd5c66-d6db-4964-b64f-5a0ecf098d8f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:13.863812 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5fdd5c66-d6db-4964-b64f-5a0ecf098d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:13.926390 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd5c66-d6db-4964-b64f-5a0ecf098d8f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:13.932933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ce818-66d0-4e46-9288-c71732b2581c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:13.933594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ce818-66d0-4e46-9288-c71732b2581c service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:13.933869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ce818-66d0-4e46-9288-c71732b2581c service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:13.934138 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ce818-66d0-4e46-9288-c71732b2581c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:13.943784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ce818-66d0-4e46-9288-c71732b2581c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:13.945891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ce818-66d0-4e46-9288-c71732b2581c service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:13.956256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 983/1948] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:14.356249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86342d30-5261-4827-9ac5-9b2abd02fc0c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:14.358789 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-86342d30-5261-4827-9ac5-9b2abd02fc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:14.372796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86342d30-5261-4827-9ac5-9b2abd02fc0c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:14.377986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095157e6-9577-4649-bc92-c602401c9e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:14.378916 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095157e6-9577-4649-bc92-c602401c9e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:14.379200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095157e6-9577-4649-bc92-c602401c9e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:14.379481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095157e6-9577-4649-bc92-c602401c9e79 admin admin] PATH_INFO: `/v3/projects/5edf717b864049e19db1b026c7fd9004` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:14.380833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095157e6-9577-4649-bc92-c602401c9e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5edf717b864049e19db1b026c7fd9004)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:14.382781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095157e6-9577-4649-bc92-c602401c9e79 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:14.437168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-095157e6-9577-4649-bc92-c602401c9e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5edf717b864049e19db1b026c7fd9004', 'request_id': 'req-095157e6-9577-4649-bc92-c602401c9e79'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:14.443986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-095157e6-9577-4649-bc92-c602401c9e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5edf717b864049e19db1b026c7fd9004', 'request_id': 'req-095157e6-9577-4649-bc92-c602401c9e79'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:14.454043 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-095157e6-9577-4649-bc92-c602401c9e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5edf717b864049e19db1b026c7fd9004', 'request_id': 'req-095157e6-9577-4649-bc92-c602401c9e79'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:14.467359 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-095157e6-9577-4649-bc92-c602401c9e79 admin admin] The token cache is being invalidate because project 5edf717b864049e19db1b026c7fd9004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:14.467686 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-095157e6-9577-4649-bc92-c602401c9e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:14.468461 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-095157e6-9577-4649-bc92-c602401c9e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:14.470189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 966/1949] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:14 2022] DELETE /identity/v3/projects/5edf717b864049e19db1b026c7fd9004 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:14.474641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ce818-66d0-4e46-9288-c71732b2581c service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:14.484712 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ce818-66d0-4e46-9288-c71732b2581c service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:14.551203 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:14.562356 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34f4e7-24c1-4da9-be7c-133f6df7c331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:14.563352 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34f4e7-24c1-4da9-be7c-133f6df7c331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:14.563862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34f4e7-24c1-4da9-be7c-133f6df7c331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:14.564355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34f4e7-24c1-4da9-be7c-133f6df7c331 admin admin] PATH_INFO: `/v3/users/1911f45fd7174d0f8af5e958b1ffa632` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:14.565990 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34f4e7-24c1-4da9-be7c-133f6df7c331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1911f45fd7174d0f8af5e958b1ffa632)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:14.567988 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34f4e7-24c1-4da9-be7c-133f6df7c331 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:14.638858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1b34f4e7-24c1-4da9-be7c-133f6df7c331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1911f45fd7174d0f8af5e958b1ffa632'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:14.653790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1b34f4e7-24c1-4da9-be7c-133f6df7c331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1911f45fd7174d0f8af5e958b1ffa632'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:14.667648 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1b34f4e7-24c1-4da9-be7c-133f6df7c331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1911f45fd7174d0f8af5e958b1ffa632'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:14.676612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1b34f4e7-24c1-4da9-be7c-133f6df7c331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1911f45fd7174d0f8af5e958b1ffa632'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:14.677416 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1b34f4e7-24c1-4da9-be7c-133f6df7c331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1911f45fd7174d0f8af5e958b1ffa632'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:14.687403 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 984/1950] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:14 2022] DELETE /identity/v3/users/1911f45fd7174d0f8af5e958b1ffa632 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:14.984483 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095157e6-9577-4649-bc92-c602401c9e79 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:14.986263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-095157e6-9577-4649-bc92-c602401c9e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:15.001208 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095157e6-9577-4649-bc92-c602401c9e79 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:15.061613 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b78cb-fe5f-4609-9ac7-cf002bf40c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:15.062401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b78cb-fe5f-4609-9ac7-cf002bf40c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:15.063316 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b78cb-fe5f-4609-9ac7-cf002bf40c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:15.063603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b78cb-fe5f-4609-9ac7-cf002bf40c72 admin admin] PATH_INFO: `/v3/projects/9136d6e372aa4d33b88d26e78f40af31` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:15.064834 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b78cb-fe5f-4609-9ac7-cf002bf40c72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9136d6e372aa4d33b88d26e78f40af31)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:15.066840 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b78cb-fe5f-4609-9ac7-cf002bf40c72 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:15.119618 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-be1b78cb-fe5f-4609-9ac7-cf002bf40c72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9136d6e372aa4d33b88d26e78f40af31', 'request_id': 'req-be1b78cb-fe5f-4609-9ac7-cf002bf40c72'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:15.128205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-be1b78cb-fe5f-4609-9ac7-cf002bf40c72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9136d6e372aa4d33b88d26e78f40af31', 'request_id': 'req-be1b78cb-fe5f-4609-9ac7-cf002bf40c72'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:15.136460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-be1b78cb-fe5f-4609-9ac7-cf002bf40c72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9136d6e372aa4d33b88d26e78f40af31', 'request_id': 'req-be1b78cb-fe5f-4609-9ac7-cf002bf40c72'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:15.139928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:15.152125 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-be1b78cb-fe5f-4609-9ac7-cf002bf40c72 admin admin] The token cache is being invalidate because project 9136d6e372aa4d33b88d26e78f40af31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:15.152436 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-be1b78cb-fe5f-4609-9ac7-cf002bf40c72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:15.153202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-be1b78cb-fe5f-4609-9ac7-cf002bf40c72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:15.155120 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 967/1951] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:14 2022] DELETE /identity/v3/projects/9136d6e372aa4d33b88d26e78f40af31 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:15.161048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799573d7-4e84-41c2-a78a-1cfb018ad3de None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:15.161338 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799573d7-4e84-41c2-a78a-1cfb018ad3de None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:15.161612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799573d7-4e84-41c2-a78a-1cfb018ad3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:15.163835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b78cb-fe5f-4609-9ac7-cf002bf40c72 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:15.165148 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-be1b78cb-fe5f-4609-9ac7-cf002bf40c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:15.183816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-799573d7-4e84-41c2-a78a-1cfb018ad3de None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:15.185110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-799573d7-4e84-41c2-a78a-1cfb018ad3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:15.224651 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b78cb-fe5f-4609-9ac7-cf002bf40c72 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:15.229054 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2768a-2098-4bf8-9470-a8a3a0febed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:15.229800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2768a-2098-4bf8-9470-a8a3a0febed3 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:15.230083 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2768a-2098-4bf8-9470-a8a3a0febed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:15.230441 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2768a-2098-4bf8-9470-a8a3a0febed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:15.232726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b4b2768a-2098-4bf8-9470-a8a3a0febed3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:15.250918 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 985/1952] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:15.261925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc198caa-e485-47bc-ac65-a734a8a05dfe None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:15.262232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc198caa-e485-47bc-ac65-a734a8a05dfe None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:15.262516 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc198caa-e485-47bc-ac65-a734a8a05dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:15.291501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fc198caa-e485-47bc-ac65-a734a8a05dfe None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:15.293100 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fc198caa-e485-47bc-ac65-a734a8a05dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:15.309865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 986/1953] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:15.314243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc198caa-e485-47bc-ac65-a734a8a05dfe None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:15.325625 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc198caa-e485-47bc-ac65-a734a8a05dfe None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:15.332097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2768a-2098-4bf8-9470-a8a3a0febed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:15.332412 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccb074-65b9-4cb8-b323-26501d03cb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:15.333106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccb074-65b9-4cb8-b323-26501d03cb17 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:15.333638 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2768a-2098-4bf8-9470-a8a3a0febed3 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:15.335070 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccb074-65b9-4cb8-b323-26501d03cb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:15.335373 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccb074-65b9-4cb8-b323-26501d03cb17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:15.336154 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccb074-65b9-4cb8-b323-26501d03cb17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:32:15.338975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccb074-65b9-4cb8-b323-26501d03cb17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:15.340600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccb074-65b9-4cb8-b323-26501d03cb17 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:15.345110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 968/1954] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:15.370471 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 987/1955] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:32:15.370943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2768a-2098-4bf8-9470-a8a3a0febed3 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:15.392208 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2768a-2098-4bf8-9470-a8a3a0febed3 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:15.399372 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d1b8c-a33d-4185-a732-e7427911a257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:15.400126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d1b8c-a33d-4185-a732-e7427911a257 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:15.400878 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d1b8c-a33d-4185-a732-e7427911a257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:15.401226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d1b8c-a33d-4185-a732-e7427911a257 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:15.402215 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d1b8c-a33d-4185-a732-e7427911a257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:15.404344 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d1b8c-a33d-4185-a732-e7427911a257 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:15.445092 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 969/1956] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:15 2022] POST /identity/v3/projects => generated 365 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:32:15.449347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccb074-65b9-4cb8-b323-26501d03cb17 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:15.461082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccb074-65b9-4cb8-b323-26501d03cb17 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:15.538594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:15.569365 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d412dd-b8f4-4c0a-900b-c663936122e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:15.570137 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d412dd-b8f4-4c0a-900b-c663936122e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:15.570427 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d412dd-b8f4-4c0a-900b-c663936122e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:15.570704 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d412dd-b8f4-4c0a-900b-c663936122e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:15.571482 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d412dd-b8f4-4c0a-900b-c663936122e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:15.573820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d412dd-b8f4-4c0a-900b-c663936122e7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:15.599402 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 988/1957] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:15 2022] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:15.603585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d1b8c-a33d-4185-a732-e7427911a257 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:15.620807 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d1b8c-a33d-4185-a732-e7427911a257 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:15.626095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8755ed2-c77b-4cc9-a840-87bf5f016a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:15.626896 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8755ed2-c77b-4cc9-a840-87bf5f016a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:15.627180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8755ed2-c77b-4cc9-a840-87bf5f016a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:15.627482 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8755ed2-c77b-4cc9-a840-87bf5f016a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:15.628227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8755ed2-c77b-4cc9-a840-87bf5f016a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:15.629877 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8755ed2-c77b-4cc9-a840-87bf5f016a1a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:15.645971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 970/1958] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:15.647262 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d412dd-b8f4-4c0a-900b-c663936122e7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:15.658212 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d412dd-b8f4-4c0a-900b-c663936122e7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:15.664308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c404c70-539e-42e2-95b4-5ef66d101b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:15.665006 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c404c70-539e-42e2-95b4-5ef66d101b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:15.665289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c404c70-539e-42e2-95b4-5ef66d101b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:15.665567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c404c70-539e-42e2-95b4-5ef66d101b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:15.666309 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c404c70-539e-42e2-95b4-5ef66d101b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:15.667989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c404c70-539e-42e2-95b4-5ef66d101b93 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:15.684703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 989/1959] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:15.686204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8755ed2-c77b-4cc9-a840-87bf5f016a1a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:15.696961 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8755ed2-c77b-4cc9-a840-87bf5f016a1a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:15.701823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0591e86-c161-4772-8755-467a03fe270b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:15.703547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0591e86-c161-4772-8755-467a03fe270b admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:15.703547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0591e86-c161-4772-8755-467a03fe270b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:15.703807 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0591e86-c161-4772-8755-467a03fe270b admin admin] PATH_INFO: `/v3/projects/0a0e168026d64624a18ee3a3c863402f/users/c2514424d0684afa8985e5d67298abb3/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:15.722664 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0591e86-c161-4772-8755-467a03fe270b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0e168026d64624a18ee3a3c863402f, user_id=c2514424d0684afa8985e5d67298abb3, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:15.725355 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0591e86-c161-4772-8755-467a03fe270b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:15.739801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 971/1960] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:15 2022] PUT /identity/v3/projects/0a0e168026d64624a18ee3a3c863402f/users/c2514424d0684afa8985e5d67298abb3/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:15.750069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b72429-7126-4fc4-8ea9-e796c2dd9b77 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:15.750364 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b72429-7126-4fc4-8ea9-e796c2dd9b77 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:15.750646 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b72429-7126-4fc4-8ea9-e796c2dd9b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:15.783011 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-68b72429-7126-4fc4-8ea9-e796c2dd9b77 None None] MFA Rules not processed for user `c2514424d0684afa8985e5d67298abb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:15.784369 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-68b72429-7126-4fc4-8ea9-e796c2dd9b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:15.866894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 990/1961] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:15.871035 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0591e86-c161-4772-8755-467a03fe270b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:15.966718 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:15.983024 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0591e86-c161-4772-8755-467a03fe270b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:15.987959 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a5ffd-d5cc-4d82-817d-b487351710d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:15.988630 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a5ffd-d5cc-4d82-817d-b487351710d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:15.988916 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a5ffd-d5cc-4d82-817d-b487351710d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:15.989188 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a5ffd-d5cc-4d82-817d-b487351710d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:15.989893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a5ffd-d5cc-4d82-817d-b487351710d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:15.991827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a5ffd-d5cc-4d82-817d-b487351710d4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:16.035482 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 972/1962] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:15 2022] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:32:16.039573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b72429-7126-4fc4-8ea9-e796c2dd9b77 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:16.051364 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b72429-7126-4fc4-8ea9-e796c2dd9b77 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:16.113864 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e4979-456d-42d7-82a4-41076afff879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:16.114542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e4979-456d-42d7-82a4-41076afff879 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:16.114866 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e4979-456d-42d7-82a4-41076afff879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:16.115131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e4979-456d-42d7-82a4-41076afff879 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:16.115827 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e4979-456d-42d7-82a4-41076afff879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:16.117733 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e4979-456d-42d7-82a4-41076afff879 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:16.148356 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 991/1963] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:16 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:16.149645 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a5ffd-d5cc-4d82-817d-b487351710d4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:16.161125 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a5ffd-d5cc-4d82-817d-b487351710d4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:16.166048 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db3511-6db0-4e96-ae97-175ff0bd45b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:16.167084 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db3511-6db0-4e96-ae97-175ff0bd45b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:16.167346 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db3511-6db0-4e96-ae97-175ff0bd45b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:16.167687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db3511-6db0-4e96-ae97-175ff0bd45b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:16.168494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db3511-6db0-4e96-ae97-175ff0bd45b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:16.170144 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db3511-6db0-4e96-ae97-175ff0bd45b8 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:16.182727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 973/1964] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:16.187101 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e4979-456d-42d7-82a4-41076afff879 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:16.201162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e4979-456d-42d7-82a4-41076afff879 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:16.205949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5c37f-6cd5-448d-8b6e-e03c93085cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:16.206880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5c37f-6cd5-448d-8b6e-e03c93085cda admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:16.207162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5c37f-6cd5-448d-8b6e-e03c93085cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:16.207563 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5c37f-6cd5-448d-8b6e-e03c93085cda admin admin] PATH_INFO: `/v3/projects/da738903034146328eb51384040c6b86/users/36e8e2033de54dc6a5f422197455a6a0/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:16.223176 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5c37f-6cd5-448d-8b6e-e03c93085cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=da738903034146328eb51384040c6b86, user_id=36e8e2033de54dc6a5f422197455a6a0, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:16.225811 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5c37f-6cd5-448d-8b6e-e03c93085cda admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:16.239559 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 992/1965] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:16 2022] PUT /identity/v3/projects/da738903034146328eb51384040c6b86/users/36e8e2033de54dc6a5f422197455a6a0/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:16.243759 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db3511-6db0-4e96-ae97-175ff0bd45b8 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:16.257033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db3511-6db0-4e96-ae97-175ff0bd45b8 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:16.318946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13db8f3-8d92-4882-a039-428f65197a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:16.319646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13db8f3-8d92-4882-a039-428f65197a77 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:16.319924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13db8f3-8d92-4882-a039-428f65197a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:16.320245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13db8f3-8d92-4882-a039-428f65197a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:16.320962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13db8f3-8d92-4882-a039-428f65197a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:16.323127 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13db8f3-8d92-4882-a039-428f65197a77 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:16.333902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 974/1966] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:16.338160 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5c37f-6cd5-448d-8b6e-e03c93085cda admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:16.349697 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5c37f-6cd5-448d-8b6e-e03c93085cda admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:16.354284 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dd1e7-6134-4877-a104-c1ff2ab4281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:16.355218 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dd1e7-6134-4877-a104-c1ff2ab4281f admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:16.355527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dd1e7-6134-4877-a104-c1ff2ab4281f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:16.355797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dd1e7-6134-4877-a104-c1ff2ab4281f admin admin] PATH_INFO: `/v3/projects/da738903034146328eb51384040c6b86/users/36e8e2033de54dc6a5f422197455a6a0/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:16.357865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dd1e7-6134-4877-a104-c1ff2ab4281f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da738903034146328eb51384040c6b86, user_id=36e8e2033de54dc6a5f422197455a6a0, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:16.360593 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dd1e7-6134-4877-a104-c1ff2ab4281f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:16.372384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 993/1967] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:16 2022] PUT /identity/v3/projects/da738903034146328eb51384040c6b86/users/36e8e2033de54dc6a5f422197455a6a0/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:16.383738 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aa8e8-5837-4361-880d-4cbb1876f82f None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:16.384211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aa8e8-5837-4361-880d-4cbb1876f82f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:16.384323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aa8e8-5837-4361-880d-4cbb1876f82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:16.411290 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-913aa8e8-5837-4361-880d-4cbb1876f82f None None] MFA Rules not processed for user `36e8e2033de54dc6a5f422197455a6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:16.412510 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-913aa8e8-5837-4361-880d-4cbb1876f82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:16.488181 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 975/1968] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:16 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:16.499278 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dd1e7-6134-4877-a104-c1ff2ab4281f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:16.500955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a09dd1e7-6134-4877-a104-c1ff2ab4281f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:16.517142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:16.564002 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dd1e7-6134-4877-a104-c1ff2ab4281f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:16.568419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa1bc6-8988-4f90-ae10-41014468e398 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:16.569070 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa1bc6-8988-4f90-ae10-41014468e398 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:16.569347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa1bc6-8988-4f90-ae10-41014468e398 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:16.569617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa1bc6-8988-4f90-ae10-41014468e398 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:16.582521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa1bc6-8988-4f90-ae10-41014468e398 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:16.584170 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa1bc6-8988-4f90-ae10-41014468e398 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:16.594772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 994/1969] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:16 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:16.705291 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aa8e8-5837-4361-880d-4cbb1876f82f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:16.718664 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aa8e8-5837-4361-880d-4cbb1876f82f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:16.729329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d4993-155c-4005-80dc-ed049c5d41fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:16.730012 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d4993-155c-4005-80dc-ed049c5d41fa service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:16.730400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d4993-155c-4005-80dc-ed049c5d41fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:16.730593 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d4993-155c-4005-80dc-ed049c5d41fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:16.781105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:16.803656 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d4993-155c-4005-80dc-ed049c5d41fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:16.805142 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d4993-155c-4005-80dc-ed049c5d41fa service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:16.819769 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 976/1970] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:24.126331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa1bc6-8988-4f90-ae10-41014468e398 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:24.225084 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa1bc6-8988-4f90-ae10-41014468e398 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:24.231585 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28126469-cf89-4a3f-96cc-2d8819ebc5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:24.232519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28126469-cf89-4a3f-96cc-2d8819ebc5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:24.232801 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28126469-cf89-4a3f-96cc-2d8819ebc5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:24.233078 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28126469-cf89-4a3f-96cc-2d8819ebc5f7 admin admin] PATH_INFO: `/v3/users/c2514424d0684afa8985e5d67298abb3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:24.235331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28126469-cf89-4a3f-96cc-2d8819ebc5f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2514424d0684afa8985e5d67298abb3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:24.239286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28126469-cf89-4a3f-96cc-2d8819ebc5f7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:24.301309 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-28126469-cf89-4a3f-96cc-2d8819ebc5f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2514424d0684afa8985e5d67298abb3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:24.309840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-28126469-cf89-4a3f-96cc-2d8819ebc5f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2514424d0684afa8985e5d67298abb3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:24.344054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-28126469-cf89-4a3f-96cc-2d8819ebc5f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2514424d0684afa8985e5d67298abb3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:24.355358 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-28126469-cf89-4a3f-96cc-2d8819ebc5f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2514424d0684afa8985e5d67298abb3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:24.356129 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-28126469-cf89-4a3f-96cc-2d8819ebc5f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2514424d0684afa8985e5d67298abb3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:24.367111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 995/1971] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:24 2022] DELETE /identity/v3/users/c2514424d0684afa8985e5d67298abb3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:24.369503 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7259a1-d35c-4172-8689-cd3107be8db4 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:24.370017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7259a1-d35c-4172-8689-cd3107be8db4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:24.370312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7259a1-d35c-4172-8689-cd3107be8db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:24.389720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4a7259a1-d35c-4172-8689-cd3107be8db4 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:24.391065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4a7259a1-d35c-4172-8689-cd3107be8db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:24.546861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 977/1972] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:24.558415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28126469-cf89-4a3f-96cc-2d8819ebc5f7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:24.559924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-28126469-cf89-4a3f-96cc-2d8819ebc5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:24.603652 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:24.623157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28126469-cf89-4a3f-96cc-2d8819ebc5f7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:24.626780 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe0bd1-146e-4568-b158-d0d1d7afb4e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:24.628033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe0bd1-146e-4568-b158-d0d1d7afb4e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:24.628309 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe0bd1-146e-4568-b158-d0d1d7afb4e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:24.628716 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe0bd1-146e-4568-b158-d0d1d7afb4e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:24.638798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe0bd1-146e-4568-b158-d0d1d7afb4e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:24.640248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe0bd1-146e-4568-b158-d0d1d7afb4e4 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:24.651392 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 996/1973] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:24.965395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7259a1-d35c-4172-8689-cd3107be8db4 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:24.966937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4a7259a1-d35c-4172-8689-cd3107be8db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:24.980150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7259a1-d35c-4172-8689-cd3107be8db4 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:24.984925 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d1337-fc47-40fb-bcf5-44600bbddf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:24.985795 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d1337-fc47-40fb-bcf5-44600bbddf16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:24.986074 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d1337-fc47-40fb-bcf5-44600bbddf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:24.986346 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d1337-fc47-40fb-bcf5-44600bbddf16 admin admin] PATH_INFO: `/v3/projects/0a0e168026d64624a18ee3a3c863402f` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:24.988145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d1337-fc47-40fb-bcf5-44600bbddf16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a0e168026d64624a18ee3a3c863402f)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:24.990062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d1337-fc47-40fb-bcf5-44600bbddf16 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:25.042239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4b5d1337-fc47-40fb-bcf5-44600bbddf16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0e168026d64624a18ee3a3c863402f', 'request_id': 'req-4b5d1337-fc47-40fb-bcf5-44600bbddf16'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:25.059853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4b5d1337-fc47-40fb-bcf5-44600bbddf16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0e168026d64624a18ee3a3c863402f', 'request_id': 'req-4b5d1337-fc47-40fb-bcf5-44600bbddf16'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:25.071404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4b5d1337-fc47-40fb-bcf5-44600bbddf16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0e168026d64624a18ee3a3c863402f', 'request_id': 'req-4b5d1337-fc47-40fb-bcf5-44600bbddf16'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:25.099979 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4b5d1337-fc47-40fb-bcf5-44600bbddf16 admin admin] The token cache is being invalidate because project 0a0e168026d64624a18ee3a3c863402f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:25.100533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4b5d1337-fc47-40fb-bcf5-44600bbddf16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:25.101443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4b5d1337-fc47-40fb-bcf5-44600bbddf16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:25.103665 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 978/1974] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:24 2022] DELETE /identity/v3/projects/0a0e168026d64624a18ee3a3c863402f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:25.107439 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe0bd1-146e-4568-b158-d0d1d7afb4e4 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:25.119228 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe0bd1-146e-4568-b158-d0d1d7afb4e4 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:25.187985 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357d2b0-9e40-49c6-b1d8-6fffa808b859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:25.191057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357d2b0-9e40-49c6-b1d8-6fffa808b859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:25.191637 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357d2b0-9e40-49c6-b1d8-6fffa808b859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:25.192824 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357d2b0-9e40-49c6-b1d8-6fffa808b859 admin admin] PATH_INFO: `/v3/users/36e8e2033de54dc6a5f422197455a6a0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:25.194689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357d2b0-9e40-49c6-b1d8-6fffa808b859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e8e2033de54dc6a5f422197455a6a0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:25.197927 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357d2b0-9e40-49c6-b1d8-6fffa808b859 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:25.296938 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2357d2b0-9e40-49c6-b1d8-6fffa808b859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e8e2033de54dc6a5f422197455a6a0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:25.314498 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2357d2b0-9e40-49c6-b1d8-6fffa808b859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e8e2033de54dc6a5f422197455a6a0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:25.329758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2357d2b0-9e40-49c6-b1d8-6fffa808b859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e8e2033de54dc6a5f422197455a6a0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:25.342449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2357d2b0-9e40-49c6-b1d8-6fffa808b859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e8e2033de54dc6a5f422197455a6a0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:25.344613 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2357d2b0-9e40-49c6-b1d8-6fffa808b859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e8e2033de54dc6a5f422197455a6a0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:25.367964 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 997/1975] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:25 2022] DELETE /identity/v3/users/36e8e2033de54dc6a5f422197455a6a0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:25.915091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d1337-fc47-40fb-bcf5-44600bbddf16 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:25.916674 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4b5d1337-fc47-40fb-bcf5-44600bbddf16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:25.932237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d1337-fc47-40fb-bcf5-44600bbddf16 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:26.000667 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6cd5c-3dbd-4dfb-9aa7-3129931b897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:26.001600 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6cd5c-3dbd-4dfb-9aa7-3129931b897c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:26.001857 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6cd5c-3dbd-4dfb-9aa7-3129931b897c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:26.002209 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6cd5c-3dbd-4dfb-9aa7-3129931b897c admin admin] PATH_INFO: `/v3/projects/da738903034146328eb51384040c6b86` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:26.004051 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6cd5c-3dbd-4dfb-9aa7-3129931b897c admin admin] RBAC: Authorizing `identity:delete_project(project_id=da738903034146328eb51384040c6b86)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:26.005965 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6cd5c-3dbd-4dfb-9aa7-3129931b897c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:26.014892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:26.057090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4cf6cd5c-3dbd-4dfb-9aa7-3129931b897c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da738903034146328eb51384040c6b86', 'request_id': 'req-4cf6cd5c-3dbd-4dfb-9aa7-3129931b897c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:26.066499 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4cf6cd5c-3dbd-4dfb-9aa7-3129931b897c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da738903034146328eb51384040c6b86', 'request_id': 'req-4cf6cd5c-3dbd-4dfb-9aa7-3129931b897c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:26.074603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4cf6cd5c-3dbd-4dfb-9aa7-3129931b897c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da738903034146328eb51384040c6b86', 'request_id': 'req-4cf6cd5c-3dbd-4dfb-9aa7-3129931b897c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:26.087058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4cf6cd5c-3dbd-4dfb-9aa7-3129931b897c admin admin] The token cache is being invalidate because project da738903034146328eb51384040c6b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:26.087419 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4cf6cd5c-3dbd-4dfb-9aa7-3129931b897c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:26.088165 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4cf6cd5c-3dbd-4dfb-9aa7-3129931b897c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:26.090009 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 979/1976] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:25 2022] DELETE /identity/v3/projects/da738903034146328eb51384040c6b86 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:26.095041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c19a9e-7f95-4c10-a4a3-c3ec04e182a9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:26.095470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c19a9e-7f95-4c10-a4a3-c3ec04e182a9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:26.095882 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c19a9e-7f95-4c10-a4a3-c3ec04e182a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:26.115580 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-55c19a9e-7f95-4c10-a4a3-c3ec04e182a9 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:26.117237 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-55c19a9e-7f95-4c10-a4a3-c3ec04e182a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:26.184101 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:26.202908 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 998/1977] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:26.205592 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a7cdd-5d3f-4dee-b8d3-276a4629e3be None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:26.205965 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a7cdd-5d3f-4dee-b8d3-276a4629e3be None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:26.206290 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a7cdd-5d3f-4dee-b8d3-276a4629e3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:26.233247 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e12a7cdd-5d3f-4dee-b8d3-276a4629e3be None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:26.234511 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e12a7cdd-5d3f-4dee-b8d3-276a4629e3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:26.243621 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 980/1978] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:26.247935 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c19a9e-7f95-4c10-a4a3-c3ec04e182a9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:26.259165 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c19a9e-7f95-4c10-a4a3-c3ec04e182a9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:26.263965 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126232dd-1ecb-4186-8ea2-ab6a483e759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:26.264776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126232dd-1ecb-4186-8ea2-ab6a483e759e admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:26.267054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126232dd-1ecb-4186-8ea2-ab6a483e759e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:26.267054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126232dd-1ecb-4186-8ea2-ab6a483e759e admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:26.267054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126232dd-1ecb-4186-8ea2-ab6a483e759e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:32:26.267054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126232dd-1ecb-4186-8ea2-ab6a483e759e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:26.269007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126232dd-1ecb-4186-8ea2-ab6a483e759e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:26.284782 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 999/1979] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:32:26.289178 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a7cdd-5d3f-4dee-b8d3-276a4629e3be None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:26.301188 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a7cdd-5d3f-4dee-b8d3-276a4629e3be None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:26.306216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f438c58-bd77-49db-a66f-256ecf354ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:26.306922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f438c58-bd77-49db-a66f-256ecf354ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:26.307208 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f438c58-bd77-49db-a66f-256ecf354ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:26.307485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f438c58-bd77-49db-a66f-256ecf354ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:26.308219 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f438c58-bd77-49db-a66f-256ecf354ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:26.310135 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f438c58-bd77-49db-a66f-256ecf354ce0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:26.340183 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 981/1980] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:26 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:26.344801 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126232dd-1ecb-4186-8ea2-ab6a483e759e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:26.356697 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126232dd-1ecb-4186-8ea2-ab6a483e759e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:26.431971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d924016-9bee-46dd-bda4-95addee39bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:26.432671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d924016-9bee-46dd-bda4-95addee39bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:26.432913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d924016-9bee-46dd-bda4-95addee39bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:26.433183 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d924016-9bee-46dd-bda4-95addee39bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:26.433922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d924016-9bee-46dd-bda4-95addee39bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:26.435884 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d924016-9bee-46dd-bda4-95addee39bc5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:26.458493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1000/1981] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:26 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:26.462530 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f438c58-bd77-49db-a66f-256ecf354ce0 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:26.477536 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f438c58-bd77-49db-a66f-256ecf354ce0 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:26.482172 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e241e-82c6-4068-a63e-f17616e8c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:26.482901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e241e-82c6-4068-a63e-f17616e8c318 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:26.483182 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e241e-82c6-4068-a63e-f17616e8c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:26.483454 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e241e-82c6-4068-a63e-f17616e8c318 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:26.484175 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e241e-82c6-4068-a63e-f17616e8c318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:26.485747 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e241e-82c6-4068-a63e-f17616e8c318 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:26.499675 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 982/1982] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:32:26.504729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d924016-9bee-46dd-bda4-95addee39bc5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:26.515161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d924016-9bee-46dd-bda4-95addee39bc5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:26.521504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a412b-142d-43b7-ad3a-8b12247ea0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:26.522168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a412b-142d-43b7-ad3a-8b12247ea0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:26.522446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a412b-142d-43b7-ad3a-8b12247ea0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:26.522888 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a412b-142d-43b7-ad3a-8b12247ea0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:26.523847 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a412b-142d-43b7-ad3a-8b12247ea0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:26.525534 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a412b-142d-43b7-ad3a-8b12247ea0d0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:26.536043 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1001/1983] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:32:26.540249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e241e-82c6-4068-a63e-f17616e8c318 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:26.551606 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e241e-82c6-4068-a63e-f17616e8c318 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:26.556503 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b6cca-1811-4f84-9120-959567cc3e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:26.557380 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b6cca-1811-4f84-9120-959567cc3e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:26.557687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b6cca-1811-4f84-9120-959567cc3e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:26.557965 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b6cca-1811-4f84-9120-959567cc3e98 admin admin] PATH_INFO: `/v3/projects/6969ece6b8e6448e8aea6fae11dec75d/users/4fa671af421847bd856596f05af7cb83/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:26.588273 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b6cca-1811-4f84-9120-959567cc3e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6969ece6b8e6448e8aea6fae11dec75d, user_id=4fa671af421847bd856596f05af7cb83, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:26.591506 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b6cca-1811-4f84-9120-959567cc3e98 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:26.608636 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 983/1984] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:26 2022] PUT /identity/v3/projects/6969ece6b8e6448e8aea6fae11dec75d/users/4fa671af421847bd856596f05af7cb83/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:26.622509 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a20cd-830c-4f84-b926-6d901da2dc90 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:26.622847 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a20cd-830c-4f84-b926-6d901da2dc90 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:26.623270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a20cd-830c-4f84-b926-6d901da2dc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:26.655020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e33a20cd-830c-4f84-b926-6d901da2dc90 None None] MFA Rules not processed for user `4fa671af421847bd856596f05af7cb83`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:26.656506 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e33a20cd-830c-4f84-b926-6d901da2dc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:26.766136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1002/1985] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:26.784325 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b6cca-1811-4f84-9120-959567cc3e98 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:26.787434 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-da6b6cca-1811-4f84-9120-959567cc3e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:26.862860 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b6cca-1811-4f84-9120-959567cc3e98 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:26.866485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3563505-e198-4671-a582-790ab317baa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:26.867180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3563505-e198-4671-a582-790ab317baa0 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:26.867458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3563505-e198-4671-a582-790ab317baa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:26.867733 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3563505-e198-4671-a582-790ab317baa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:26.876207 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3563505-e198-4671-a582-790ab317baa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:26.877696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3563505-e198-4671-a582-790ab317baa0 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:26.887163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 984/1986] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:32:26.911098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a20cd-830c-4f84-b926-6d901da2dc90 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:26.993709 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:27.007830 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a20cd-830c-4f84-b926-6d901da2dc90 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:27.016202 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2e869-6f2d-4e49-a22e-a9009e1c0f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:27.017293 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2e869-6f2d-4e49-a22e-a9009e1c0f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:27.017470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2e869-6f2d-4e49-a22e-a9009e1c0f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:27.018025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2e869-6f2d-4e49-a22e-a9009e1c0f57 admin admin] PATH_INFO: `/v3/users/4fa671af421847bd856596f05af7cb83` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:27.020414 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2e869-6f2d-4e49-a22e-a9009e1c0f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa671af421847bd856596f05af7cb83)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:27.023145 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2e869-6f2d-4e49-a22e-a9009e1c0f57 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:27.074169 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1ba2e869-6f2d-4e49-a22e-a9009e1c0f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa671af421847bd856596f05af7cb83'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:27.083627 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1ba2e869-6f2d-4e49-a22e-a9009e1c0f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa671af421847bd856596f05af7cb83'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:27.101448 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1ba2e869-6f2d-4e49-a22e-a9009e1c0f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa671af421847bd856596f05af7cb83'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:27.109976 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1ba2e869-6f2d-4e49-a22e-a9009e1c0f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa671af421847bd856596f05af7cb83'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:27.110752 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1ba2e869-6f2d-4e49-a22e-a9009e1c0f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa671af421847bd856596f05af7cb83'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:27.118151 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1003/1987] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:26 2022] DELETE /identity/v3/users/4fa671af421847bd856596f05af7cb83 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:27.122823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13e130-2d72-4270-a4ed-eb8c637fb76e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:27.123273 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13e130-2d72-4270-a4ed-eb8c637fb76e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:27.123508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13e130-2d72-4270-a4ed-eb8c637fb76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:27.141147 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7f13e130-2d72-4270-a4ed-eb8c637fb76e None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:27.142390 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7f13e130-2d72-4270-a4ed-eb8c637fb76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:27.183852 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:27.224719 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 985/1988] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:27.235323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2e869-6f2d-4e49-a22e-a9009e1c0f57 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:27.238223 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1ba2e869-6f2d-4e49-a22e-a9009e1c0f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:27.297297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13e130-2d72-4270-a4ed-eb8c637fb76e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:27.298902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7f13e130-2d72-4270-a4ed-eb8c637fb76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:27.306150 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2e869-6f2d-4e49-a22e-a9009e1c0f57 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:27.311041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f28642-385b-4b14-8770-01a1f52cd150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:27.312143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f28642-385b-4b14-8770-01a1f52cd150 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:27.312431 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f28642-385b-4b14-8770-01a1f52cd150 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:27.312999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f28642-385b-4b14-8770-01a1f52cd150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:27.325411 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f28642-385b-4b14-8770-01a1f52cd150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:27.326595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f28642-385b-4b14-8770-01a1f52cd150 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:27.340733 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1004/1989] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:27.367426 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13e130-2d72-4270-a4ed-eb8c637fb76e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:27.372505 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8593e-2488-40fb-94c3-bf5bf9624967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:27.373176 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8593e-2488-40fb-94c3-bf5bf9624967 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:27.373461 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8593e-2488-40fb-94c3-bf5bf9624967 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:27.373886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8593e-2488-40fb-94c3-bf5bf9624967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:27.377734 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2be8593e-2488-40fb-94c3-bf5bf9624967 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:27.474761 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8593e-2488-40fb-94c3-bf5bf9624967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:27.474761 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8593e-2488-40fb-94c3-bf5bf9624967 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:27.501110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 986/1990] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:32:27.803910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f28642-385b-4b14-8770-01a1f52cd150 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:27.805778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-94f28642-385b-4b14-8770-01a1f52cd150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:27.829222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f28642-385b-4b14-8770-01a1f52cd150 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:27.850174 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d9ccc-866b-4f75-8f05-15da59e65c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:27.850174 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d9ccc-866b-4f75-8f05-15da59e65c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:27.850889 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d9ccc-866b-4f75-8f05-15da59e65c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:27.859959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d9ccc-866b-4f75-8f05-15da59e65c6e admin admin] PATH_INFO: `/v3/projects/6969ece6b8e6448e8aea6fae11dec75d` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:27.863032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d9ccc-866b-4f75-8f05-15da59e65c6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6969ece6b8e6448e8aea6fae11dec75d)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:27.865147 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d9ccc-866b-4f75-8f05-15da59e65c6e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:27.973903 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-288d9ccc-866b-4f75-8f05-15da59e65c6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6969ece6b8e6448e8aea6fae11dec75d', 'request_id': 'req-288d9ccc-866b-4f75-8f05-15da59e65c6e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:27.984405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-288d9ccc-866b-4f75-8f05-15da59e65c6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6969ece6b8e6448e8aea6fae11dec75d', 'request_id': 'req-288d9ccc-866b-4f75-8f05-15da59e65c6e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:27.996047 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-288d9ccc-866b-4f75-8f05-15da59e65c6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6969ece6b8e6448e8aea6fae11dec75d', 'request_id': 'req-288d9ccc-866b-4f75-8f05-15da59e65c6e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:28.008476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:28.020327 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-288d9ccc-866b-4f75-8f05-15da59e65c6e admin admin] The token cache is being invalidate because project 6969ece6b8e6448e8aea6fae11dec75d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:28.020327 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-288d9ccc-866b-4f75-8f05-15da59e65c6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:28.020327 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-288d9ccc-866b-4f75-8f05-15da59e65c6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:28.025335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1005/1991] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:27 2022] DELETE /identity/v3/projects/6969ece6b8e6448e8aea6fae11dec75d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:28.027208 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c6eac-817e-4dc6-a52e-d0a7e3042b0c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:28.028064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c6eac-817e-4dc6-a52e-d0a7e3042b0c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:28.028064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c6eac-817e-4dc6-a52e-d0a7e3042b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:28.057113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8d9c6eac-817e-4dc6-a52e-d0a7e3042b0c None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:28.058523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8d9c6eac-817e-4dc6-a52e-d0a7e3042b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:28.145012 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 987/1992] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:28.155357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdc2e2-e717-4dad-a2de-f10364ed0b67 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:28.156272 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdc2e2-e717-4dad-a2de-f10364ed0b67 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:28.156766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdc2e2-e717-4dad-a2de-f10364ed0b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:28.183084 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-83bdc2e2-e717-4dad-a2de-f10364ed0b67 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:28.184809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-83bdc2e2-e717-4dad-a2de-f10364ed0b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:28.201424 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1006/1993] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:28.206525 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c6eac-817e-4dc6-a52e-d0a7e3042b0c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:28.218524 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c6eac-817e-4dc6-a52e-d0a7e3042b0c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:28.228141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a0fe5-b8d3-4f95-812b-5d1b20969f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:28.229581 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a0fe5-b8d3-4f95-812b-5d1b20969f00 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:28.230048 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a0fe5-b8d3-4f95-812b-5d1b20969f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:28.230499 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a0fe5-b8d3-4f95-812b-5d1b20969f00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:28.231640 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a0fe5-b8d3-4f95-812b-5d1b20969f00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:32:28.232951 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a0fe5-b8d3-4f95-812b-5d1b20969f00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:28.235475 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a0fe5-b8d3-4f95-812b-5d1b20969f00 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:28.262571 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 988/1994] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:32:28.266022 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdc2e2-e717-4dad-a2de-f10364ed0b67 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:28.279781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdc2e2-e717-4dad-a2de-f10364ed0b67 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:28.285802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd2a47-57c7-452a-ac83-84aaf027e917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:28.286571 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd2a47-57c7-452a-ac83-84aaf027e917 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:28.286892 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd2a47-57c7-452a-ac83-84aaf027e917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:28.287185 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd2a47-57c7-452a-ac83-84aaf027e917 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:28.288153 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd2a47-57c7-452a-ac83-84aaf027e917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:28.291687 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd2a47-57c7-452a-ac83-84aaf027e917 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:28.335851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1007/1995] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:28 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:28.344863 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a0fe5-b8d3-4f95-812b-5d1b20969f00 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:28.355315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a0fe5-b8d3-4f95-812b-5d1b20969f00 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:28.367773 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:28.424768 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80532e-3a80-4935-ba56-8d76e354608a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:28.425948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80532e-3a80-4935-ba56-8d76e354608a admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:28.426161 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80532e-3a80-4935-ba56-8d76e354608a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:28.426785 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80532e-3a80-4935-ba56-8d76e354608a admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:28.427384 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80532e-3a80-4935-ba56-8d76e354608a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:28.432955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80532e-3a80-4935-ba56-8d76e354608a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:28.457910 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 989/1996] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:28 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:28.462528 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd2a47-57c7-452a-ac83-84aaf027e917 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:28.474899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd2a47-57c7-452a-ac83-84aaf027e917 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:28.481955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31f99e-af30-4607-b039-afec26c5a484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:28.482913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31f99e-af30-4607-b039-afec26c5a484 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:28.483266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31f99e-af30-4607-b039-afec26c5a484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:28.483658 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31f99e-af30-4607-b039-afec26c5a484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:28.484473 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31f99e-af30-4607-b039-afec26c5a484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:28.487791 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31f99e-af30-4607-b039-afec26c5a484 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:28.506999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1008/1997] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:28.508742 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80532e-3a80-4935-ba56-8d76e354608a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:28.535560 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80532e-3a80-4935-ba56-8d76e354608a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:28.541078 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f465135-7472-4ef3-8a61-dc04ab01c395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:28.542214 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f465135-7472-4ef3-8a61-dc04ab01c395 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:28.542567 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f465135-7472-4ef3-8a61-dc04ab01c395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:28.542952 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f465135-7472-4ef3-8a61-dc04ab01c395 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:28.543803 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f465135-7472-4ef3-8a61-dc04ab01c395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:28.545513 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f465135-7472-4ef3-8a61-dc04ab01c395 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:28.559437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 990/1998] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:28.563641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31f99e-af30-4607-b039-afec26c5a484 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:28.579156 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31f99e-af30-4607-b039-afec26c5a484 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:28.586545 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d414c4-52e6-487b-84fb-74e4a2898350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:28.587478 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d414c4-52e6-487b-84fb-74e4a2898350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:28.587777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d414c4-52e6-487b-84fb-74e4a2898350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:28.588018 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d414c4-52e6-487b-84fb-74e4a2898350 admin admin] PATH_INFO: `/v3/projects/19da57a8a33145fcb0b20acdcf24238e/users/d71508c8a076403ba24e74e1111ec14a/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:28.604394 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d414c4-52e6-487b-84fb-74e4a2898350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19da57a8a33145fcb0b20acdcf24238e, user_id=d71508c8a076403ba24e74e1111ec14a, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:28.607240 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d414c4-52e6-487b-84fb-74e4a2898350 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:28.625107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1009/1999] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:28 2022] PUT /identity/v3/projects/19da57a8a33145fcb0b20acdcf24238e/users/d71508c8a076403ba24e74e1111ec14a/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:28.635180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23326e00-f010-4f36-94a7-09d04902281a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:28.635411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23326e00-f010-4f36-94a7-09d04902281a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:28.635685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23326e00-f010-4f36-94a7-09d04902281a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:28.672637 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-23326e00-f010-4f36-94a7-09d04902281a None None] MFA Rules not processed for user `d71508c8a076403ba24e74e1111ec14a`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:28.674589 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-23326e00-f010-4f36-94a7-09d04902281a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:28.764013 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 991/2000] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:28.771787 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d414c4-52e6-487b-84fb-74e4a2898350 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:28.773559 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-00d414c4-52e6-487b-84fb-74e4a2898350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:28.779473 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23326e00-f010-4f36-94a7-09d04902281a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:28.781146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-23326e00-f010-4f36-94a7-09d04902281a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:28.862775 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23326e00-f010-4f36-94a7-09d04902281a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:28.863522 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d414c4-52e6-487b-84fb-74e4a2898350 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:28.868225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724c145-2bcc-4afd-a682-ab391073de47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:28.869055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724c145-2bcc-4afd-a682-ab391073de47 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:28.869344 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724c145-2bcc-4afd-a682-ab391073de47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:28.869618 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724c145-2bcc-4afd-a682-ab391073de47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:28.876129 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ed2f0-da4d-45ec-989c-46090f435640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:28.878293 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ed2f0-da4d-45ec-989c-46090f435640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:28.878750 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ed2f0-da4d-45ec-989c-46090f435640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:28.879046 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ed2f0-da4d-45ec-989c-46090f435640 admin admin] PATH_INFO: `/v3/users/96559cbdc16c45fab6b7a6d5a0b7f0ba` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:28.880597 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ed2f0-da4d-45ec-989c-46090f435640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96559cbdc16c45fab6b7a6d5a0b7f0ba)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:28.881372 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724c145-2bcc-4afd-a682-ab391073de47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:28.882560 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ed2f0-da4d-45ec-989c-46090f435640 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:28.882922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724c145-2bcc-4afd-a682-ab391073de47 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:28.897121 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 992/2001] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:32:28.957528 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d01ed2f0-da4d-45ec-989c-46090f435640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96559cbdc16c45fab6b7a6d5a0b7f0ba'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:28.967305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d01ed2f0-da4d-45ec-989c-46090f435640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96559cbdc16c45fab6b7a6d5a0b7f0ba'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:28.993933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d01ed2f0-da4d-45ec-989c-46090f435640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96559cbdc16c45fab6b7a6d5a0b7f0ba'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:29.005249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d01ed2f0-da4d-45ec-989c-46090f435640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96559cbdc16c45fab6b7a6d5a0b7f0ba'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:29.006353 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d01ed2f0-da4d-45ec-989c-46090f435640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96559cbdc16c45fab6b7a6d5a0b7f0ba'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:29.020206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1010/2002] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:28 2022] DELETE /identity/v3/users/96559cbdc16c45fab6b7a6d5a0b7f0ba => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:29.022288 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2553ab-1dff-43ae-88e2-f5484847e846 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:29.022599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2553ab-1dff-43ae-88e2-f5484847e846 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:29.022891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2553ab-1dff-43ae-88e2-f5484847e846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:29.043677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2b2553ab-1dff-43ae-88e2-f5484847e846 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:29.044932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2b2553ab-1dff-43ae-88e2-f5484847e846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:29.070095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:29.122780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 993/2003] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:29.135304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ed2f0-da4d-45ec-989c-46090f435640 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:29.136581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d01ed2f0-da4d-45ec-989c-46090f435640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:29.160337 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:29.236892 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ed2f0-da4d-45ec-989c-46090f435640 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:29.241009 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6fd5f-eeed-4245-b154-ee8d6f50352e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:29.241676 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6fd5f-eeed-4245-b154-ee8d6f50352e service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:29.241957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6fd5f-eeed-4245-b154-ee8d6f50352e service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:29.242232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6fd5f-eeed-4245-b154-ee8d6f50352e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:29.254137 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6fd5f-eeed-4245-b154-ee8d6f50352e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:29.255616 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6fd5f-eeed-4245-b154-ee8d6f50352e service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:29.269630 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1011/2004] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:29.692183 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2553ab-1dff-43ae-88e2-f5484847e846 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:29.694192 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2b2553ab-1dff-43ae-88e2-f5484847e846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:29.710969 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2553ab-1dff-43ae-88e2-f5484847e846 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:29.717971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9260d0f-016e-4b52-a3a1-4d8787c08d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:29.718995 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9260d0f-016e-4b52-a3a1-4d8787c08d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:29.719349 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9260d0f-016e-4b52-a3a1-4d8787c08d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:29.719681 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9260d0f-016e-4b52-a3a1-4d8787c08d92 admin admin] PATH_INFO: `/v3/projects/8fe1c6f069ea438494b97a819f072251` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:29.721317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9260d0f-016e-4b52-a3a1-4d8787c08d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe1c6f069ea438494b97a819f072251)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:29.724389 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9260d0f-016e-4b52-a3a1-4d8787c08d92 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:29.782764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e9260d0f-016e-4b52-a3a1-4d8787c08d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe1c6f069ea438494b97a819f072251', 'request_id': 'req-e9260d0f-016e-4b52-a3a1-4d8787c08d92'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:29.790096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e9260d0f-016e-4b52-a3a1-4d8787c08d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe1c6f069ea438494b97a819f072251', 'request_id': 'req-e9260d0f-016e-4b52-a3a1-4d8787c08d92'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:29.800593 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e9260d0f-016e-4b52-a3a1-4d8787c08d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe1c6f069ea438494b97a819f072251', 'request_id': 'req-e9260d0f-016e-4b52-a3a1-4d8787c08d92'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:29.813682 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e9260d0f-016e-4b52-a3a1-4d8787c08d92 admin admin] The token cache is being invalidate because project 8fe1c6f069ea438494b97a819f072251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:29.814255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e9260d0f-016e-4b52-a3a1-4d8787c08d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:29.816621 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e9260d0f-016e-4b52-a3a1-4d8787c08d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:29.818247 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 994/2005] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:29 2022] DELETE /identity/v3/projects/8fe1c6f069ea438494b97a819f072251 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:29.822194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6fd5f-eeed-4245-b154-ee8d6f50352e service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:29.832286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6fd5f-eeed-4245-b154-ee8d6f50352e service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:29.928713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2306a5-6e3c-41dc-a501-5fbee1bea809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:29.929899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2306a5-6e3c-41dc-a501-5fbee1bea809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:29.930311 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2306a5-6e3c-41dc-a501-5fbee1bea809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:29.930687 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2306a5-6e3c-41dc-a501-5fbee1bea809 admin admin] PATH_INFO: `/v3/users/81673028696443bba9009e437203fac3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:29.932128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2306a5-6e3c-41dc-a501-5fbee1bea809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81673028696443bba9009e437203fac3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:29.935051 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2306a5-6e3c-41dc-a501-5fbee1bea809 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:30.023400 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3c2306a5-6e3c-41dc-a501-5fbee1bea809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81673028696443bba9009e437203fac3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:30.034177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3c2306a5-6e3c-41dc-a501-5fbee1bea809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81673028696443bba9009e437203fac3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:30.070754 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3c2306a5-6e3c-41dc-a501-5fbee1bea809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81673028696443bba9009e437203fac3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:30.082141 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3c2306a5-6e3c-41dc-a501-5fbee1bea809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81673028696443bba9009e437203fac3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:30.082489 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3c2306a5-6e3c-41dc-a501-5fbee1bea809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81673028696443bba9009e437203fac3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:30.092283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1012/2006] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:29 2022] DELETE /identity/v3/users/81673028696443bba9009e437203fac3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:30.648824 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9260d0f-016e-4b52-a3a1-4d8787c08d92 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:30.650622 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e9260d0f-016e-4b52-a3a1-4d8787c08d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:30.666043 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9260d0f-016e-4b52-a3a1-4d8787c08d92 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:30.787139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf7918-41ba-4e40-bb60-307ab1f11a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:30.788677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf7918-41ba-4e40-bb60-307ab1f11a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:30.790433 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf7918-41ba-4e40-bb60-307ab1f11a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:30.790988 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf7918-41ba-4e40-bb60-307ab1f11a03 admin admin] PATH_INFO: `/v3/projects/aa18376ee3094dceae76db0214d39d44` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:30.792323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf7918-41ba-4e40-bb60-307ab1f11a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa18376ee3094dceae76db0214d39d44)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:30.794454 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf7918-41ba-4e40-bb60-307ab1f11a03 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:30.858979 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3abf7918-41ba-4e40-bb60-307ab1f11a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa18376ee3094dceae76db0214d39d44', 'request_id': 'req-3abf7918-41ba-4e40-bb60-307ab1f11a03'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:30.860764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:30.869644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3abf7918-41ba-4e40-bb60-307ab1f11a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa18376ee3094dceae76db0214d39d44', 'request_id': 'req-3abf7918-41ba-4e40-bb60-307ab1f11a03'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:30.879496 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3abf7918-41ba-4e40-bb60-307ab1f11a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa18376ee3094dceae76db0214d39d44', 'request_id': 'req-3abf7918-41ba-4e40-bb60-307ab1f11a03'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:30.898478 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3abf7918-41ba-4e40-bb60-307ab1f11a03 admin admin] The token cache is being invalidate because project aa18376ee3094dceae76db0214d39d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:30.898832 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3abf7918-41ba-4e40-bb60-307ab1f11a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:30.899615 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3abf7918-41ba-4e40-bb60-307ab1f11a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:30.901547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 995/2007] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:30 2022] DELETE /identity/v3/projects/aa18376ee3094dceae76db0214d39d44 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:30.906281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd4218-44b3-42ee-8157-3b90ef800ea7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:30.907219 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd4218-44b3-42ee-8157-3b90ef800ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:30.907918 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd4218-44b3-42ee-8157-3b90ef800ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:30.931950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f3fd4218-44b3-42ee-8157-3b90ef800ea7 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:30.933934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f3fd4218-44b3-42ee-8157-3b90ef800ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:30.996247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:31.076386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1013/2008] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:31.078651 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a83de0-78fb-4ed8-b60a-45f8dfdec8b3 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:31.078992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a83de0-78fb-4ed8-b60a-45f8dfdec8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:31.079312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a83de0-78fb-4ed8-b60a-45f8dfdec8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:31.127080 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a0a83de0-78fb-4ed8-b60a-45f8dfdec8b3 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:31.129614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a0a83de0-78fb-4ed8-b60a-45f8dfdec8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:31.147890 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 996/2009] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:31.152479 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd4218-44b3-42ee-8157-3b90ef800ea7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:31.171895 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd4218-44b3-42ee-8157-3b90ef800ea7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:31.193022 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d4ef0-40c3-4e12-800e-951332f39f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:31.193675 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d4ef0-40c3-4e12-800e-951332f39f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:31.193957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d4ef0-40c3-4e12-800e-951332f39f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:31.194233 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d4ef0-40c3-4e12-800e-951332f39f77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:31.195010 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d4ef0-40c3-4e12-800e-951332f39f77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:32:31.195322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d4ef0-40c3-4e12-800e-951332f39f77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:31.196938 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d4ef0-40c3-4e12-800e-951332f39f77 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:31.229302 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1014/2010] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:32:31.235857 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a83de0-78fb-4ed8-b60a-45f8dfdec8b3 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:31.257911 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a83de0-78fb-4ed8-b60a-45f8dfdec8b3 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:31.267294 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf12f4a-83a7-4868-bd74-16ce363b6bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:31.268909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf12f4a-83a7-4868-bd74-16ce363b6bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:31.269327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf12f4a-83a7-4868-bd74-16ce363b6bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:31.269685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf12f4a-83a7-4868-bd74-16ce363b6bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:31.270770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf12f4a-83a7-4868-bd74-16ce363b6bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:31.275107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf12f4a-83a7-4868-bd74-16ce363b6bd5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:31.347877 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 997/2011] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:31 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:31.352080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d4ef0-40c3-4e12-800e-951332f39f77 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:31.370448 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d4ef0-40c3-4e12-800e-951332f39f77 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:31.469205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31235de7-f7b6-4964-b76e-417e1a33d615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:31.469500 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31235de7-f7b6-4964-b76e-417e1a33d615 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:31.469972 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31235de7-f7b6-4964-b76e-417e1a33d615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:31.470248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31235de7-f7b6-4964-b76e-417e1a33d615 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:31.471146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31235de7-f7b6-4964-b76e-417e1a33d615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:31.473189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31235de7-f7b6-4964-b76e-417e1a33d615 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:31.511221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1015/2012] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:31 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:31.514002 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf12f4a-83a7-4868-bd74-16ce363b6bd5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:31.544349 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf12f4a-83a7-4868-bd74-16ce363b6bd5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:31.550163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d602394-c378-482c-9c48-f52328122910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:31.551122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d602394-c378-482c-9c48-f52328122910 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:31.551122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d602394-c378-482c-9c48-f52328122910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:31.551424 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d602394-c378-482c-9c48-f52328122910 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:31.552148 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d602394-c378-482c-9c48-f52328122910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:31.553759 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d602394-c378-482c-9c48-f52328122910 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:31.568555 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 998/2013] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:32:31.573051 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31235de7-f7b6-4964-b76e-417e1a33d615 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:31.585937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31235de7-f7b6-4964-b76e-417e1a33d615 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:31.591057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef51d6d-e4f6-4be2-8669-5d9f92a91256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:31.591744 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef51d6d-e4f6-4be2-8669-5d9f92a91256 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:31.592027 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef51d6d-e4f6-4be2-8669-5d9f92a91256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:31.592378 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef51d6d-e4f6-4be2-8669-5d9f92a91256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:31.593119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef51d6d-e4f6-4be2-8669-5d9f92a91256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:31.594746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef51d6d-e4f6-4be2-8669-5d9f92a91256 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:31.608049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1016/2014] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:31.613124 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d602394-c378-482c-9c48-f52328122910 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:31.624293 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d602394-c378-482c-9c48-f52328122910 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:31.631216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01779a3d-31fa-4fbb-8f19-a955cde8f8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:31.632128 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01779a3d-31fa-4fbb-8f19-a955cde8f8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:31.632417 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01779a3d-31fa-4fbb-8f19-a955cde8f8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:31.632691 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01779a3d-31fa-4fbb-8f19-a955cde8f8e9 admin admin] PATH_INFO: `/v3/projects/a710ac09e2ef45e6903d9541309155ca/users/0f52dee3f3fd433a83f6baa4eedf569d/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:31.653551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01779a3d-31fa-4fbb-8f19-a955cde8f8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a710ac09e2ef45e6903d9541309155ca, user_id=0f52dee3f3fd433a83f6baa4eedf569d, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:31.656545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01779a3d-31fa-4fbb-8f19-a955cde8f8e9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:31.678705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 999/2015] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:31 2022] PUT /identity/v3/projects/a710ac09e2ef45e6903d9541309155ca/users/0f52dee3f3fd433a83f6baa4eedf569d/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:31.692336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c915fd2-b3bd-44e3-9155-a363a1a4c4db None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:31.692724 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c915fd2-b3bd-44e3-9155-a363a1a4c4db None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:31.693298 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c915fd2-b3bd-44e3-9155-a363a1a4c4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:31.730447 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2c915fd2-b3bd-44e3-9155-a363a1a4c4db None None] MFA Rules not processed for user `0f52dee3f3fd433a83f6baa4eedf569d`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:31.731680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2c915fd2-b3bd-44e3-9155-a363a1a4c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:31.799475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1017/2016] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:31.804776 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01779a3d-31fa-4fbb-8f19-a955cde8f8e9 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:31.907770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01779a3d-31fa-4fbb-8f19-a955cde8f8e9 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:31.914655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96731f-4684-4f4a-a2fb-aa4a2029638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:31.915373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96731f-4684-4f4a-a2fb-aa4a2029638d admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:31.915652 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96731f-4684-4f4a-a2fb-aa4a2029638d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:31.915923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96731f-4684-4f4a-a2fb-aa4a2029638d admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:31.916658 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96731f-4684-4f4a-a2fb-aa4a2029638d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:31.918563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96731f-4684-4f4a-a2fb-aa4a2029638d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:31.972828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1000/2017] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:31 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:32:31.974489 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c915fd2-b3bd-44e3-9155-a363a1a4c4db None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:31.995657 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c915fd2-b3bd-44e3-9155-a363a1a4c4db None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:32.036376 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:32.074754 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0e4ba-a379-4f21-a065-aabe2b10cf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:32.075991 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0e4ba-a379-4f21-a065-aabe2b10cf0c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:32.076297 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0e4ba-a379-4f21-a065-aabe2b10cf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:32.076577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0e4ba-a379-4f21-a065-aabe2b10cf0c admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:32.077278 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0e4ba-a379-4f21-a065-aabe2b10cf0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:32.079451 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0e4ba-a379-4f21-a065-aabe2b10cf0c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:32.105767 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1018/2018] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:31 2022] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:32.109474 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96731f-4684-4f4a-a2fb-aa4a2029638d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:32.141150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96731f-4684-4f4a-a2fb-aa4a2029638d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:32.148193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6357c-6113-40af-a104-f93bf2c9b4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:32.148922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6357c-6113-40af-a104-f93bf2c9b4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:32.149204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6357c-6113-40af-a104-f93bf2c9b4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:32.149602 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6357c-6113-40af-a104-f93bf2c9b4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:32.150336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6357c-6113-40af-a104-f93bf2c9b4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:32.152005 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6357c-6113-40af-a104-f93bf2c9b4a6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:32.165288 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1001/2019] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:32:32.169440 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0e4ba-a379-4f21-a065-aabe2b10cf0c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:32.184213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0e4ba-a379-4f21-a065-aabe2b10cf0c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:32.190636 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340caaac-f884-4e3a-bc8d-4d7999f3a9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:32.198062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340caaac-f884-4e3a-bc8d-4d7999f3a9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:32.199268 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340caaac-f884-4e3a-bc8d-4d7999f3a9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:32.199695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340caaac-f884-4e3a-bc8d-4d7999f3a9b9 admin admin] PATH_INFO: `/v3/projects/eb6cebfbe6974cecac6213455ee18ab0/users/9cc4d2c588314443a8120f72cfc51100/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:32.249632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340caaac-f884-4e3a-bc8d-4d7999f3a9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6cebfbe6974cecac6213455ee18ab0, user_id=9cc4d2c588314443a8120f72cfc51100, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:32.253406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340caaac-f884-4e3a-bc8d-4d7999f3a9b9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:32.269879 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1019/2020] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:32 2022] PUT /identity/v3/projects/eb6cebfbe6974cecac6213455ee18ab0/users/9cc4d2c588314443a8120f72cfc51100/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:32.273941 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6357c-6113-40af-a104-f93bf2c9b4a6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:32.291283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6357c-6113-40af-a104-f93bf2c9b4a6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:32.359430 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:32.375938 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340caaac-f884-4e3a-bc8d-4d7999f3a9b9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:32.378618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-340caaac-f884-4e3a-bc8d-4d7999f3a9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:32.379588 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff2789-d5d7-42be-aa54-afcb456e6e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:32.380358 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff2789-d5d7-42be-aa54-afcb456e6e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:32.380707 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff2789-d5d7-42be-aa54-afcb456e6e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:32.381053 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff2789-d5d7-42be-aa54-afcb456e6e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:32.381862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff2789-d5d7-42be-aa54-afcb456e6e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:32.384513 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff2789-d5d7-42be-aa54-afcb456e6e0d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:32.401778 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1002/2021] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:32.402013 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340caaac-f884-4e3a-bc8d-4d7999f3a9b9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:32.402846 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff2789-d5d7-42be-aa54-afcb456e6e0d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:32.407368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e93648-22d7-460a-8dcb-12b87dfee94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:32.408568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e93648-22d7-460a-8dcb-12b87dfee94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:32.408922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e93648-22d7-460a-8dcb-12b87dfee94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:32.409398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e93648-22d7-460a-8dcb-12b87dfee94d admin admin] PATH_INFO: `/v3/users/d71508c8a076403ba24e74e1111ec14a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:32.411004 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e93648-22d7-460a-8dcb-12b87dfee94d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d71508c8a076403ba24e74e1111ec14a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:32.413281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e93648-22d7-460a-8dcb-12b87dfee94d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:32.433913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff2789-d5d7-42be-aa54-afcb456e6e0d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:32.454907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be157538-781c-4781-9400-ffe1917dca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:32.459534 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be157538-781c-4781-9400-ffe1917dca18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:32.459862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be157538-781c-4781-9400-ffe1917dca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:32.460534 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be157538-781c-4781-9400-ffe1917dca18 admin admin] PATH_INFO: `/v3/projects/eb6cebfbe6974cecac6213455ee18ab0/users/9cc4d2c588314443a8120f72cfc51100/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:32.463018 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be157538-781c-4781-9400-ffe1917dca18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6cebfbe6974cecac6213455ee18ab0, user_id=9cc4d2c588314443a8120f72cfc51100, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:32.466040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be157538-781c-4781-9400-ffe1917dca18 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:32.481779 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1003/2022] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:32 2022] PUT /identity/v3/projects/eb6cebfbe6974cecac6213455ee18ab0/users/9cc4d2c588314443a8120f72cfc51100/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:32.482976 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-30e93648-22d7-460a-8dcb-12b87dfee94d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd71508c8a076403ba24e74e1111ec14a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:32.492913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66961a-a1b3-46d2-a47d-04da04fb59e6 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:32.493199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66961a-a1b3-46d2-a47d-04da04fb59e6 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:32.493561 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66961a-a1b3-46d2-a47d-04da04fb59e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:32.494251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-30e93648-22d7-460a-8dcb-12b87dfee94d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd71508c8a076403ba24e74e1111ec14a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:32.513482 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-30e93648-22d7-460a-8dcb-12b87dfee94d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd71508c8a076403ba24e74e1111ec14a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:32.528823 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-30e93648-22d7-460a-8dcb-12b87dfee94d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd71508c8a076403ba24e74e1111ec14a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:32.530465 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-30e93648-22d7-460a-8dcb-12b87dfee94d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd71508c8a076403ba24e74e1111ec14a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:32.531184 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-be66961a-a1b3-46d2-a47d-04da04fb59e6 None None] MFA Rules not processed for user `9cc4d2c588314443a8120f72cfc51100`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:32.532542 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-be66961a-a1b3-46d2-a47d-04da04fb59e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:32.547446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1020/2023] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:32 2022] DELETE /identity/v3/users/d71508c8a076403ba24e74e1111ec14a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:32.553858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad8f7a-ba32-421e-b620-a4bd020ba4a3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:32.554473 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad8f7a-ba32-421e-b620-a4bd020ba4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:32.554775 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad8f7a-ba32-421e-b620-a4bd020ba4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:32.604913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-dfad8f7a-ba32-421e-b620-a4bd020ba4a3 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:32.606208 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dfad8f7a-ba32-421e-b620-a4bd020ba4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:32.697999 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1004/2024] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:32.711504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66961a-a1b3-46d2-a47d-04da04fb59e6 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:32.714010 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-be66961a-a1b3-46d2-a47d-04da04fb59e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:32.726945 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1021/2025] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:32.745496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad8f7a-ba32-421e-b620-a4bd020ba4a3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:32.747056 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dfad8f7a-ba32-421e-b620-a4bd020ba4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:32.790869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:32.863588 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66961a-a1b3-46d2-a47d-04da04fb59e6 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:32.883930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad8f7a-ba32-421e-b620-a4bd020ba4a3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:32.892107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22208c-2325-45d0-bf5d-622049798f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:32.894023 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22208c-2325-45d0-bf5d-622049798f0c service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:32.894023 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22208c-2325-45d0-bf5d-622049798f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:32.894023 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22208c-2325-45d0-bf5d-622049798f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:32.904612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22208c-2325-45d0-bf5d-622049798f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:32.906227 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22208c-2325-45d0-bf5d-622049798f0c service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:32.917155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1022/2026] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:32.948430 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127229bd-6029-4404-865c-905da803a872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:32.949372 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127229bd-6029-4404-865c-905da803a872 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:32.949810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127229bd-6029-4404-865c-905da803a872 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:32.950239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127229bd-6029-4404-865c-905da803a872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:32.952292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-127229bd-6029-4404-865c-905da803a872 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:32.988893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:33.036146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127229bd-6029-4404-865c-905da803a872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:33.038304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127229bd-6029-4404-865c-905da803a872 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:33.053431 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1005/2027] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:32:33.295019 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22208c-2325-45d0-bf5d-622049798f0c service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:33.296985 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3e22208c-2325-45d0-bf5d-622049798f0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:33.313401 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22208c-2325-45d0-bf5d-622049798f0c service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:33.319736 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd7ce5-ac48-4a41-805f-3004d9fb7467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:33.321035 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd7ce5-ac48-4a41-805f-3004d9fb7467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:33.322090 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd7ce5-ac48-4a41-805f-3004d9fb7467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:33.322579 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd7ce5-ac48-4a41-805f-3004d9fb7467 admin admin] PATH_INFO: `/v3/projects/19da57a8a33145fcb0b20acdcf24238e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:33.325235 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd7ce5-ac48-4a41-805f-3004d9fb7467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19da57a8a33145fcb0b20acdcf24238e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:33.328407 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd7ce5-ac48-4a41-805f-3004d9fb7467 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:33.414233 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-47dd7ce5-ac48-4a41-805f-3004d9fb7467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19da57a8a33145fcb0b20acdcf24238e', 'request_id': 'req-47dd7ce5-ac48-4a41-805f-3004d9fb7467'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:33.420830 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-47dd7ce5-ac48-4a41-805f-3004d9fb7467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19da57a8a33145fcb0b20acdcf24238e', 'request_id': 'req-47dd7ce5-ac48-4a41-805f-3004d9fb7467'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:33.434345 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-47dd7ce5-ac48-4a41-805f-3004d9fb7467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19da57a8a33145fcb0b20acdcf24238e', 'request_id': 'req-47dd7ce5-ac48-4a41-805f-3004d9fb7467'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:33.459065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-47dd7ce5-ac48-4a41-805f-3004d9fb7467 admin admin] The token cache is being invalidate because project 19da57a8a33145fcb0b20acdcf24238e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:33.459370 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-47dd7ce5-ac48-4a41-805f-3004d9fb7467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:33.461306 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-47dd7ce5-ac48-4a41-805f-3004d9fb7467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:33.466540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1023/2028] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:33 2022] DELETE /identity/v3/projects/19da57a8a33145fcb0b20acdcf24238e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:33.473133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5622c-11bc-42b1-8d40-74127aec68c2 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:33.473133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5622c-11bc-42b1-8d40-74127aec68c2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:33.473500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5622c-11bc-42b1-8d40-74127aec68c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:33.513940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0ad5622c-11bc-42b1-8d40-74127aec68c2 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:33.519311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0ad5622c-11bc-42b1-8d40-74127aec68c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:33.602919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1006/2029] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:33.607878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d7e9a-99e4-4c91-90eb-79deae21036f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:33.608167 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d7e9a-99e4-4c91-90eb-79deae21036f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:33.608450 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d7e9a-99e4-4c91-90eb-79deae21036f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:33.635033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5f0d7e9a-99e4-4c91-90eb-79deae21036f None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:33.636281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5f0d7e9a-99e4-4c91-90eb-79deae21036f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:33.645184 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1024/2030] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:33.649461 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5622c-11bc-42b1-8d40-74127aec68c2 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:33.660029 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5622c-11bc-42b1-8d40-74127aec68c2 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:33.664666 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8537f5-6095-4b8e-a279-cc140542e558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:33.665322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8537f5-6095-4b8e-a279-cc140542e558 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:33.665597 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8537f5-6095-4b8e-a279-cc140542e558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:33.665867 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8537f5-6095-4b8e-a279-cc140542e558 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:33.666614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8537f5-6095-4b8e-a279-cc140542e558 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:32:33.667353 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8537f5-6095-4b8e-a279-cc140542e558 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:33.668715 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8537f5-6095-4b8e-a279-cc140542e558 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:33.681054 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1007/2031] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:32:33.691138 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d7e9a-99e4-4c91-90eb-79deae21036f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:33.702113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d7e9a-99e4-4c91-90eb-79deae21036f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:33.709523 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435db491-caac-4181-baf0-82d3762b67d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:33.711032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435db491-caac-4181-baf0-82d3762b67d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:33.712307 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435db491-caac-4181-baf0-82d3762b67d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:33.712737 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435db491-caac-4181-baf0-82d3762b67d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:33.714068 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435db491-caac-4181-baf0-82d3762b67d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:33.716301 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435db491-caac-4181-baf0-82d3762b67d6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:33.747823 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1025/2032] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:33 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:33.749352 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8537f5-6095-4b8e-a279-cc140542e558 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:33.759888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8537f5-6095-4b8e-a279-cc140542e558 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:33.851401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccf31a-67c9-4e0c-9b75-ac4ea39fb82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:33.852112 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccf31a-67c9-4e0c-9b75-ac4ea39fb82b admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:33.852742 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccf31a-67c9-4e0c-9b75-ac4ea39fb82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:33.853022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccf31a-67c9-4e0c-9b75-ac4ea39fb82b admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:33.853731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccf31a-67c9-4e0c-9b75-ac4ea39fb82b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:33.855732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccf31a-67c9-4e0c-9b75-ac4ea39fb82b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:33.898418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1008/2033] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:33 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:32:33.902615 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435db491-caac-4181-baf0-82d3762b67d6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:33.914084 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435db491-caac-4181-baf0-82d3762b67d6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:33.918937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02492fb1-eb76-43e7-86a6-b994f14092a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:33.919601 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02492fb1-eb76-43e7-86a6-b994f14092a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:33.919882 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02492fb1-eb76-43e7-86a6-b994f14092a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:33.920166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02492fb1-eb76-43e7-86a6-b994f14092a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:33.920871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02492fb1-eb76-43e7-86a6-b994f14092a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:33.922454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02492fb1-eb76-43e7-86a6-b994f14092a8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:33.936421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1026/2034] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:32:33.940871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccf31a-67c9-4e0c-9b75-ac4ea39fb82b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:33.952930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccf31a-67c9-4e0c-9b75-ac4ea39fb82b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:33.965574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e745149-a2c4-4d8f-adce-7d6300903692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:33.966455 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e745149-a2c4-4d8f-adce-7d6300903692 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:33.966859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e745149-a2c4-4d8f-adce-7d6300903692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:33.967219 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e745149-a2c4-4d8f-adce-7d6300903692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:33.968036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e745149-a2c4-4d8f-adce-7d6300903692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:33.970222 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e745149-a2c4-4d8f-adce-7d6300903692 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:33.987252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02492fb1-eb76-43e7-86a6-b994f14092a8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:33.987868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1009/2035] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:33.998285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02492fb1-eb76-43e7-86a6-b994f14092a8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:34.004552 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555755d2-6a7f-40a9-9702-04a10f9de2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:34.005499 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555755d2-6a7f-40a9-9702-04a10f9de2f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:34.005830 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555755d2-6a7f-40a9-9702-04a10f9de2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:34.006138 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555755d2-6a7f-40a9-9702-04a10f9de2f1 admin admin] PATH_INFO: `/v3/projects/ef37d14d75ce4177b078d349f019732a/users/a583b06f6999438cab953c92486dbda2/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:34.026617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555755d2-6a7f-40a9-9702-04a10f9de2f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef37d14d75ce4177b078d349f019732a, user_id=a583b06f6999438cab953c92486dbda2, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:34.031777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555755d2-6a7f-40a9-9702-04a10f9de2f1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:34.050786 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1027/2036] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:33 2022] PUT /identity/v3/projects/ef37d14d75ce4177b078d349f019732a/users/a583b06f6999438cab953c92486dbda2/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:34.061729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317fea3-4521-41c0-bf4b-42fa0b0cd444 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:34.062753 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317fea3-4521-41c0-bf4b-42fa0b0cd444 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:34.062753 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317fea3-4521-41c0-bf4b-42fa0b0cd444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:34.134110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2317fea3-4521-41c0-bf4b-42fa0b0cd444 None None] MFA Rules not processed for user `a583b06f6999438cab953c92486dbda2`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:34.135917 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2317fea3-4521-41c0-bf4b-42fa0b0cd444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:34.165755 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:34.253419 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1010/2037] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:34.263718 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555755d2-6a7f-40a9-9702-04a10f9de2f1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:34.269105 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-555755d2-6a7f-40a9-9702-04a10f9de2f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:34.324839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:34.362371 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555755d2-6a7f-40a9-9702-04a10f9de2f1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:34.368984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f44543-60d4-47d3-8314-5edd589014a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:34.369832 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f44543-60d4-47d3-8314-5edd589014a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:34.370125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f44543-60d4-47d3-8314-5edd589014a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:34.370405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f44543-60d4-47d3-8314-5edd589014a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:34.381491 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f44543-60d4-47d3-8314-5edd589014a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:34.383048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f44543-60d4-47d3-8314-5edd589014a0 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:34.394643 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1028/2038] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:34.568436 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317fea3-4521-41c0-bf4b-42fa0b0cd444 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:34.585517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317fea3-4521-41c0-bf4b-42fa0b0cd444 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:34.589751 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858f96f-061d-49b6-a665-6b202d472d31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:34.590579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858f96f-061d-49b6-a665-6b202d472d31 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:34.590996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858f96f-061d-49b6-a665-6b202d472d31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:34.591568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858f96f-061d-49b6-a665-6b202d472d31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:34.595252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8858f96f-061d-49b6-a665-6b202d472d31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:34.699605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858f96f-061d-49b6-a665-6b202d472d31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:34.701563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858f96f-061d-49b6-a665-6b202d472d31 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:34.716814 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1011/2039] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:35.072036 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f44543-60d4-47d3-8314-5edd589014a0 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:35.073620 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-62f44543-60d4-47d3-8314-5edd589014a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:35.164388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f44543-60d4-47d3-8314-5edd589014a0 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:35.168839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8df193-a741-4027-a917-d2c59a923f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:35.169787 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8df193-a741-4027-a917-d2c59a923f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:35.170071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8df193-a741-4027-a917-d2c59a923f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:35.170344 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8df193-a741-4027-a917-d2c59a923f1b admin admin] PATH_INFO: `/v3/users/6575cc39f6a1466691f15625e15fc199` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:35.171560 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8df193-a741-4027-a917-d2c59a923f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6575cc39f6a1466691f15625e15fc199)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:35.173449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8df193-a741-4027-a917-d2c59a923f1b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:35.220076 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1c8df193-a741-4027-a917-d2c59a923f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6575cc39f6a1466691f15625e15fc199'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:35.226940 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1c8df193-a741-4027-a917-d2c59a923f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6575cc39f6a1466691f15625e15fc199'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:35.239849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1c8df193-a741-4027-a917-d2c59a923f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6575cc39f6a1466691f15625e15fc199'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:35.247480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1c8df193-a741-4027-a917-d2c59a923f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6575cc39f6a1466691f15625e15fc199'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:35.248108 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1c8df193-a741-4027-a917-d2c59a923f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6575cc39f6a1466691f15625e15fc199'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:35.255099 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1029/2040] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:35 2022] DELETE /identity/v3/users/6575cc39f6a1466691f15625e15fc199 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:35.484522 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858f96f-061d-49b6-a665-6b202d472d31 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:35.498459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858f96f-061d-49b6-a665-6b202d472d31 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:35.565662 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4c037-3e86-49e1-b3fa-ddcfa7e3ec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:35.566791 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4c037-3e86-49e1-b3fa-ddcfa7e3ec8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:35.567171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4c037-3e86-49e1-b3fa-ddcfa7e3ec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:35.567444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4c037-3e86-49e1-b3fa-ddcfa7e3ec8b admin admin] PATH_INFO: `/v3/projects/206f5ccabdb74e8cb6c3d3cbbe6e0062` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:35.569228 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4c037-3e86-49e1-b3fa-ddcfa7e3ec8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=206f5ccabdb74e8cb6c3d3cbbe6e0062)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:35.571999 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4c037-3e86-49e1-b3fa-ddcfa7e3ec8b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:35.621527 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a9f4c037-3e86-49e1-b3fa-ddcfa7e3ec8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '206f5ccabdb74e8cb6c3d3cbbe6e0062', 'request_id': 'req-a9f4c037-3e86-49e1-b3fa-ddcfa7e3ec8b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:35.628227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a9f4c037-3e86-49e1-b3fa-ddcfa7e3ec8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '206f5ccabdb74e8cb6c3d3cbbe6e0062', 'request_id': 'req-a9f4c037-3e86-49e1-b3fa-ddcfa7e3ec8b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:35.629959 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:35.636607 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a9f4c037-3e86-49e1-b3fa-ddcfa7e3ec8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '206f5ccabdb74e8cb6c3d3cbbe6e0062', 'request_id': 'req-a9f4c037-3e86-49e1-b3fa-ddcfa7e3ec8b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:35.649434 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a9f4c037-3e86-49e1-b3fa-ddcfa7e3ec8b admin admin] The token cache is being invalidate because project 206f5ccabdb74e8cb6c3d3cbbe6e0062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:35.649724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a9f4c037-3e86-49e1-b3fa-ddcfa7e3ec8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:35.650369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a9f4c037-3e86-49e1-b3fa-ddcfa7e3ec8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:35.652015 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1012/2041] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:35 2022] DELETE /identity/v3/projects/206f5ccabdb74e8cb6c3d3cbbe6e0062 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:35.657054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2027f2-358e-40d1-89af-85c37f3fef85 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:35.657497 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2027f2-358e-40d1-89af-85c37f3fef85 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:35.657621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2027f2-358e-40d1-89af-85c37f3fef85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:35.676364 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1c2027f2-358e-40d1-89af-85c37f3fef85 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:35.677493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1c2027f2-358e-40d1-89af-85c37f3fef85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:35.732124 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:35.747116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1030/2042] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:35.755948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338494c-bd45-4cb8-b12f-8211674da9df None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:35.756237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338494c-bd45-4cb8-b12f-8211674da9df None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:35.756514 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338494c-bd45-4cb8-b12f-8211674da9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:35.776453 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4338494c-bd45-4cb8-b12f-8211674da9df None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:35.777757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4338494c-bd45-4cb8-b12f-8211674da9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:35.786855 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1013/2043] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:35.791235 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2027f2-358e-40d1-89af-85c37f3fef85 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:35.801985 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2027f2-358e-40d1-89af-85c37f3fef85 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:35.806648 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd5b60-37c7-4590-b74a-e0014f6b2bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:35.807343 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd5b60-37c7-4590-b74a-e0014f6b2bda admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:35.807626 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd5b60-37c7-4590-b74a-e0014f6b2bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:35.807900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd5b60-37c7-4590-b74a-e0014f6b2bda admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:35.808617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd5b60-37c7-4590-b74a-e0014f6b2bda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:32:35.808921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd5b60-37c7-4590-b74a-e0014f6b2bda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:35.810513 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd5b60-37c7-4590-b74a-e0014f6b2bda admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:35.822971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1031/2044] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:32:35.827345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338494c-bd45-4cb8-b12f-8211674da9df None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:35.837258 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338494c-bd45-4cb8-b12f-8211674da9df None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:35.841898 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef3faa-19b4-4ab8-ab3d-8056d5f5d426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:35.842547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef3faa-19b4-4ab8-ab3d-8056d5f5d426 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:35.842871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef3faa-19b4-4ab8-ab3d-8056d5f5d426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:35.843143 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef3faa-19b4-4ab8-ab3d-8056d5f5d426 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:35.843838 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef3faa-19b4-4ab8-ab3d-8056d5f5d426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:35.846378 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef3faa-19b4-4ab8-ab3d-8056d5f5d426 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:35.871234 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1014/2045] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:35 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:32:35.875313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd5b60-37c7-4590-b74a-e0014f6b2bda admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:35.885827 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd5b60-37c7-4590-b74a-e0014f6b2bda admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:35.943838 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f63d2f-d18c-4845-8a00-74538993befb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:35.944429 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f63d2f-d18c-4845-8a00-74538993befb admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:35.944710 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f63d2f-d18c-4845-8a00-74538993befb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:35.944984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f63d2f-d18c-4845-8a00-74538993befb admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:35.945659 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f63d2f-d18c-4845-8a00-74538993befb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:35.947609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f63d2f-d18c-4845-8a00-74538993befb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:35.967781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1032/2046] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:35 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:35.972445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef3faa-19b4-4ab8-ab3d-8056d5f5d426 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:35.983485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef3faa-19b4-4ab8-ab3d-8056d5f5d426 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:35.990718 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cfef3-33f9-49aa-8f20-4864a741d5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:35.991608 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cfef3-33f9-49aa-8f20-4864a741d5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:35.991917 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cfef3-33f9-49aa-8f20-4864a741d5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:35.992167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cfef3-33f9-49aa-8f20-4864a741d5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:35.993204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cfef3-33f9-49aa-8f20-4864a741d5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:35.995406 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cfef3-33f9-49aa-8f20-4864a741d5a4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:36.010383 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1015/2047] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:32:36.017054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f63d2f-d18c-4845-8a00-74538993befb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:36.035285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f63d2f-d18c-4845-8a00-74538993befb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:36.042163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c5c48-6369-4f65-bfa8-ee72e6672ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:36.042894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c5c48-6369-4f65-bfa8-ee72e6672ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:36.043181 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c5c48-6369-4f65-bfa8-ee72e6672ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:36.043457 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c5c48-6369-4f65-bfa8-ee72e6672ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:36.044332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c5c48-6369-4f65-bfa8-ee72e6672ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:36.047648 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c5c48-6369-4f65-bfa8-ee72e6672ea2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:36.062909 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1033/2048] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:36.067201 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cfef3-33f9-49aa-8f20-4864a741d5a4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:36.080135 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cfef3-33f9-49aa-8f20-4864a741d5a4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:36.085993 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a373a23-e9c6-4ba4-b120-1f112d3c6507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:36.087098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a373a23-e9c6-4ba4-b120-1f112d3c6507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:36.087380 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a373a23-e9c6-4ba4-b120-1f112d3c6507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:36.087910 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a373a23-e9c6-4ba4-b120-1f112d3c6507 admin admin] PATH_INFO: `/v3/projects/e0f90c92968f4e038d7a31f7a6e757ec/users/18d11a05d1c2433c8c0ece4b49c7ed5c/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:36.106130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a373a23-e9c6-4ba4-b120-1f112d3c6507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f90c92968f4e038d7a31f7a6e757ec, user_id=18d11a05d1c2433c8c0ece4b49c7ed5c, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:36.109132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a373a23-e9c6-4ba4-b120-1f112d3c6507 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:36.125839 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1016/2049] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:36 2022] PUT /identity/v3/projects/e0f90c92968f4e038d7a31f7a6e757ec/users/18d11a05d1c2433c8c0ece4b49c7ed5c/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:36.136365 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237c784-7835-4d82-93ad-fe0e6f438650 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:36.136563 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237c784-7835-4d82-93ad-fe0e6f438650 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:36.136841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237c784-7835-4d82-93ad-fe0e6f438650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:36.167486 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c237c784-7835-4d82-93ad-fe0e6f438650 None None] MFA Rules not processed for user `18d11a05d1c2433c8c0ece4b49c7ed5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:36.169167 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c237c784-7835-4d82-93ad-fe0e6f438650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:36.257970 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1034/2050] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:36.259207 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a373a23-e9c6-4ba4-b120-1f112d3c6507 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:36.334331 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a373a23-e9c6-4ba4-b120-1f112d3c6507 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:36.343699 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2c80f-e862-4c42-bfcc-ab0a2b6faaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:36.344427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2c80f-e862-4c42-bfcc-ab0a2b6faaa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:36.344712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2c80f-e862-4c42-bfcc-ab0a2b6faaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:36.345044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2c80f-e862-4c42-bfcc-ab0a2b6faaa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:36.345791 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2c80f-e862-4c42-bfcc-ab0a2b6faaa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:36.347977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2c80f-e862-4c42-bfcc-ab0a2b6faaa5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:36.384691 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1017/2051] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:36 2022] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:36.386156 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237c784-7835-4d82-93ad-fe0e6f438650 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:36.399561 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237c784-7835-4d82-93ad-fe0e6f438650 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:36.484307 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:36.506585 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d48d7c-54e8-48f0-903b-b18c49460eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:36.508021 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d48d7c-54e8-48f0-903b-b18c49460eca admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:36.508379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d48d7c-54e8-48f0-903b-b18c49460eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:36.508935 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d48d7c-54e8-48f0-903b-b18c49460eca admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:36.509869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d48d7c-54e8-48f0-903b-b18c49460eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:36.512583 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d48d7c-54e8-48f0-903b-b18c49460eca admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:36.539357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1035/2052] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:36 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:32:36.542782 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2c80f-e862-4c42-bfcc-ab0a2b6faaa5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:36.555133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2c80f-e862-4c42-bfcc-ab0a2b6faaa5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:36.560164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead618e-2a7b-41a4-98a7-4e53a838da45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:36.560789 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead618e-2a7b-41a4-98a7-4e53a838da45 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:36.561076 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead618e-2a7b-41a4-98a7-4e53a838da45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:36.561352 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead618e-2a7b-41a4-98a7-4e53a838da45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:36.562086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead618e-2a7b-41a4-98a7-4e53a838da45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:36.563982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead618e-2a7b-41a4-98a7-4e53a838da45 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:36.582183 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1018/2053] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:32:36.583832 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d48d7c-54e8-48f0-903b-b18c49460eca admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:36.594656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d48d7c-54e8-48f0-903b-b18c49460eca admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:36.601102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7f837-12b5-4125-b8a7-20cc20a41b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:36.602879 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7f837-12b5-4125-b8a7-20cc20a41b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:36.603534 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7f837-12b5-4125-b8a7-20cc20a41b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:36.604055 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7f837-12b5-4125-b8a7-20cc20a41b1c admin admin] PATH_INFO: `/v3/projects/80edc9755c3949c1bb3fb47cb40c46da/users/c128e7ccba5a4c0fb26af65b62da95f0/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:36.629157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7f837-12b5-4125-b8a7-20cc20a41b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=80edc9755c3949c1bb3fb47cb40c46da, user_id=c128e7ccba5a4c0fb26af65b62da95f0, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:36.633196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7f837-12b5-4125-b8a7-20cc20a41b1c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:36.650081 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1036/2054] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:36 2022] PUT /identity/v3/projects/80edc9755c3949c1bb3fb47cb40c46da/users/c128e7ccba5a4c0fb26af65b62da95f0/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:36.654196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead618e-2a7b-41a4-98a7-4e53a838da45 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:36.665858 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead618e-2a7b-41a4-98a7-4e53a838da45 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:36.729549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:36.738273 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ee03a-1c85-48fe-8853-91a15add4460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:36.739082 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ee03a-1c85-48fe-8853-91a15add4460 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:36.739528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ee03a-1c85-48fe-8853-91a15add4460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:36.739973 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ee03a-1c85-48fe-8853-91a15add4460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:36.740707 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ee03a-1c85-48fe-8853-91a15add4460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:36.742545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ee03a-1c85-48fe-8853-91a15add4460 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:36.757752 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1019/2055] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:32:36.759270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7f837-12b5-4125-b8a7-20cc20a41b1c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:36.770091 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7f837-12b5-4125-b8a7-20cc20a41b1c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:36.774959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92b23d-eef3-41ae-8f3e-7196a5d13c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:36.775846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92b23d-eef3-41ae-8f3e-7196a5d13c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:36.776125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92b23d-eef3-41ae-8f3e-7196a5d13c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:36.776398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92b23d-eef3-41ae-8f3e-7196a5d13c21 admin admin] PATH_INFO: `/v3/projects/80edc9755c3949c1bb3fb47cb40c46da/users/c128e7ccba5a4c0fb26af65b62da95f0/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:36.778390 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92b23d-eef3-41ae-8f3e-7196a5d13c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80edc9755c3949c1bb3fb47cb40c46da, user_id=c128e7ccba5a4c0fb26af65b62da95f0, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:36.781093 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92b23d-eef3-41ae-8f3e-7196a5d13c21 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:36.794237 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1037/2056] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:36 2022] PUT /identity/v3/projects/80edc9755c3949c1bb3fb47cb40c46da/users/c128e7ccba5a4c0fb26af65b62da95f0/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:36.805585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3556e8d-62d8-4b97-944d-703e1bcf1d69 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:36.806415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3556e8d-62d8-4b97-944d-703e1bcf1d69 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:36.806855 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3556e8d-62d8-4b97-944d-703e1bcf1d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:36.837567 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b3556e8d-62d8-4b97-944d-703e1bcf1d69 None None] MFA Rules not processed for user `c128e7ccba5a4c0fb26af65b62da95f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:36.838813 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b3556e8d-62d8-4b97-944d-703e1bcf1d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:36.917800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1020/2057] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:36 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:36.930642 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92b23d-eef3-41ae-8f3e-7196a5d13c21 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:36.932843 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9f92b23d-eef3-41ae-8f3e-7196a5d13c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:37.012342 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92b23d-eef3-41ae-8f3e-7196a5d13c21 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:37.016013 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396a39b-0436-4413-9839-b25736450c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:37.016661 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396a39b-0436-4413-9839-b25736450c81 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:37.016941 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396a39b-0436-4413-9839-b25736450c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:37.017219 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396a39b-0436-4413-9839-b25736450c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:37.027065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396a39b-0436-4413-9839-b25736450c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:37.028490 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396a39b-0436-4413-9839-b25736450c81 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:37.038604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1038/2058] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:36 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:32:37.460553 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3556e8d-62d8-4b97-944d-703e1bcf1d69 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:37.541059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3556e8d-62d8-4b97-944d-703e1bcf1d69 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:37.545883 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1cbd4-eaab-406f-8f88-36aa784a920e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:37.546871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1cbd4-eaab-406f-8f88-36aa784a920e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:37.547176 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1cbd4-eaab-406f-8f88-36aa784a920e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:37.547545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1cbd4-eaab-406f-8f88-36aa784a920e admin admin] PATH_INFO: `/v3/users/18d11a05d1c2433c8c0ece4b49c7ed5c` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:37.549151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1cbd4-eaab-406f-8f88-36aa784a920e admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d11a05d1c2433c8c0ece4b49c7ed5c)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:37.551406 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1cbd4-eaab-406f-8f88-36aa784a920e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:37.613459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5ee1cbd4-eaab-406f-8f88-36aa784a920e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d11a05d1c2433c8c0ece4b49c7ed5c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:37.623312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5ee1cbd4-eaab-406f-8f88-36aa784a920e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d11a05d1c2433c8c0ece4b49c7ed5c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:37.637552 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5ee1cbd4-eaab-406f-8f88-36aa784a920e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d11a05d1c2433c8c0ece4b49c7ed5c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:37.645988 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5ee1cbd4-eaab-406f-8f88-36aa784a920e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d11a05d1c2433c8c0ece4b49c7ed5c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:37.646623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5ee1cbd4-eaab-406f-8f88-36aa784a920e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d11a05d1c2433c8c0ece4b49c7ed5c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:37.648293 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:37.654207 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1021/2059] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:37 2022] DELETE /identity/v3/users/18d11a05d1c2433c8c0ece4b49c7ed5c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:37.659689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1c546-8cd8-4259-9f59-e664f6e0f4e2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:37.660031 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1c546-8cd8-4259-9f59-e664f6e0f4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:37.660308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1c546-8cd8-4259-9f59-e664f6e0f4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:37.680448 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-68d1c546-8cd8-4259-9f59-e664f6e0f4e2 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:37.680802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-68d1c546-8cd8-4259-9f59-e664f6e0f4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:37.765819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1039/2060] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:37.776539 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1cbd4-eaab-406f-8f88-36aa784a920e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:37.778215 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5ee1cbd4-eaab-406f-8f88-36aa784a920e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:37.856175 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1cbd4-eaab-406f-8f88-36aa784a920e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:37.865030 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c40771-9340-44ba-ab2b-cea692f57e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:37.866427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c40771-9340-44ba-ab2b-cea692f57e01 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:37.866923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c40771-9340-44ba-ab2b-cea692f57e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:37.867258 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c40771-9340-44ba-ab2b-cea692f57e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:37.878558 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c40771-9340-44ba-ab2b-cea692f57e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:37.880599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c40771-9340-44ba-ab2b-cea692f57e01 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:37.891720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1022/2061] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:32:38.294758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1c546-8cd8-4259-9f59-e664f6e0f4e2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:38.296519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-68d1c546-8cd8-4259-9f59-e664f6e0f4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:38.317501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1c546-8cd8-4259-9f59-e664f6e0f4e2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:38.324375 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eca67f-cfcf-4fda-83ab-0247205a9cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:38.325244 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eca67f-cfcf-4fda-83ab-0247205a9cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:38.325525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eca67f-cfcf-4fda-83ab-0247205a9cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:38.325797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eca67f-cfcf-4fda-83ab-0247205a9cfc admin admin] PATH_INFO: `/v3/projects/e0f90c92968f4e038d7a31f7a6e757ec` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:38.327393 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eca67f-cfcf-4fda-83ab-0247205a9cfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f90c92968f4e038d7a31f7a6e757ec)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:38.329598 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eca67f-cfcf-4fda-83ab-0247205a9cfc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:38.372341 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:38.382087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-64eca67f-cfcf-4fda-83ab-0247205a9cfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f90c92968f4e038d7a31f7a6e757ec', 'request_id': 'req-64eca67f-cfcf-4fda-83ab-0247205a9cfc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:38.389179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-64eca67f-cfcf-4fda-83ab-0247205a9cfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f90c92968f4e038d7a31f7a6e757ec', 'request_id': 'req-64eca67f-cfcf-4fda-83ab-0247205a9cfc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:38.398160 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-64eca67f-cfcf-4fda-83ab-0247205a9cfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f90c92968f4e038d7a31f7a6e757ec', 'request_id': 'req-64eca67f-cfcf-4fda-83ab-0247205a9cfc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:38.409650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-64eca67f-cfcf-4fda-83ab-0247205a9cfc admin admin] The token cache is being invalidate because project e0f90c92968f4e038d7a31f7a6e757ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:38.409935 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-64eca67f-cfcf-4fda-83ab-0247205a9cfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:38.410575 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-64eca67f-cfcf-4fda-83ab-0247205a9cfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:38.412201 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1040/2062] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:38 2022] DELETE /identity/v3/projects/e0f90c92968f4e038d7a31f7a6e757ec => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:38.416151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c40771-9340-44ba-ab2b-cea692f57e01 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:38.426690 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c40771-9340-44ba-ab2b-cea692f57e01 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:38.487931 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e462c-6cf4-4f3e-9caa-c9cfeaa6b413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:38.488859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e462c-6cf4-4f3e-9caa-c9cfeaa6b413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:38.489197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e462c-6cf4-4f3e-9caa-c9cfeaa6b413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:38.489588 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e462c-6cf4-4f3e-9caa-c9cfeaa6b413 admin admin] PATH_INFO: `/v3/users/c128e7ccba5a4c0fb26af65b62da95f0` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:38.491169 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e462c-6cf4-4f3e-9caa-c9cfeaa6b413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c128e7ccba5a4c0fb26af65b62da95f0)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:38.493201 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e462c-6cf4-4f3e-9caa-c9cfeaa6b413 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:38.544698 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-dd4e462c-6cf4-4f3e-9caa-c9cfeaa6b413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c128e7ccba5a4c0fb26af65b62da95f0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:38.552200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-dd4e462c-6cf4-4f3e-9caa-c9cfeaa6b413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c128e7ccba5a4c0fb26af65b62da95f0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:38.565730 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-dd4e462c-6cf4-4f3e-9caa-c9cfeaa6b413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c128e7ccba5a4c0fb26af65b62da95f0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:38.573037 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-dd4e462c-6cf4-4f3e-9caa-c9cfeaa6b413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c128e7ccba5a4c0fb26af65b62da95f0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:38.573697 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-dd4e462c-6cf4-4f3e-9caa-c9cfeaa6b413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c128e7ccba5a4c0fb26af65b62da95f0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:38.580897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1023/2063] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:38 2022] DELETE /identity/v3/users/c128e7ccba5a4c0fb26af65b62da95f0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:38.705918 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eca67f-cfcf-4fda-83ab-0247205a9cfc admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:38.707446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-64eca67f-cfcf-4fda-83ab-0247205a9cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:38.721082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eca67f-cfcf-4fda-83ab-0247205a9cfc admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:38.781864 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ed51b-2c1b-44d4-af5e-85cbd77ff02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:38.782789 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ed51b-2c1b-44d4-af5e-85cbd77ff02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:38.783095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ed51b-2c1b-44d4-af5e-85cbd77ff02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:38.783366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ed51b-2c1b-44d4-af5e-85cbd77ff02f admin admin] PATH_INFO: `/v3/users/0f52dee3f3fd433a83f6baa4eedf569d` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:38.784568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ed51b-2c1b-44d4-af5e-85cbd77ff02f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f52dee3f3fd433a83f6baa4eedf569d)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:38.786582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ed51b-2c1b-44d4-af5e-85cbd77ff02f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:38.837557 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-448ed51b-2c1b-44d4-af5e-85cbd77ff02f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f52dee3f3fd433a83f6baa4eedf569d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:38.844620 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-448ed51b-2c1b-44d4-af5e-85cbd77ff02f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f52dee3f3fd433a83f6baa4eedf569d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:38.857400 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-448ed51b-2c1b-44d4-af5e-85cbd77ff02f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f52dee3f3fd433a83f6baa4eedf569d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:38.868377 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-448ed51b-2c1b-44d4-af5e-85cbd77ff02f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f52dee3f3fd433a83f6baa4eedf569d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:38.869237 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-448ed51b-2c1b-44d4-af5e-85cbd77ff02f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f52dee3f3fd433a83f6baa4eedf569d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:38.875764 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1041/2064] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:38 2022] DELETE /identity/v3/users/0f52dee3f3fd433a83f6baa4eedf569d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:38.881733 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055895c-4335-4f84-aa13-cf1a2aff5d5c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:38.882126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055895c-4335-4f84-aa13-cf1a2aff5d5c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:38.882406 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055895c-4335-4f84-aa13-cf1a2aff5d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:38.886759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ed51b-2c1b-44d4-af5e-85cbd77ff02f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:38.888188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-448ed51b-2c1b-44d4-af5e-85cbd77ff02f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:38.903660 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-5055895c-4335-4f84-aa13-cf1a2aff5d5c None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:38.905141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5055895c-4335-4f84-aa13-cf1a2aff5d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:38.919739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:38.941734 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:38.960950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ed51b-2c1b-44d4-af5e-85cbd77ff02f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:38.966355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607bca2-bd1b-4710-8f88-1ffe296f97bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:38.968069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607bca2-bd1b-4710-8f88-1ffe296f97bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:38.968668 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607bca2-bd1b-4710-8f88-1ffe296f97bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:38.969412 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607bca2-bd1b-4710-8f88-1ffe296f97bc admin admin] PATH_INFO: `/v3/projects/80edc9755c3949c1bb3fb47cb40c46da` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:38.971283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607bca2-bd1b-4710-8f88-1ffe296f97bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=80edc9755c3949c1bb3fb47cb40c46da)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:38.973510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607bca2-bd1b-4710-8f88-1ffe296f97bc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:38.974619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1024/2065] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:38.984320 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055895c-4335-4f84-aa13-cf1a2aff5d5c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:38.985692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5055895c-4335-4f84-aa13-cf1a2aff5d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:39.022321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0607bca2-bd1b-4710-8f88-1ffe296f97bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80edc9755c3949c1bb3fb47cb40c46da', 'request_id': 'req-0607bca2-bd1b-4710-8f88-1ffe296f97bc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:39.028961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0607bca2-bd1b-4710-8f88-1ffe296f97bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80edc9755c3949c1bb3fb47cb40c46da', 'request_id': 'req-0607bca2-bd1b-4710-8f88-1ffe296f97bc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:39.061034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0607bca2-bd1b-4710-8f88-1ffe296f97bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80edc9755c3949c1bb3fb47cb40c46da', 'request_id': 'req-0607bca2-bd1b-4710-8f88-1ffe296f97bc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:39.072135 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055895c-4335-4f84-aa13-cf1a2aff5d5c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:39.074878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0607bca2-bd1b-4710-8f88-1ffe296f97bc admin admin] The token cache is being invalidate because project 80edc9755c3949c1bb3fb47cb40c46da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:39.075498 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0607bca2-bd1b-4710-8f88-1ffe296f97bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:39.076281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0607bca2-bd1b-4710-8f88-1ffe296f97bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:39.078046 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1042/2066] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:38 2022] DELETE /identity/v3/projects/80edc9755c3949c1bb3fb47cb40c46da => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:39.084893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e62a7d-6dc2-4a7d-8dd2-1dca64de8921 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:39.085538 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e62a7d-6dc2-4a7d-8dd2-1dca64de8921 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:39.085669 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e62a7d-6dc2-4a7d-8dd2-1dca64de8921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:39.109918 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a0e62a7d-6dc2-4a7d-8dd2-1dca64de8921 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:39.110812 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a0e62a7d-6dc2-4a7d-8dd2-1dca64de8921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:39.131609 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a2e2d-9850-4c1f-bf73-2e5c2b374094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:39.132270 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a2e2d-9850-4c1f-bf73-2e5c2b374094 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:39.132562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a2e2d-9850-4c1f-bf73-2e5c2b374094 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:39.132840 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a2e2d-9850-4c1f-bf73-2e5c2b374094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:39.134878 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-231a2e2d-9850-4c1f-bf73-2e5c2b374094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:39.178908 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1043/2067] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:39.188141 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3fd16-58de-4be4-bee4-56c76d4ddf49 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:39.188422 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3fd16-58de-4be4-bee4-56c76d4ddf49 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:39.188721 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3fd16-58de-4be4-bee4-56c76d4ddf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:39.216241 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-39a3fd16-58de-4be4-bee4-56c76d4ddf49 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:39.216964 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a2e2d-9850-4c1f-bf73-2e5c2b374094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:39.217453 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-39a3fd16-58de-4be4-bee4-56c76d4ddf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:39.219693 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a2e2d-9850-4c1f-bf73-2e5c2b374094 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:39.231617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1025/2068] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:32:39.253592 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1044/2069] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:39.257525 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a2e2d-9850-4c1f-bf73-2e5c2b374094 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:39.270638 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a2e2d-9850-4c1f-bf73-2e5c2b374094 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:39.276311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e41ef9-e37b-417d-9eef-afeb4815c245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:39.276912 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e41ef9-e37b-417d-9eef-afeb4815c245 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:39.277221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e41ef9-e37b-417d-9eef-afeb4815c245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:39.277470 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e41ef9-e37b-417d-9eef-afeb4815c245 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:39.278205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e41ef9-e37b-417d-9eef-afeb4815c245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:32:39.278514 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e41ef9-e37b-417d-9eef-afeb4815c245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:39.280177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e41ef9-e37b-417d-9eef-afeb4815c245 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:39.297014 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1026/2070] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:32:39.301580 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3fd16-58de-4be4-bee4-56c76d4ddf49 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:39.311679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3fd16-58de-4be4-bee4-56c76d4ddf49 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:39.318259 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944148f7-d528-4793-ab40-e3508100713f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:39.319260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944148f7-d528-4793-ab40-e3508100713f admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:39.319605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944148f7-d528-4793-ab40-e3508100713f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:39.320069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944148f7-d528-4793-ab40-e3508100713f admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:39.320715 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944148f7-d528-4793-ab40-e3508100713f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:39.322962 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944148f7-d528-4793-ab40-e3508100713f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:39.361270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1045/2071] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:39 2022] POST /identity/v3/projects => generated 357 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:39.365794 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e41ef9-e37b-417d-9eef-afeb4815c245 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:39.378088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e41ef9-e37b-417d-9eef-afeb4815c245 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:39.392177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:39.512673 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8d47d-6a0d-4eeb-8657-045bbcbd2765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:39.515459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8d47d-6a0d-4eeb-8657-045bbcbd2765 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:39.516562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8d47d-6a0d-4eeb-8657-045bbcbd2765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:39.518236 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8d47d-6a0d-4eeb-8657-045bbcbd2765 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:39.523188 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8d47d-6a0d-4eeb-8657-045bbcbd2765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:39.529146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8d47d-6a0d-4eeb-8657-045bbcbd2765 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:39.576997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1027/2072] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:39 2022] POST /identity/v3/users => generated 279 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:32:39.582302 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944148f7-d528-4793-ab40-e3508100713f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:39.598440 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944148f7-d528-4793-ab40-e3508100713f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:39.605432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89de3f-5599-47d7-8343-bb8c97c3506f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:39.606377 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89de3f-5599-47d7-8343-bb8c97c3506f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:39.606990 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89de3f-5599-47d7-8343-bb8c97c3506f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:39.607359 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89de3f-5599-47d7-8343-bb8c97c3506f admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:39.608334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89de3f-5599-47d7-8343-bb8c97c3506f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:39.610107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89de3f-5599-47d7-8343-bb8c97c3506f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:39.619799 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8d47d-6a0d-4eeb-8657-045bbcbd2765 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:39.622102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-82d8d47d-6a0d-4eeb-8657-045bbcbd2765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:39.632994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1046/2073] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:39.633705 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89de3f-5599-47d7-8343-bb8c97c3506f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:39.649691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89de3f-5599-47d7-8343-bb8c97c3506f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:39.664949 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8d47d-6a0d-4eeb-8657-045bbcbd2765 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:39.670679 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7da80-4180-49b2-be98-47661c55d7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:39.671458 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbd7a3-9be1-42a2-985b-fe8f1e666127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:39.671820 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7da80-4180-49b2-be98-47661c55d7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:39.672186 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7da80-4180-49b2-be98-47661c55d7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:39.672286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbd7a3-9be1-42a2-985b-fe8f1e666127 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:39.672505 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbd7a3-9be1-42a2-985b-fe8f1e666127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:39.672783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbd7a3-9be1-42a2-985b-fe8f1e666127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:39.673247 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7da80-4180-49b2-be98-47661c55d7f7 admin admin] PATH_INFO: `/v3/projects/a710ac09e2ef45e6903d9541309155ca` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:39.673552 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbd7a3-9be1-42a2-985b-fe8f1e666127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:39.674829 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7da80-4180-49b2-be98-47661c55d7f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a710ac09e2ef45e6903d9541309155ca)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:39.677182 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7da80-4180-49b2-be98-47661c55d7f7 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:39.686800 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbd7a3-9be1-42a2-985b-fe8f1e666127 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:39.707564 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1047/2074] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:32:39.713238 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbd7a3-9be1-42a2-985b-fe8f1e666127 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:39.730926 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbd7a3-9be1-42a2-985b-fe8f1e666127 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:39.737901 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83549c76-e900-4da2-b528-5ba65414a050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:39.739034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83549c76-e900-4da2-b528-5ba65414a050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:39.739412 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83549c76-e900-4da2-b528-5ba65414a050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:39.739785 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83549c76-e900-4da2-b528-5ba65414a050 admin admin] PATH_INFO: `/v3/projects/d8d29c8c196e439eb6881b67d24e872c/users/cdce8bd21fee472bab8b9ff92a35f3d0/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:39.765139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-17a7da80-4180-49b2-be98-47661c55d7f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a710ac09e2ef45e6903d9541309155ca', 'request_id': 'req-17a7da80-4180-49b2-be98-47661c55d7f7'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:39.776286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83549c76-e900-4da2-b528-5ba65414a050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8d29c8c196e439eb6881b67d24e872c, user_id=cdce8bd21fee472bab8b9ff92a35f3d0, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:39.777097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-17a7da80-4180-49b2-be98-47661c55d7f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a710ac09e2ef45e6903d9541309155ca', 'request_id': 'req-17a7da80-4180-49b2-be98-47661c55d7f7'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:39.779339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83549c76-e900-4da2-b528-5ba65414a050 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:39.798435 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-17a7da80-4180-49b2-be98-47661c55d7f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a710ac09e2ef45e6903d9541309155ca', 'request_id': 'req-17a7da80-4180-49b2-be98-47661c55d7f7'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:39.809945 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1048/2075] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:39 2022] PUT /identity/v3/projects/d8d29c8c196e439eb6881b67d24e872c/users/cdce8bd21fee472bab8b9ff92a35f3d0/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:39.820759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daaeb3-268c-4f58-a3c8-800979398dac None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:39.822864 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daaeb3-268c-4f58-a3c8-800979398dac None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:39.824165 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daaeb3-268c-4f58-a3c8-800979398dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:39.828342 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-17a7da80-4180-49b2-be98-47661c55d7f7 admin admin] The token cache is being invalidate because project a710ac09e2ef45e6903d9541309155ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:39.828836 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-17a7da80-4180-49b2-be98-47661c55d7f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:39.829739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-17a7da80-4180-49b2-be98-47661c55d7f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:39.835024 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1028/2076] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:39 2022] DELETE /identity/v3/projects/a710ac09e2ef45e6903d9541309155ca => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:39.840542 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7da80-4180-49b2-be98-47661c55d7f7 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:39.841365 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:39.847765 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-17a7da80-4180-49b2-be98-47661c55d7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:39.885069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-52daaeb3-268c-4f58-a3c8-800979398dac None None] MFA Rules not processed for user `cdce8bd21fee472bab8b9ff92a35f3d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:39.887614 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-52daaeb3-268c-4f58-a3c8-800979398dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:39.981104 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7da80-4180-49b2-be98-47661c55d7f7 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:40.009907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1049/2077] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:39 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:40.010913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daaeb3-268c-4f58-a3c8-800979398dac None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:40.012600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-52daaeb3-268c-4f58-a3c8-800979398dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:40.024527 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:40.064108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efadf3b-3d17-4802-8156-544b57f147c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:40.065685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efadf3b-3d17-4802-8156-544b57f147c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:40.065971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efadf3b-3d17-4802-8156-544b57f147c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:40.066386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efadf3b-3d17-4802-8156-544b57f147c9 admin admin] PATH_INFO: `/v3/users/9cc4d2c588314443a8120f72cfc51100` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:40.067687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efadf3b-3d17-4802-8156-544b57f147c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc4d2c588314443a8120f72cfc51100)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:40.069614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efadf3b-3d17-4802-8156-544b57f147c9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:40.097372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daaeb3-268c-4f58-a3c8-800979398dac None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:40.103292 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06cdb7-e446-4281-97b8-385815e7915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:40.104107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06cdb7-e446-4281-97b8-385815e7915f admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:40.104374 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06cdb7-e446-4281-97b8-385815e7915f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:40.104689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06cdb7-e446-4281-97b8-385815e7915f admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:40.105476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06cdb7-e446-4281-97b8-385815e7915f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:40.108289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06cdb7-e446-4281-97b8-385815e7915f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:40.128325 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3efadf3b-3d17-4802-8156-544b57f147c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc4d2c588314443a8120f72cfc51100'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:40.138114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3efadf3b-3d17-4802-8156-544b57f147c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc4d2c588314443a8120f72cfc51100'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:40.141467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1050/2078] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:40 2022] POST /identity/v3/projects => generated 357 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:40.142460 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06cdb7-e446-4281-97b8-385815e7915f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:40.155609 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3efadf3b-3d17-4802-8156-544b57f147c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc4d2c588314443a8120f72cfc51100'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:40.164183 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3efadf3b-3d17-4802-8156-544b57f147c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc4d2c588314443a8120f72cfc51100'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:40.165057 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3efadf3b-3d17-4802-8156-544b57f147c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc4d2c588314443a8120f72cfc51100'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:40.172772 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1029/2079] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:39 2022] DELETE /identity/v3/users/9cc4d2c588314443a8120f72cfc51100 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:40.222119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06cdb7-e446-4281-97b8-385815e7915f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:40.244801 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:40.292537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b84a26-6156-4f0e-9f90-0983b633e1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:40.293458 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b84a26-6156-4f0e-9f90-0983b633e1cd admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:40.293738 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b84a26-6156-4f0e-9f90-0983b633e1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:40.294013 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b84a26-6156-4f0e-9f90-0983b633e1cd admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:40.294827 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b84a26-6156-4f0e-9f90-0983b633e1cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:40.296803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b84a26-6156-4f0e-9f90-0983b633e1cd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:40.335523 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1051/2080] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:40 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:32:40.339645 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efadf3b-3d17-4802-8156-544b57f147c9 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:40.341198 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3efadf3b-3d17-4802-8156-544b57f147c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:40.356971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efadf3b-3d17-4802-8156-544b57f147c9 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:40.364583 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9325f7-503d-4f68-92ec-a2cee84bc339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:40.375648 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9325f7-503d-4f68-92ec-a2cee84bc339 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:40.375947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9325f7-503d-4f68-92ec-a2cee84bc339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:40.376231 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9325f7-503d-4f68-92ec-a2cee84bc339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:40.377576 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9325f7-503d-4f68-92ec-a2cee84bc339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:40.381254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9325f7-503d-4f68-92ec-a2cee84bc339 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:40.394256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1030/2081] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:32:40.399396 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b84a26-6156-4f0e-9f90-0983b633e1cd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:40.411756 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b84a26-6156-4f0e-9f90-0983b633e1cd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:40.416701 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d057f2-323a-4e75-a03f-d216aea779c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:40.417816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d057f2-323a-4e75-a03f-d216aea779c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:40.418221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d057f2-323a-4e75-a03f-d216aea779c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:40.418627 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d057f2-323a-4e75-a03f-d216aea779c1 admin admin] PATH_INFO: `/v3/projects/9c6d15ff96e54837b2dbb2dd56cce183/users/96ee316a9dc2410f845aca47811ddeb4/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:40.438292 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d057f2-323a-4e75-a03f-d216aea779c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6d15ff96e54837b2dbb2dd56cce183, user_id=96ee316a9dc2410f845aca47811ddeb4, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:40.443206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d057f2-323a-4e75-a03f-d216aea779c1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:40.462042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1052/2082] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:40 2022] PUT /identity/v3/projects/9c6d15ff96e54837b2dbb2dd56cce183/users/96ee316a9dc2410f845aca47811ddeb4/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:40.466118 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9325f7-503d-4f68-92ec-a2cee84bc339 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:40.479173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9325f7-503d-4f68-92ec-a2cee84bc339 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:40.499749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d057f2-323a-4e75-a03f-d216aea779c1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:40.503984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c8d057f2-323a-4e75-a03f-d216aea779c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:40.562786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8d3d5-adf7-4f84-852a-ca5c7d108356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:40.563472 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8d3d5-adf7-4f84-852a-ca5c7d108356 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:40.563758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8d3d5-adf7-4f84-852a-ca5c7d108356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:40.564036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8d3d5-adf7-4f84-852a-ca5c7d108356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:40.565413 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8d3d5-adf7-4f84-852a-ca5c7d108356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:40.567390 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8d3d5-adf7-4f84-852a-ca5c7d108356 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:40.582622 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1031/2083] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:32:40.583952 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8d3d5-adf7-4f84-852a-ca5c7d108356 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:40.608289 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8d3d5-adf7-4f84-852a-ca5c7d108356 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:40.620600 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae122663-0a8c-4b6c-990a-64edf851740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:40.622016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae122663-0a8c-4b6c-990a-64edf851740a admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:40.622482 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae122663-0a8c-4b6c-990a-64edf851740a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:40.622956 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae122663-0a8c-4b6c-990a-64edf851740a admin admin] PATH_INFO: `/v3/projects/9c6d15ff96e54837b2dbb2dd56cce183/users/96ee316a9dc2410f845aca47811ddeb4/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:40.625318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae122663-0a8c-4b6c-990a-64edf851740a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6d15ff96e54837b2dbb2dd56cce183, user_id=96ee316a9dc2410f845aca47811ddeb4, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:40.629235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae122663-0a8c-4b6c-990a-64edf851740a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:40.638112 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d057f2-323a-4e75-a03f-d216aea779c1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:40.643465 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1032/2084] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:40 2022] PUT /identity/v3/projects/9c6d15ff96e54837b2dbb2dd56cce183/users/96ee316a9dc2410f845aca47811ddeb4/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:40.657584 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61816ea-e3ec-4051-88bc-0b85e11d9c6c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:40.658611 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61816ea-e3ec-4051-88bc-0b85e11d9c6c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:40.659073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61816ea-e3ec-4051-88bc-0b85e11d9c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:40.697732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d61816ea-e3ec-4051-88bc-0b85e11d9c6c None None] MFA Rules not processed for user `96ee316a9dc2410f845aca47811ddeb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:40.702009 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d61816ea-e3ec-4051-88bc-0b85e11d9c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:40.719801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:40.734574 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4610a6f-d29f-4015-8599-7080f5ae7509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:40.736029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4610a6f-d29f-4015-8599-7080f5ae7509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:40.736613 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4610a6f-d29f-4015-8599-7080f5ae7509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:40.737039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4610a6f-d29f-4015-8599-7080f5ae7509 admin admin] PATH_INFO: `/v3/projects/eb6cebfbe6974cecac6213455ee18ab0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:40.738613 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4610a6f-d29f-4015-8599-7080f5ae7509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb6cebfbe6974cecac6213455ee18ab0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:40.741927 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4610a6f-d29f-4015-8599-7080f5ae7509 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:40.808924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:40.813100 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1033/2085] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:40 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:40.820791 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a4610a6f-d29f-4015-8599-7080f5ae7509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb6cebfbe6974cecac6213455ee18ab0', 'request_id': 'req-a4610a6f-d29f-4015-8599-7080f5ae7509'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:40.826138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61816ea-e3ec-4051-88bc-0b85e11d9c6c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:40.827563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d61816ea-e3ec-4051-88bc-0b85e11d9c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:40.831549 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a4610a6f-d29f-4015-8599-7080f5ae7509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb6cebfbe6974cecac6213455ee18ab0', 'request_id': 'req-a4610a6f-d29f-4015-8599-7080f5ae7509'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:40.841326 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a4610a6f-d29f-4015-8599-7080f5ae7509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb6cebfbe6974cecac6213455ee18ab0', 'request_id': 'req-a4610a6f-d29f-4015-8599-7080f5ae7509'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:40.856218 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a4610a6f-d29f-4015-8599-7080f5ae7509 admin admin] The token cache is being invalidate because project eb6cebfbe6974cecac6213455ee18ab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:40.856510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a4610a6f-d29f-4015-8599-7080f5ae7509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:40.857358 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a4610a6f-d29f-4015-8599-7080f5ae7509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:40.863234 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1053/2086] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:40 2022] DELETE /identity/v3/projects/eb6cebfbe6974cecac6213455ee18ab0 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:40.865024 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd002706-31be-45b4-8955-a95b98d455b1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:40.865582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd002706-31be-45b4-8955-a95b98d455b1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:40.865879 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd002706-31be-45b4-8955-a95b98d455b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:40.893522 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fd002706-31be-45b4-8955-a95b98d455b1 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:40.894790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fd002706-31be-45b4-8955-a95b98d455b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:40.897186 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61816ea-e3ec-4051-88bc-0b85e11d9c6c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:40.954455 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12ce2d-a7f6-41df-816a-cadd556796a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:40.955583 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12ce2d-a7f6-41df-816a-cadd556796a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:40.955805 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12ce2d-a7f6-41df-816a-cadd556796a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:40.956082 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12ce2d-a7f6-41df-816a-cadd556796a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:40.958118 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fb12ce2d-a7f6-41df-816a-cadd556796a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:40.974119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1054/2087] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:40.985386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd25a80-e3c5-43c8-b5a5-8386f837d52f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:40.985911 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd25a80-e3c5-43c8-b5a5-8386f837d52f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:40.986959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd25a80-e3c5-43c8-b5a5-8386f837d52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:41.016697 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1fd25a80-e3c5-43c8-b5a5-8386f837d52f None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:41.019109 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1fd25a80-e3c5-43c8-b5a5-8386f837d52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:41.030851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1055/2088] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:41.039339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd25a80-e3c5-43c8-b5a5-8386f837d52f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:41.055403 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd25a80-e3c5-43c8-b5a5-8386f837d52f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:41.060601 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c71c1-a3f4-4e1c-8878-30b66707c613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:41.061443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c71c1-a3f4-4e1c-8878-30b66707c613 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:41.061729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c71c1-a3f4-4e1c-8878-30b66707c613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:41.062555 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c71c1-a3f4-4e1c-8878-30b66707c613 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:41.062862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c71c1-a3f4-4e1c-8878-30b66707c613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:32:41.063219 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c71c1-a3f4-4e1c-8878-30b66707c613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:41.065259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12ce2d-a7f6-41df-816a-cadd556796a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:41.065599 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c71c1-a3f4-4e1c-8878-30b66707c613 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:41.066914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12ce2d-a7f6-41df-816a-cadd556796a5 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:41.083376 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1056/2089] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:32:41.085361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c71c1-a3f4-4e1c-8878-30b66707c613 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:41.107160 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c71c1-a3f4-4e1c-8878-30b66707c613 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:41.119083 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1034/2090] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:40 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:32:41.134634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad690f-dd19-4413-9dd1-7a6d84424eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:41.135351 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad690f-dd19-4413-9dd1-7a6d84424eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:41.135639 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad690f-dd19-4413-9dd1-7a6d84424eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:41.135917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad690f-dd19-4413-9dd1-7a6d84424eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:41.136613 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad690f-dd19-4413-9dd1-7a6d84424eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:41.138564 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad690f-dd19-4413-9dd1-7a6d84424eb6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:41.199338 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1057/2091] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:41 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:41.200727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12ce2d-a7f6-41df-816a-cadd556796a5 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:41.212893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12ce2d-a7f6-41df-816a-cadd556796a5 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:41.227501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:41.256028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad690f-dd19-4413-9dd1-7a6d84424eb6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:41.257947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4cad690f-dd19-4413-9dd1-7a6d84424eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:41.309672 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5ac66-0d1e-42d1-8677-3196e047f501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:41.310089 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5ac66-0d1e-42d1-8677-3196e047f501 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:41.310403 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5ac66-0d1e-42d1-8677-3196e047f501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:41.310620 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5ac66-0d1e-42d1-8677-3196e047f501 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:41.311361 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5ac66-0d1e-42d1-8677-3196e047f501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:41.313258 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5ac66-0d1e-42d1-8677-3196e047f501 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:41.331765 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad690f-dd19-4413-9dd1-7a6d84424eb6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:41.346025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1035/2092] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:41 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:32:41.347024 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479491f-68ad-4227-9fe8-5dde81aadb3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:41.347719 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479491f-68ad-4227-9fe8-5dde81aadb3e service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:41.348000 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479491f-68ad-4227-9fe8-5dde81aadb3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:41.348271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479491f-68ad-4227-9fe8-5dde81aadb3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:41.350127 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5ac66-0d1e-42d1-8677-3196e047f501 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:41.350546 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5479491f-68ad-4227-9fe8-5dde81aadb3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:41.364073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5ac66-0d1e-42d1-8677-3196e047f501 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:41.368771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49c197-6580-4e76-bec6-3b5bbcc1eb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:41.369422 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49c197-6580-4e76-bec6-3b5bbcc1eb5f admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:41.369702 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49c197-6580-4e76-bec6-3b5bbcc1eb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:41.369973 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49c197-6580-4e76-bec6-3b5bbcc1eb5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:41.370687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49c197-6580-4e76-bec6-3b5bbcc1eb5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:41.372316 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49c197-6580-4e76-bec6-3b5bbcc1eb5f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:41.389681 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1036/2093] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:41.390647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49c197-6580-4e76-bec6-3b5bbcc1eb5f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:41.402018 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49c197-6580-4e76-bec6-3b5bbcc1eb5f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:41.405779 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:41.409996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477e898-76ca-4dcd-a462-b1f484e14aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:41.410672 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477e898-76ca-4dcd-a462-b1f484e14aff admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:41.411359 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477e898-76ca-4dcd-a462-b1f484e14aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:41.411644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477e898-76ca-4dcd-a462-b1f484e14aff admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:41.413454 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477e898-76ca-4dcd-a462-b1f484e14aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:41.416475 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477e898-76ca-4dcd-a462-b1f484e14aff admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:41.430241 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1037/2094] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:41.434442 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477e898-76ca-4dcd-a462-b1f484e14aff admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:41.435338 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479491f-68ad-4227-9fe8-5dde81aadb3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:41.436808 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479491f-68ad-4227-9fe8-5dde81aadb3e service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:41.446333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477e898-76ca-4dcd-a462-b1f484e14aff admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:41.449784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1058/2095] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:41 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:41.452514 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234d7cd-88e5-4fda-a375-03fdd35bfd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:41.453680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234d7cd-88e5-4fda-a375-03fdd35bfd69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:41.454065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234d7cd-88e5-4fda-a375-03fdd35bfd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:41.454291 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234d7cd-88e5-4fda-a375-03fdd35bfd69 admin admin] PATH_INFO: `/v3/projects/4c92164e9f6f4909ad3067024688ce0b/users/f5932ddaa6a34c6989047a40fcce9cd7/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:41.475156 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234d7cd-88e5-4fda-a375-03fdd35bfd69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c92164e9f6f4909ad3067024688ce0b, user_id=f5932ddaa6a34c6989047a40fcce9cd7, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:41.478226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234d7cd-88e5-4fda-a375-03fdd35bfd69 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:41.499445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1038/2096] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:41 2022] PUT /identity/v3/projects/4c92164e9f6f4909ad3067024688ce0b/users/f5932ddaa6a34c6989047a40fcce9cd7/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:41.518924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70248460-e0ce-49fb-b8a5-87ed2ce1950f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:41.519263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70248460-e0ce-49fb-b8a5-87ed2ce1950f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:41.519598 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70248460-e0ce-49fb-b8a5-87ed2ce1950f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:41.558095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-70248460-e0ce-49fb-b8a5-87ed2ce1950f None None] MFA Rules not processed for user `f5932ddaa6a34c6989047a40fcce9cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:41.559643 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-70248460-e0ce-49fb-b8a5-87ed2ce1950f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:41.650434 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1059/2097] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:41.654653 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234d7cd-88e5-4fda-a375-03fdd35bfd69 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:41.737440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234d7cd-88e5-4fda-a375-03fdd35bfd69 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:41.745128 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d10d57-9e40-4f43-bb6b-0c8b77e6fa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:41.745128 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d10d57-9e40-4f43-bb6b-0c8b77e6fa67 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:41.745128 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d10d57-9e40-4f43-bb6b-0c8b77e6fa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:41.745128 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d10d57-9e40-4f43-bb6b-0c8b77e6fa67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:41.745447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d10d57-9e40-4f43-bb6b-0c8b77e6fa67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:41.746465 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d10d57-9e40-4f43-bb6b-0c8b77e6fa67 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:41.776226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1039/2098] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:41 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:41.780837 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70248460-e0ce-49fb-b8a5-87ed2ce1950f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:41.791949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70248460-e0ce-49fb-b8a5-87ed2ce1950f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:41.858772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03683aa9-987f-418c-8b9a-041b5e1166b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:41.859473 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03683aa9-987f-418c-8b9a-041b5e1166b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:41.859757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03683aa9-987f-418c-8b9a-041b5e1166b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:41.860044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03683aa9-987f-418c-8b9a-041b5e1166b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:41.860750 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03683aa9-987f-418c-8b9a-041b5e1166b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:41.863291 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03683aa9-987f-418c-8b9a-041b5e1166b5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:41.891039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1060/2099] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:41 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:41.891523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d10d57-9e40-4f43-bb6b-0c8b77e6fa67 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:41.903624 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d10d57-9e40-4f43-bb6b-0c8b77e6fa67 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:41.911281 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf9fe2-f87d-4b73-8b54-ccecce81d109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:41.912159 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf9fe2-f87d-4b73-8b54-ccecce81d109 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:41.912514 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf9fe2-f87d-4b73-8b54-ccecce81d109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:41.912899 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf9fe2-f87d-4b73-8b54-ccecce81d109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:41.913703 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf9fe2-f87d-4b73-8b54-ccecce81d109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:41.915619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf9fe2-f87d-4b73-8b54-ccecce81d109 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:41.928805 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1040/2100] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:41.933785 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03683aa9-987f-418c-8b9a-041b5e1166b5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:41.947326 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03683aa9-987f-418c-8b9a-041b5e1166b5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:41.952569 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcb24c-c5e7-4f68-bbeb-8692de6eaf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:41.953602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcb24c-c5e7-4f68-bbeb-8692de6eaf29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:41.954019 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcb24c-c5e7-4f68-bbeb-8692de6eaf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:41.954306 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcb24c-c5e7-4f68-bbeb-8692de6eaf29 admin admin] PATH_INFO: `/v3/projects/3adc21a3c851404384625134a7f27ea9/users/5b3ab51b89f641db8798f268579d7309/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:41.972225 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcb24c-c5e7-4f68-bbeb-8692de6eaf29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3adc21a3c851404384625134a7f27ea9, user_id=5b3ab51b89f641db8798f268579d7309, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:41.975346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcb24c-c5e7-4f68-bbeb-8692de6eaf29 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:41.998031 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1061/2101] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:41 2022] PUT /identity/v3/projects/3adc21a3c851404384625134a7f27ea9/users/5b3ab51b89f641db8798f268579d7309/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:42.002437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf9fe2-f87d-4b73-8b54-ccecce81d109 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:42.012526 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf9fe2-f87d-4b73-8b54-ccecce81d109 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:42.044144 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:42.075908 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1c483-9c4c-48d1-ac0e-171f5f7729b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:42.076588 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1c483-9c4c-48d1-ac0e-171f5f7729b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:42.076872 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1c483-9c4c-48d1-ac0e-171f5f7729b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:42.077148 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1c483-9c4c-48d1-ac0e-171f5f7729b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:42.077881 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1c483-9c4c-48d1-ac0e-171f5f7729b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:42.079504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1c483-9c4c-48d1-ac0e-171f5f7729b3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:42.090838 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1041/2102] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:42.093910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcb24c-c5e7-4f68-bbeb-8692de6eaf29 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:42.105574 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcb24c-c5e7-4f68-bbeb-8692de6eaf29 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:42.110285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d763112-6937-40c8-8b94-19a61f78c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:42.111264 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d763112-6937-40c8-8b94-19a61f78c318 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:42.111545 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d763112-6937-40c8-8b94-19a61f78c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:42.111818 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d763112-6937-40c8-8b94-19a61f78c318 admin admin] PATH_INFO: `/v3/projects/3adc21a3c851404384625134a7f27ea9/users/5b3ab51b89f641db8798f268579d7309/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:42.113862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d763112-6937-40c8-8b94-19a61f78c318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3adc21a3c851404384625134a7f27ea9, user_id=5b3ab51b89f641db8798f268579d7309, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:42.116536 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d763112-6937-40c8-8b94-19a61f78c318 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:42.128111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1062/2103] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:42 2022] PUT /identity/v3/projects/3adc21a3c851404384625134a7f27ea9/users/5b3ab51b89f641db8798f268579d7309/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:42.138839 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6bda2-a180-4470-8fa7-da6e368dc69d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:42.139133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6bda2-a180-4470-8fa7-da6e368dc69d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:42.139413 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6bda2-a180-4470-8fa7-da6e368dc69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:42.179295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-27c6bda2-a180-4470-8fa7-da6e368dc69d None None] MFA Rules not processed for user `5b3ab51b89f641db8798f268579d7309`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:42.180642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-27c6bda2-a180-4470-8fa7-da6e368dc69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:42.265547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1042/2104] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:42.280068 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d763112-6937-40c8-8b94-19a61f78c318 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:42.310787 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:42.348008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d763112-6937-40c8-8b94-19a61f78c318 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:42.352306 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a13f51-7f90-4d85-a934-4600f54395c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:42.353520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a13f51-7f90-4d85-a934-4600f54395c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:42.353520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a13f51-7f90-4d85-a934-4600f54395c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:42.353765 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a13f51-7f90-4d85-a934-4600f54395c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:42.364615 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a13f51-7f90-4d85-a934-4600f54395c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:42.366274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a13f51-7f90-4d85-a934-4600f54395c9 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:42.377400 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1063/2105] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:42.508047 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6bda2-a180-4470-8fa7-da6e368dc69d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:42.574238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6bda2-a180-4470-8fa7-da6e368dc69d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:42.578835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c53ae-5a3d-4309-90db-e18f7f3ff2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:42.579732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c53ae-5a3d-4309-90db-e18f7f3ff2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:42.580019 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c53ae-5a3d-4309-90db-e18f7f3ff2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:42.580290 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c53ae-5a3d-4309-90db-e18f7f3ff2f5 admin admin] PATH_INFO: `/v3/users/f5932ddaa6a34c6989047a40fcce9cd7` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:42.581491 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c53ae-5a3d-4309-90db-e18f7f3ff2f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5932ddaa6a34c6989047a40fcce9cd7)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:42.583447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c53ae-5a3d-4309-90db-e18f7f3ff2f5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:42.630633 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b97c53ae-5a3d-4309-90db-e18f7f3ff2f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5932ddaa6a34c6989047a40fcce9cd7'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:42.637299 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b97c53ae-5a3d-4309-90db-e18f7f3ff2f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5932ddaa6a34c6989047a40fcce9cd7'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:42.638398 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:42.655528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b97c53ae-5a3d-4309-90db-e18f7f3ff2f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5932ddaa6a34c6989047a40fcce9cd7'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:42.663568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b97c53ae-5a3d-4309-90db-e18f7f3ff2f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5932ddaa6a34c6989047a40fcce9cd7'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:42.664502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b97c53ae-5a3d-4309-90db-e18f7f3ff2f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5932ddaa6a34c6989047a40fcce9cd7'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:42.674112 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1043/2106] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:42 2022] DELETE /identity/v3/users/f5932ddaa6a34c6989047a40fcce9cd7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:42.676766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1247fe-3c17-4fb7-93bd-a144aa79dbfb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:42.677057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1247fe-3c17-4fb7-93bd-a144aa79dbfb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:42.677391 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1247fe-3c17-4fb7-93bd-a144aa79dbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:42.700448 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4b1247fe-3c17-4fb7-93bd-a144aa79dbfb None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:42.701811 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4b1247fe-3c17-4fb7-93bd-a144aa79dbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:42.784214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1064/2107] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:42.795696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c53ae-5a3d-4309-90db-e18f7f3ff2f5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:42.797137 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b97c53ae-5a3d-4309-90db-e18f7f3ff2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:42.879605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c53ae-5a3d-4309-90db-e18f7f3ff2f5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:42.883826 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72bfd1-0440-4695-9706-4edaa02f0392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:42.884481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72bfd1-0440-4695-9706-4edaa02f0392 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:42.884764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72bfd1-0440-4695-9706-4edaa02f0392 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:42.885039 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72bfd1-0440-4695-9706-4edaa02f0392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:42.895765 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72bfd1-0440-4695-9706-4edaa02f0392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:42.897939 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72bfd1-0440-4695-9706-4edaa02f0392 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:42.910866 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1044/2108] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:43.233499 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1247fe-3c17-4fb7-93bd-a144aa79dbfb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:43.235031 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4b1247fe-3c17-4fb7-93bd-a144aa79dbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:43.247261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1247fe-3c17-4fb7-93bd-a144aa79dbfb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:43.252119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3cbfe-02b0-41be-adcd-503c7d0033bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:43.253006 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3cbfe-02b0-41be-adcd-503c7d0033bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:43.253281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3cbfe-02b0-41be-adcd-503c7d0033bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:43.253551 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3cbfe-02b0-41be-adcd-503c7d0033bd admin admin] PATH_INFO: `/v3/projects/4c92164e9f6f4909ad3067024688ce0b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:43.254762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3cbfe-02b0-41be-adcd-503c7d0033bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c92164e9f6f4909ad3067024688ce0b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:43.256678 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3cbfe-02b0-41be-adcd-503c7d0033bd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:43.311056 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-64a3cbfe-02b0-41be-adcd-503c7d0033bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c92164e9f6f4909ad3067024688ce0b', 'request_id': 'req-64a3cbfe-02b0-41be-adcd-503c7d0033bd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:43.318776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-64a3cbfe-02b0-41be-adcd-503c7d0033bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c92164e9f6f4909ad3067024688ce0b', 'request_id': 'req-64a3cbfe-02b0-41be-adcd-503c7d0033bd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:43.327785 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-64a3cbfe-02b0-41be-adcd-503c7d0033bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c92164e9f6f4909ad3067024688ce0b', 'request_id': 'req-64a3cbfe-02b0-41be-adcd-503c7d0033bd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:43.340351 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-64a3cbfe-02b0-41be-adcd-503c7d0033bd admin admin] The token cache is being invalidate because project 4c92164e9f6f4909ad3067024688ce0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:43.340642 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-64a3cbfe-02b0-41be-adcd-503c7d0033bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:43.341418 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-64a3cbfe-02b0-41be-adcd-503c7d0033bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:43.343067 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1065/2109] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:43 2022] DELETE /identity/v3/projects/4c92164e9f6f4909ad3067024688ce0b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:43.348536 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72bfd1-0440-4695-9706-4edaa02f0392 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:43.358775 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72bfd1-0440-4695-9706-4edaa02f0392 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:43.429590 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621febb-5942-4eda-8d4b-ccb2cf88051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:43.430883 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621febb-5942-4eda-8d4b-ccb2cf88051c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:43.431161 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621febb-5942-4eda-8d4b-ccb2cf88051c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:43.431436 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621febb-5942-4eda-8d4b-ccb2cf88051c admin admin] PATH_INFO: `/v3/users/5b3ab51b89f641db8798f268579d7309` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:43.434955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621febb-5942-4eda-8d4b-ccb2cf88051c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b3ab51b89f641db8798f268579d7309)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:43.437127 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621febb-5942-4eda-8d4b-ccb2cf88051c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:43.492586 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f621febb-5942-4eda-8d4b-ccb2cf88051c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b3ab51b89f641db8798f268579d7309'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:43.500655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f621febb-5942-4eda-8d4b-ccb2cf88051c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b3ab51b89f641db8798f268579d7309'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:43.515125 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f621febb-5942-4eda-8d4b-ccb2cf88051c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b3ab51b89f641db8798f268579d7309'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:43.520453 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:43.524531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f621febb-5942-4eda-8d4b-ccb2cf88051c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b3ab51b89f641db8798f268579d7309'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:43.526079 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f621febb-5942-4eda-8d4b-ccb2cf88051c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b3ab51b89f641db8798f268579d7309'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:43.534568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1045/2110] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:43 2022] DELETE /identity/v3/users/5b3ab51b89f641db8798f268579d7309 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:43.830611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3cbfe-02b0-41be-adcd-503c7d0033bd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:43.832096 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-64a3cbfe-02b0-41be-adcd-503c7d0033bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:43.845506 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3cbfe-02b0-41be-adcd-503c7d0033bd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:43.894088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:43.912244 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2abf7-f06c-4035-a030-7601e1facd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:43.913111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2abf7-f06c-4035-a030-7601e1facd6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:43.913674 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2abf7-f06c-4035-a030-7601e1facd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:43.914310 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2abf7-f06c-4035-a030-7601e1facd6e admin admin] PATH_INFO: `/v3/projects/3adc21a3c851404384625134a7f27ea9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:43.915708 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2abf7-f06c-4035-a030-7601e1facd6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3adc21a3c851404384625134a7f27ea9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:43.917754 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2abf7-f06c-4035-a030-7601e1facd6e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:43.966043 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-17e2abf7-f06c-4035-a030-7601e1facd6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3adc21a3c851404384625134a7f27ea9', 'request_id': 'req-17e2abf7-f06c-4035-a030-7601e1facd6e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:43.972674 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-17e2abf7-f06c-4035-a030-7601e1facd6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3adc21a3c851404384625134a7f27ea9', 'request_id': 'req-17e2abf7-f06c-4035-a030-7601e1facd6e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:43.980656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-17e2abf7-f06c-4035-a030-7601e1facd6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3adc21a3c851404384625134a7f27ea9', 'request_id': 'req-17e2abf7-f06c-4035-a030-7601e1facd6e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:43.992779 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-17e2abf7-f06c-4035-a030-7601e1facd6e admin admin] The token cache is being invalidate because project 3adc21a3c851404384625134a7f27ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:43.993075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-17e2abf7-f06c-4035-a030-7601e1facd6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:43.993731 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-17e2abf7-f06c-4035-a030-7601e1facd6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:43.995339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1066/2111] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:43 2022] DELETE /identity/v3/projects/3adc21a3c851404384625134a7f27ea9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:44.000337 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f084df-60e8-47ab-ab7a-f812916cdfaf None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:44.000823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f084df-60e8-47ab-ab7a-f812916cdfaf None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:44.000916 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f084df-60e8-47ab-ab7a-f812916cdfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:44.022375 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-19f084df-60e8-47ab-ab7a-f812916cdfaf None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:44.023708 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-19f084df-60e8-47ab-ab7a-f812916cdfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:44.102132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1046/2112] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:44.109538 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd8bdd-e073-4600-94ed-585ef4ac9405 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:44.109822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd8bdd-e073-4600-94ed-585ef4ac9405 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:44.110096 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd8bdd-e073-4600-94ed-585ef4ac9405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:44.133050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-53cd8bdd-e073-4600-94ed-585ef4ac9405 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:44.134404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-53cd8bdd-e073-4600-94ed-585ef4ac9405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:44.154855 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1067/2113] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:44.161596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f084df-60e8-47ab-ab7a-f812916cdfaf None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:44.193061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f084df-60e8-47ab-ab7a-f812916cdfaf None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:44.208329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596465d4-0efd-49dd-b5da-9eb9ff8beb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:44.209141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596465d4-0efd-49dd-b5da-9eb9ff8beb09 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:44.209423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596465d4-0efd-49dd-b5da-9eb9ff8beb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:44.209696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596465d4-0efd-49dd-b5da-9eb9ff8beb09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:44.210563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596465d4-0efd-49dd-b5da-9eb9ff8beb09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:32:44.210970 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596465d4-0efd-49dd-b5da-9eb9ff8beb09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:44.213123 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596465d4-0efd-49dd-b5da-9eb9ff8beb09 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:44.231448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1047/2114] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:32:44.232835 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd8bdd-e073-4600-94ed-585ef4ac9405 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:44.245017 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd8bdd-e073-4600-94ed-585ef4ac9405 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:44.263365 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed8751-5810-4cce-840a-2430397acaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:44.264200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed8751-5810-4cce-840a-2430397acaeb admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:44.264434 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed8751-5810-4cce-840a-2430397acaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:44.264669 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed8751-5810-4cce-840a-2430397acaeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:44.265423 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed8751-5810-4cce-840a-2430397acaeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:44.267712 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed8751-5810-4cce-840a-2430397acaeb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:44.308714 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1068/2115] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:44 2022] POST /identity/v3/projects => generated 407 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:32:44.314358 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596465d4-0efd-49dd-b5da-9eb9ff8beb09 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:44.337586 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596465d4-0efd-49dd-b5da-9eb9ff8beb09 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:44.416433 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9870d-b8b0-4edc-ae97-24bf0dfac2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:44.417113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9870d-b8b0-4edc-ae97-24bf0dfac2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:44.417425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9870d-b8b0-4edc-ae97-24bf0dfac2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:44.417821 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9870d-b8b0-4edc-ae97-24bf0dfac2f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:44.419044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9870d-b8b0-4edc-ae97-24bf0dfac2f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:44.421558 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9870d-b8b0-4edc-ae97-24bf0dfac2f1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:44.450620 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1048/2116] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:44 2022] POST /identity/v3/users => generated 304 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:44.451906 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed8751-5810-4cce-840a-2430397acaeb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:44.465611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed8751-5810-4cce-840a-2430397acaeb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:44.470359 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fe7f9-8b86-45b6-ab20-b145e2dd451a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:44.471074 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fe7f9-8b86-45b6-ab20-b145e2dd451a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:44.471346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fe7f9-8b86-45b6-ab20-b145e2dd451a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:44.471601 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fe7f9-8b86-45b6-ab20-b145e2dd451a admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:44.472320 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fe7f9-8b86-45b6-ab20-b145e2dd451a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:44.477416 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fe7f9-8b86-45b6-ab20-b145e2dd451a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:44.489255 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1069/2117] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:44.493340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9870d-b8b0-4edc-ae97-24bf0dfac2f1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:44.504837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9870d-b8b0-4edc-ae97-24bf0dfac2f1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:44.509725 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c665cf-45b7-409d-882a-05b56749e07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:44.510437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c665cf-45b7-409d-882a-05b56749e07d admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:44.510699 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c665cf-45b7-409d-882a-05b56749e07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:44.511011 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c665cf-45b7-409d-882a-05b56749e07d admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:44.511835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c665cf-45b7-409d-882a-05b56749e07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:44.513365 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c665cf-45b7-409d-882a-05b56749e07d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:44.524774 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1049/2118] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:32:44.529290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fe7f9-8b86-45b6-ab20-b145e2dd451a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:44.541021 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fe7f9-8b86-45b6-ab20-b145e2dd451a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:44.545913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1fcf8-5d61-496a-899a-5631dd97e271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:44.546828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1fcf8-5d61-496a-899a-5631dd97e271 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:44.547112 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1fcf8-5d61-496a-899a-5631dd97e271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:44.547382 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1fcf8-5d61-496a-899a-5631dd97e271 admin admin] PATH_INFO: `/v3/projects/944287727eb4456bacc7bc99036a2e80/users/a76e42e901164464b3b0fa30881dd01d/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:44.563598 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1fcf8-5d61-496a-899a-5631dd97e271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=944287727eb4456bacc7bc99036a2e80, user_id=a76e42e901164464b3b0fa30881dd01d, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:44.566655 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1fcf8-5d61-496a-899a-5631dd97e271 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:44.590777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1070/2119] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:44 2022] PUT /identity/v3/projects/944287727eb4456bacc7bc99036a2e80/users/a76e42e901164464b3b0fa30881dd01d/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:44.602948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31779f2-cfe8-494c-a321-a2b31fb3f9e8 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:44.603243 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31779f2-cfe8-494c-a321-a2b31fb3f9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:44.603581 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31779f2-cfe8-494c-a321-a2b31fb3f9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:44.638530 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-f31779f2-cfe8-494c-a321-a2b31fb3f9e8 None None] MFA Rules not processed for user `a76e42e901164464b3b0fa30881dd01d`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:44.640196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f31779f2-cfe8-494c-a321-a2b31fb3f9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:44.709781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:44.730508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1050/2120] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:44.735128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1fcf8-5d61-496a-899a-5631dd97e271 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:44.810962 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1fcf8-5d61-496a-899a-5631dd97e271 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:44.815763 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a853f85-28dc-40cd-92d7-63ff3d1701cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:44.816421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a853f85-28dc-40cd-92d7-63ff3d1701cc admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:44.816706 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a853f85-28dc-40cd-92d7-63ff3d1701cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:44.816998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a853f85-28dc-40cd-92d7-63ff3d1701cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:44.817700 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a853f85-28dc-40cd-92d7-63ff3d1701cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:44.819853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a853f85-28dc-40cd-92d7-63ff3d1701cc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:44.840653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:44.850823 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1071/2121] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:44 2022] POST /identity/v3/projects => generated 407 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:44.853660 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31779f2-cfe8-494c-a321-a2b31fb3f9e8 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:44.865630 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31779f2-cfe8-494c-a321-a2b31fb3f9e8 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:44.928792 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbf9ff-a591-4a12-bcc9-8a95a7ccd174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:44.929491 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbf9ff-a591-4a12-bcc9-8a95a7ccd174 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:44.929775 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbf9ff-a591-4a12-bcc9-8a95a7ccd174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:44.930138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbf9ff-a591-4a12-bcc9-8a95a7ccd174 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:44.931166 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbf9ff-a591-4a12-bcc9-8a95a7ccd174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:44.933289 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbf9ff-a591-4a12-bcc9-8a95a7ccd174 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:44.953596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1051/2122] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:44 2022] POST /identity/v3/users => generated 310 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:32:44.958388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a853f85-28dc-40cd-92d7-63ff3d1701cc admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:44.968964 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a853f85-28dc-40cd-92d7-63ff3d1701cc admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:44.974288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894abf3f-0139-4b15-b1f7-c92a9553db12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:44.974995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894abf3f-0139-4b15-b1f7-c92a9553db12 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:44.975278 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894abf3f-0139-4b15-b1f7-c92a9553db12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:44.975556 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894abf3f-0139-4b15-b1f7-c92a9553db12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:44.976406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894abf3f-0139-4b15-b1f7-c92a9553db12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:44.978081 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894abf3f-0139-4b15-b1f7-c92a9553db12 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:44.989267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1072/2123] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:44.993503 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbf9ff-a591-4a12-bcc9-8a95a7ccd174 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:45.004309 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbf9ff-a591-4a12-bcc9-8a95a7ccd174 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:45.009073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a0213-1670-454a-bedf-989c32262eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:45.009950 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a0213-1670-454a-bedf-989c32262eda admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:45.010232 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a0213-1670-454a-bedf-989c32262eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:45.010506 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a0213-1670-454a-bedf-989c32262eda admin admin] PATH_INFO: `/v3/projects/c9a1fcd44c30462a8ea4a6dbbc70e8eb/users/f99b8a96baed4b34b1e064a982093d18/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:45.026210 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a0213-1670-454a-bedf-989c32262eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a1fcd44c30462a8ea4a6dbbc70e8eb, user_id=f99b8a96baed4b34b1e064a982093d18, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:45.028891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a0213-1670-454a-bedf-989c32262eda admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:45.042220 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1052/2124] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:44 2022] PUT /identity/v3/projects/c9a1fcd44c30462a8ea4a6dbbc70e8eb/users/f99b8a96baed4b34b1e064a982093d18/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:45.046910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894abf3f-0139-4b15-b1f7-c92a9553db12 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:45.057158 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894abf3f-0139-4b15-b1f7-c92a9553db12 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:45.114194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140176c-25dc-4a3f-acff-1ec473d2e9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:45.114891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140176c-25dc-4a3f-acff-1ec473d2e9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:45.115177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140176c-25dc-4a3f-acff-1ec473d2e9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:45.115450 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140176c-25dc-4a3f-acff-1ec473d2e9c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:45.116168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140176c-25dc-4a3f-acff-1ec473d2e9c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:45.117774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140176c-25dc-4a3f-acff-1ec473d2e9c7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:45.128246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1073/2125] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:45.132536 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a0213-1670-454a-bedf-989c32262eda admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:45.143617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a0213-1670-454a-bedf-989c32262eda admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:45.148285 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4cfdd-a102-4d9a-83c8-85b6667f5779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:45.149168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4cfdd-a102-4d9a-83c8-85b6667f5779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:45.149447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4cfdd-a102-4d9a-83c8-85b6667f5779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:45.149725 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4cfdd-a102-4d9a-83c8-85b6667f5779 admin admin] PATH_INFO: `/v3/projects/c9a1fcd44c30462a8ea4a6dbbc70e8eb/users/f99b8a96baed4b34b1e064a982093d18/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:45.151718 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4cfdd-a102-4d9a-83c8-85b6667f5779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a1fcd44c30462a8ea4a6dbbc70e8eb, user_id=f99b8a96baed4b34b1e064a982093d18, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:45.154352 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4cfdd-a102-4d9a-83c8-85b6667f5779 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:45.164928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1053/2126] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:45 2022] PUT /identity/v3/projects/c9a1fcd44c30462a8ea4a6dbbc70e8eb/users/f99b8a96baed4b34b1e064a982093d18/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:45.175226 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838cec8-dba3-4491-932a-8b05d9d5377a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:45.175515 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838cec8-dba3-4491-932a-8b05d9d5377a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:45.175792 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838cec8-dba3-4491-932a-8b05d9d5377a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:45.203895 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e838cec8-dba3-4491-932a-8b05d9d5377a None None] MFA Rules not processed for user `f99b8a96baed4b34b1e064a982093d18`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:45.206210 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e838cec8-dba3-4491-932a-8b05d9d5377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:45.279757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1074/2127] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:45 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:45.290793 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4cfdd-a102-4d9a-83c8-85b6667f5779 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:45.292486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8ff4cfdd-a102-4d9a-83c8-85b6667f5779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:45.352554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4cfdd-a102-4d9a-83c8-85b6667f5779 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:45.357953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a25ff5-7f4c-4490-89e9-34837d21be76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:45.358713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a25ff5-7f4c-4490-89e9-34837d21be76 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:45.359016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a25ff5-7f4c-4490-89e9-34837d21be76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:45.359336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a25ff5-7f4c-4490-89e9-34837d21be76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:45.369572 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a25ff5-7f4c-4490-89e9-34837d21be76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:45.370671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a25ff5-7f4c-4490-89e9-34837d21be76 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:45.381124 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1054/2128] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:45 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:45.435589 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838cec8-dba3-4491-932a-8b05d9d5377a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:45.436976 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e838cec8-dba3-4491-932a-8b05d9d5377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:45.537335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838cec8-dba3-4491-932a-8b05d9d5377a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:45.542416 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fb084-844e-47fe-862e-7056539ac933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:45.543314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fb084-844e-47fe-862e-7056539ac933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:45.544199 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fb084-844e-47fe-862e-7056539ac933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:45.544487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fb084-844e-47fe-862e-7056539ac933 admin admin] PATH_INFO: `/v3/users/1101ae45c2b84f218484f5016329512b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:45.545725 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fb084-844e-47fe-862e-7056539ac933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1101ae45c2b84f218484f5016329512b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:45.547696 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fb084-844e-47fe-862e-7056539ac933 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:45.569740 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:45.578157 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a25ff5-7f4c-4490-89e9-34837d21be76 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:45.587815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a25ff5-7f4c-4490-89e9-34837d21be76 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:45.592297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630887c9-5a53-49aa-909b-cd9546918b0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:45.593364 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630887c9-5a53-49aa-909b-cd9546918b0d service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:45.593689 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630887c9-5a53-49aa-909b-cd9546918b0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:45.593915 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630887c9-5a53-49aa-909b-cd9546918b0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:45.618616 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2b6fb084-844e-47fe-862e-7056539ac933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1101ae45c2b84f218484f5016329512b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:45.627200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2b6fb084-844e-47fe-862e-7056539ac933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1101ae45c2b84f218484f5016329512b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:45.640510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2b6fb084-844e-47fe-862e-7056539ac933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1101ae45c2b84f218484f5016329512b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:45.647908 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:45.651300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2b6fb084-844e-47fe-862e-7056539ac933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1101ae45c2b84f218484f5016329512b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:45.651926 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2b6fb084-844e-47fe-862e-7056539ac933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1101ae45c2b84f218484f5016329512b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:45.659656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1075/2129] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:45 2022] DELETE /identity/v3/users/1101ae45c2b84f218484f5016329512b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:45.664161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafc86f-2228-4226-b0c1-75f8b79428a2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:45.664657 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafc86f-2228-4226-b0c1-75f8b79428a2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:45.664937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafc86f-2228-4226-b0c1-75f8b79428a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:45.666582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630887c9-5a53-49aa-909b-cd9546918b0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:45.668750 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630887c9-5a53-49aa-909b-cd9546918b0d service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:45.680294 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1055/2130] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:45.687032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9bafc86f-2228-4226-b0c1-75f8b79428a2 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:45.687032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9bafc86f-2228-4226-b0c1-75f8b79428a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:45.761945 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1076/2131] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:45.772385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630887c9-5a53-49aa-909b-cd9546918b0d service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:45.773924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-630887c9-5a53-49aa-909b-cd9546918b0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:45.879935 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630887c9-5a53-49aa-909b-cd9546918b0d service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:45.992887 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f3435-511c-4a1a-8719-96bac8113272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:45.994123 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3435-511c-4a1a-8719-96bac8113272 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:45.998906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3435-511c-4a1a-8719-96bac8113272 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:45.998906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3435-511c-4a1a-8719-96bac8113272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:46.016610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f3435-511c-4a1a-8719-96bac8113272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:46.019394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f3435-511c-4a1a-8719-96bac8113272 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:46.023298 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafc86f-2228-4226-b0c1-75f8b79428a2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:46.027379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9bafc86f-2228-4226-b0c1-75f8b79428a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:46.031097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1056/2132] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:46.052996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafc86f-2228-4226-b0c1-75f8b79428a2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:46.068511 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91241670-3349-4335-b8fb-42979ed4c47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:46.070071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91241670-3349-4335-b8fb-42979ed4c47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:46.070357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91241670-3349-4335-b8fb-42979ed4c47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:46.070635 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91241670-3349-4335-b8fb-42979ed4c47a admin admin] PATH_INFO: `/v3/users/a583b06f6999438cab953c92486dbda2` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:46.075703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91241670-3349-4335-b8fb-42979ed4c47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a583b06f6999438cab953c92486dbda2)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:46.079802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91241670-3349-4335-b8fb-42979ed4c47a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:46.177718 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-91241670-3349-4335-b8fb-42979ed4c47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a583b06f6999438cab953c92486dbda2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:46.188553 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-91241670-3349-4335-b8fb-42979ed4c47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a583b06f6999438cab953c92486dbda2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:46.211614 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-91241670-3349-4335-b8fb-42979ed4c47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a583b06f6999438cab953c92486dbda2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:46.228175 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-91241670-3349-4335-b8fb-42979ed4c47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a583b06f6999438cab953c92486dbda2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:46.228873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-91241670-3349-4335-b8fb-42979ed4c47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a583b06f6999438cab953c92486dbda2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:46.243718 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1077/2133] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:46 2022] DELETE /identity/v3/users/a583b06f6999438cab953c92486dbda2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:46.248925 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cd1ac-8c03-477e-b3d6-6661630a883c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:46.249412 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cd1ac-8c03-477e-b3d6-6661630a883c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:46.249766 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cd1ac-8c03-477e-b3d6-6661630a883c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:46.269776 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b74cd1ac-8c03-477e-b3d6-6661630a883c None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:46.271136 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b74cd1ac-8c03-477e-b3d6-6661630a883c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:46.354024 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1057/2134] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:46.365266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91241670-3349-4335-b8fb-42979ed4c47a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:46.368438 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-91241670-3349-4335-b8fb-42979ed4c47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:46.374873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:46.417616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cd1ac-8c03-477e-b3d6-6661630a883c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:46.419240 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b74cd1ac-8c03-477e-b3d6-6661630a883c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:46.439619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cd1ac-8c03-477e-b3d6-6661630a883c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:46.440451 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69f0e4-7cf6-4826-af18-78269f7bd6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:46.441361 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69f0e4-7cf6-4826-af18-78269f7bd6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:46.441642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69f0e4-7cf6-4826-af18-78269f7bd6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:46.441917 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69f0e4-7cf6-4826-af18-78269f7bd6af admin admin] PATH_INFO: `/v3/projects/f38c6cbb85184a358c98842f010cf71f` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:46.443368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69f0e4-7cf6-4826-af18-78269f7bd6af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f38c6cbb85184a358c98842f010cf71f)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:46.445727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69f0e4-7cf6-4826-af18-78269f7bd6af admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:46.463605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91241670-3349-4335-b8fb-42979ed4c47a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:46.468483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76921813-d2e0-4468-9433-2777a8da0885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:46.469251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76921813-d2e0-4468-9433-2777a8da0885 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:46.469528 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76921813-d2e0-4468-9433-2777a8da0885 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:46.469841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76921813-d2e0-4468-9433-2777a8da0885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:46.480887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76921813-d2e0-4468-9433-2777a8da0885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:46.482360 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76921813-d2e0-4468-9433-2777a8da0885 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:46.493926 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1078/2135] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:46.502877 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:46.511938 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fe69f0e4-7cf6-4826-af18-78269f7bd6af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38c6cbb85184a358c98842f010cf71f', 'request_id': 'req-fe69f0e4-7cf6-4826-af18-78269f7bd6af'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:46.518656 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fe69f0e4-7cf6-4826-af18-78269f7bd6af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38c6cbb85184a358c98842f010cf71f', 'request_id': 'req-fe69f0e4-7cf6-4826-af18-78269f7bd6af'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:46.527375 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fe69f0e4-7cf6-4826-af18-78269f7bd6af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38c6cbb85184a358c98842f010cf71f', 'request_id': 'req-fe69f0e4-7cf6-4826-af18-78269f7bd6af'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:46.541044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fe69f0e4-7cf6-4826-af18-78269f7bd6af admin admin] The token cache is being invalidate because project f38c6cbb85184a358c98842f010cf71f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:46.541341 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fe69f0e4-7cf6-4826-af18-78269f7bd6af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:46.541982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fe69f0e4-7cf6-4826-af18-78269f7bd6af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:46.544044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1058/2136] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:46 2022] DELETE /identity/v3/projects/f38c6cbb85184a358c98842f010cf71f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:46.551684 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0cbf5-388d-4934-bcac-2b8635524857 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:46.552007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0cbf5-388d-4934-bcac-2b8635524857 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:46.552415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0cbf5-388d-4934-bcac-2b8635524857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:46.572567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e1c0cbf5-388d-4934-bcac-2b8635524857 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:46.573924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e1c0cbf5-388d-4934-bcac-2b8635524857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:46.646026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1079/2137] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:46.654135 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d34e3-02fd-4900-864d-5e8bb84a5fdb None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:46.654437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d34e3-02fd-4900-864d-5e8bb84a5fdb None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:46.654713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d34e3-02fd-4900-864d-5e8bb84a5fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:46.675745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-955d34e3-02fd-4900-864d-5e8bb84a5fdb None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:46.676985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-955d34e3-02fd-4900-864d-5e8bb84a5fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:46.691255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1059/2138] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:46.700589 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0cbf5-388d-4934-bcac-2b8635524857 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:46.711719 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0cbf5-388d-4934-bcac-2b8635524857 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:46.716468 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f2bc7-6395-4e6d-b88c-e17a8ccfbc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:46.717126 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f2bc7-6395-4e6d-b88c-e17a8ccfbc6d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:46.717405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f2bc7-6395-4e6d-b88c-e17a8ccfbc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:46.717682 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f2bc7-6395-4e6d-b88c-e17a8ccfbc6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:46.718395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f2bc7-6395-4e6d-b88c-e17a8ccfbc6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:32:46.718777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f2bc7-6395-4e6d-b88c-e17a8ccfbc6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:46.720539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f2bc7-6395-4e6d-b88c-e17a8ccfbc6d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:46.733437 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1080/2139] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:32:46.738345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d34e3-02fd-4900-864d-5e8bb84a5fdb None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:46.747923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d34e3-02fd-4900-864d-5e8bb84a5fdb None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:46.753559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7df57-1b3e-431f-91dc-416c53764b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:46.754221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7df57-1b3e-431f-91dc-416c53764b71 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:46.754501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7df57-1b3e-431f-91dc-416c53764b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:46.754879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7df57-1b3e-431f-91dc-416c53764b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:46.755584 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7df57-1b3e-431f-91dc-416c53764b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:46.757471 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7df57-1b3e-431f-91dc-416c53764b71 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:46.789132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1060/2140] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:46 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:46.793691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f2bc7-6395-4e6d-b88c-e17a8ccfbc6d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:46.800218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7df57-1b3e-431f-91dc-416c53764b71 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:46.802199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a5a7df57-1b3e-431f-91dc-416c53764b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:46.806082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f2bc7-6395-4e6d-b88c-e17a8ccfbc6d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:46.869830 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7df57-1b3e-431f-91dc-416c53764b71 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:46.871719 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239aa209-b813-43c8-b39e-9c14cd54f1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:46.872468 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239aa209-b813-43c8-b39e-9c14cd54f1ba admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:46.872825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239aa209-b813-43c8-b39e-9c14cd54f1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:46.873175 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239aa209-b813-43c8-b39e-9c14cd54f1ba admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:46.873951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239aa209-b813-43c8-b39e-9c14cd54f1ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:46.874587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb59e46-9b0f-45d6-891a-0b05e97af471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:46.875469 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb59e46-9b0f-45d6-891a-0b05e97af471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:46.875749 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb59e46-9b0f-45d6-891a-0b05e97af471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:46.876003 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239aa209-b813-43c8-b39e-9c14cd54f1ba admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:46.876109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb59e46-9b0f-45d6-891a-0b05e97af471 admin admin] PATH_INFO: `/v3/projects/ef37d14d75ce4177b078d349f019732a` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:46.877274 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb59e46-9b0f-45d6-891a-0b05e97af471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef37d14d75ce4177b078d349f019732a)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:46.879204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb59e46-9b0f-45d6-891a-0b05e97af471 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:46.897798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1081/2141] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:46 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:32:46.902208 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239aa209-b813-43c8-b39e-9c14cd54f1ba admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:46.925274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239aa209-b813-43c8-b39e-9c14cd54f1ba admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:46.938635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6cb59e46-9b0f-45d6-891a-0b05e97af471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef37d14d75ce4177b078d349f019732a', 'request_id': 'req-6cb59e46-9b0f-45d6-891a-0b05e97af471'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:46.944447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6cb59e46-9b0f-45d6-891a-0b05e97af471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef37d14d75ce4177b078d349f019732a', 'request_id': 'req-6cb59e46-9b0f-45d6-891a-0b05e97af471'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:46.945424 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:46.957106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6cb59e46-9b0f-45d6-891a-0b05e97af471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef37d14d75ce4177b078d349f019732a', 'request_id': 'req-6cb59e46-9b0f-45d6-891a-0b05e97af471'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:46.968607 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6cb59e46-9b0f-45d6-891a-0b05e97af471 admin admin] The token cache is being invalidate because project ef37d14d75ce4177b078d349f019732a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:46.968947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6cb59e46-9b0f-45d6-891a-0b05e97af471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:46.969632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6cb59e46-9b0f-45d6-891a-0b05e97af471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:46.971928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1061/2142] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:46 2022] DELETE /identity/v3/projects/ef37d14d75ce4177b078d349f019732a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:46.976611 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cd122-fad4-4909-9f02-7e128dedaf80 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:46.977003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cd122-fad4-4909-9f02-7e128dedaf80 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:46.977308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cd122-fad4-4909-9f02-7e128dedaf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:46.995239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e12fae-193e-459a-b084-d8411a3d1304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:46.995912 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e12fae-193e-459a-b084-d8411a3d1304 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:46.996020 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9e8cd122-fad4-4909-9f02-7e128dedaf80 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:46.996190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e12fae-193e-459a-b084-d8411a3d1304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:46.996460 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e12fae-193e-459a-b084-d8411a3d1304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:46.997105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9e8cd122-fad4-4909-9f02-7e128dedaf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:46.997214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e12fae-193e-459a-b084-d8411a3d1304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:46.998772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e12fae-193e-459a-b084-d8411a3d1304 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:47.005931 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1062/2143] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:47.016040 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1082/2144] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:47.016207 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbd543-3bc4-49c9-90fc-aaa6fd560e59 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:47.016207 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbd543-3bc4-49c9-90fc-aaa6fd560e59 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:47.016207 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbd543-3bc4-49c9-90fc-aaa6fd560e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:47.016986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e12fae-193e-459a-b084-d8411a3d1304 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:47.019490 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-83e12fae-193e-459a-b084-d8411a3d1304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:47.032428 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e12fae-193e-459a-b084-d8411a3d1304 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:47.035116 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-efdbd543-3bc4-49c9-90fc-aaa6fd560e59 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:47.036302 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-efdbd543-3bc4-49c9-90fc-aaa6fd560e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:47.038807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257aa8b-b8f7-4fbb-a134-c64c7ffcd99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:47.039611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257aa8b-b8f7-4fbb-a134-c64c7ffcd99f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:47.039898 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257aa8b-b8f7-4fbb-a134-c64c7ffcd99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:47.040242 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257aa8b-b8f7-4fbb-a134-c64c7ffcd99f admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:47.041088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257aa8b-b8f7-4fbb-a134-c64c7ffcd99f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:47.042819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257aa8b-b8f7-4fbb-a134-c64c7ffcd99f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:47.044622 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1063/2145] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:47.048614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbd543-3bc4-49c9-90fc-aaa6fd560e59 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:47.057220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1083/2146] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:32:47.058303 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257aa8b-b8f7-4fbb-a134-c64c7ffcd99f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:47.058591 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbd543-3bc4-49c9-90fc-aaa6fd560e59 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:47.063933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8262f-48d3-48aa-8304-f5bd6fc3b51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:47.065824 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8262f-48d3-48aa-8304-f5bd6fc3b51a admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:47.066284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8262f-48d3-48aa-8304-f5bd6fc3b51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:47.066714 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8262f-48d3-48aa-8304-f5bd6fc3b51a admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:47.067823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8262f-48d3-48aa-8304-f5bd6fc3b51a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:32:47.068136 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8262f-48d3-48aa-8304-f5bd6fc3b51a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:47.069753 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8262f-48d3-48aa-8304-f5bd6fc3b51a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:47.070046 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257aa8b-b8f7-4fbb-a134-c64c7ffcd99f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:47.075161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efea97-753a-46eb-a95a-295b29326bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:47.076166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efea97-753a-46eb-a95a-295b29326bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:47.076542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efea97-753a-46eb-a95a-295b29326bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:47.076913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efea97-753a-46eb-a95a-295b29326bc8 admin admin] PATH_INFO: `/v3/projects/fe2887e015494f139191ebcc6be4e0df/users/045b860303f14c5cb33556f3dd6bb422/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:47.084225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1064/2147] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:32:47.087613 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8262f-48d3-48aa-8304-f5bd6fc3b51a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:47.094900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efea97-753a-46eb-a95a-295b29326bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2887e015494f139191ebcc6be4e0df, user_id=045b860303f14c5cb33556f3dd6bb422, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:47.096149 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:47.100167 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efea97-753a-46eb-a95a-295b29326bc8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:47.109804 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8262f-48d3-48aa-8304-f5bd6fc3b51a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:47.124916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1084/2148] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:47 2022] PUT /identity/v3/projects/fe2887e015494f139191ebcc6be4e0df/users/045b860303f14c5cb33556f3dd6bb422/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:47.139148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba157e23-f6c1-4883-aff1-2452536d613b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:47.140711 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba157e23-f6c1-4883-aff1-2452536d613b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:47.141162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba157e23-f6c1-4883-aff1-2452536d613b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:47.211323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaa4f9-03dc-4cc5-97c0-c3676ef21eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:47.212349 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaa4f9-03dc-4cc5-97c0-c3676ef21eff admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:47.212831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaa4f9-03dc-4cc5-97c0-c3676ef21eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:47.213195 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaa4f9-03dc-4cc5-97c0-c3676ef21eff admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:47.214353 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcaa4f9-03dc-4cc5-97c0-c3676ef21eff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:47.214916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ba157e23-f6c1-4883-aff1-2452536d613b None None] MFA Rules not processed for user `045b860303f14c5cb33556f3dd6bb422`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:47.216870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcaa4f9-03dc-4cc5-97c0-c3676ef21eff admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:47.217140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ba157e23-f6c1-4883-aff1-2452536d613b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:47.257351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1065/2149] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:47 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:47.258919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaa4f9-03dc-4cc5-97c0-c3676ef21eff admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:47.326969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1085/2150] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:47.341469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba157e23-f6c1-4883-aff1-2452536d613b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:47.342205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaa4f9-03dc-4cc5-97c0-c3676ef21eff admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:47.343328 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ba157e23-f6c1-4883-aff1-2452536d613b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:47.350161 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47ee43-be4e-4158-8d31-13b951fb9e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:47.351034 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47ee43-be4e-4158-8d31-13b951fb9e45 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:47.351390 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47ee43-be4e-4158-8d31-13b951fb9e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:47.351817 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47ee43-be4e-4158-8d31-13b951fb9e45 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:47.352646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47ee43-be4e-4158-8d31-13b951fb9e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:47.354886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47ee43-be4e-4158-8d31-13b951fb9e45 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:47.379699 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1066/2151] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:47 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:47.383159 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47ee43-be4e-4158-8d31-13b951fb9e45 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:47.394801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47ee43-be4e-4158-8d31-13b951fb9e45 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:47.400096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9e6c5-1d72-48f0-9096-297b25152dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:47.401173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9e6c5-1d72-48f0-9096-297b25152dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:47.401173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9e6c5-1d72-48f0-9096-297b25152dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:47.401465 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9e6c5-1d72-48f0-9096-297b25152dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:47.402400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9e6c5-1d72-48f0-9096-297b25152dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:47.404235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9e6c5-1d72-48f0-9096-297b25152dd0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:47.416978 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1067/2152] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:32:47.429300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba157e23-f6c1-4883-aff1-2452536d613b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:47.430279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9e6c5-1d72-48f0-9096-297b25152dd0 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:47.450488 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9e6c5-1d72-48f0-9096-297b25152dd0 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:47.457215 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61d4c1-3825-4c56-a71c-b6e9c313b86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:47.457915 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61d4c1-3825-4c56-a71c-b6e9c313b86f admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:47.458501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61d4c1-3825-4c56-a71c-b6e9c313b86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:47.458501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61d4c1-3825-4c56-a71c-b6e9c313b86f admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:47.459281 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61d4c1-3825-4c56-a71c-b6e9c313b86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:47.460941 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61d4c1-3825-4c56-a71c-b6e9c313b86f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:47.474295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1068/2153] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:32:47.479189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61d4c1-3825-4c56-a71c-b6e9c313b86f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:47.486581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:47.491651 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61d4c1-3825-4c56-a71c-b6e9c313b86f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:47.499031 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6842c32-f75a-4a55-b0f4-0adae2dcc043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:47.499955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6842c32-f75a-4a55-b0f4-0adae2dcc043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:47.500456 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6842c32-f75a-4a55-b0f4-0adae2dcc043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:47.500743 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6842c32-f75a-4a55-b0f4-0adae2dcc043 admin admin] PATH_INFO: `/v3/projects/e839334d43534fe78bbad9ee78f8a10b/users/57a9728196524510927fb531fdbef19b/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:47.519204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6842c32-f75a-4a55-b0f4-0adae2dcc043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e839334d43534fe78bbad9ee78f8a10b, user_id=57a9728196524510927fb531fdbef19b, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:47.521048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5a36c-a7cb-4961-a543-d8bd32a10cde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:47.521900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5a36c-a7cb-4961-a543-d8bd32a10cde service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:47.522274 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6842c32-f75a-4a55-b0f4-0adae2dcc043 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:47.522541 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5a36c-a7cb-4961-a543-d8bd32a10cde service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:47.523003 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5a36c-a7cb-4961-a543-d8bd32a10cde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:47.537833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1069/2154] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:47 2022] PUT /identity/v3/projects/e839334d43534fe78bbad9ee78f8a10b/users/57a9728196524510927fb531fdbef19b/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:47.542954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bd912-2494-4a73-922f-23fde1256971 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:47.543245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bd912-2494-4a73-922f-23fde1256971 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:47.543526 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bd912-2494-4a73-922f-23fde1256971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:47.562876 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-f16bd912-2494-4a73-922f-23fde1256971 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:47.564808 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f16bd912-2494-4a73-922f-23fde1256971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:47.596880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5a36c-a7cb-4961-a543-d8bd32a10cde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:47.598078 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:47.598343 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5a36c-a7cb-4961-a543-d8bd32a10cde service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:47.609837 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1086/2155] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:47.643026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1070/2156] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:47.651732 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5a36c-a7cb-4961-a543-d8bd32a10cde service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:47.654683 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a4d5a36c-a7cb-4961-a543-d8bd32a10cde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:47.724454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5a36c-a7cb-4961-a543-d8bd32a10cde service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:47.803950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacc417-6d42-46e9-a502-59105a99956b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:47.804919 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacc417-6d42-46e9-a502-59105a99956b service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:47.805196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacc417-6d42-46e9-a502-59105a99956b service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:47.805466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacc417-6d42-46e9-a502-59105a99956b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:47.816998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacc417-6d42-46e9-a502-59105a99956b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:47.819065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacc417-6d42-46e9-a502-59105a99956b service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:47.842519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1087/2157] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:48.646141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f977bcf-42f5-4286-afc0-43fbf521b766 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:48.646631 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f977bcf-42f5-4286-afc0-43fbf521b766 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:48.646883 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f977bcf-42f5-4286-afc0-43fbf521b766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:48.678902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2f977bcf-42f5-4286-afc0-43fbf521b766 None None] MFA Rules not processed for user `57a9728196524510927fb531fdbef19b`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:48.680123 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2f977bcf-42f5-4286-afc0-43fbf521b766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:48.764888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1071/2158] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:48.778395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacc417-6d42-46e9-a502-59105a99956b service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:48.835562 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:48.847998 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacc417-6d42-46e9-a502-59105a99956b service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:48.854194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5009cd-e5a5-41ab-8793-3c80f4291299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:48.855344 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5009cd-e5a5-41ab-8793-3c80f4291299 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:48.858898 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5009cd-e5a5-41ab-8793-3c80f4291299 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:48.859343 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5009cd-e5a5-41ab-8793-3c80f4291299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:48.869969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5009cd-e5a5-41ab-8793-3c80f4291299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:48.871573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5009cd-e5a5-41ab-8793-3c80f4291299 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:48.881772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1088/2159] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:32:50.270362 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6810e1a-9269-439d-9c5f-efedd0077f10 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:50.270924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6810e1a-9269-439d-9c5f-efedd0077f10 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:50.271026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6810e1a-9269-439d-9c5f-efedd0077f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:50.296118 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e6810e1a-9269-439d-9c5f-efedd0077f10 None None] MFA Rules not processed for user `57a9728196524510927fb531fdbef19b`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:50.297316 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e6810e1a-9269-439d-9c5f-efedd0077f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:50.306959 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1072/2160] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:51.640981 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5009cd-e5a5-41ab-8793-3c80f4291299 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:51.644460 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7e5009cd-e5a5-41ab-8793-3c80f4291299 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:51.664381 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5009cd-e5a5-41ab-8793-3c80f4291299 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:51.669035 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb92331-8143-497d-b617-b2ae76c151b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:51.669910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb92331-8143-497d-b617-b2ae76c151b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:51.670374 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb92331-8143-497d-b617-b2ae76c151b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:51.670643 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb92331-8143-497d-b617-b2ae76c151b2 admin admin] PATH_INFO: `/v3/users/a76e42e901164464b3b0fa30881dd01d` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:51.671891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb92331-8143-497d-b617-b2ae76c151b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a76e42e901164464b3b0fa30881dd01d)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:51.675443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb92331-8143-497d-b617-b2ae76c151b2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:51.730999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7cb92331-8143-497d-b617-b2ae76c151b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a76e42e901164464b3b0fa30881dd01d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:51.738581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7cb92331-8143-497d-b617-b2ae76c151b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a76e42e901164464b3b0fa30881dd01d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:51.752405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7cb92331-8143-497d-b617-b2ae76c151b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a76e42e901164464b3b0fa30881dd01d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:51.759894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7cb92331-8143-497d-b617-b2ae76c151b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a76e42e901164464b3b0fa30881dd01d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:51.760519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7cb92331-8143-497d-b617-b2ae76c151b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a76e42e901164464b3b0fa30881dd01d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:51.768190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1089/2161] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:51 2022] DELETE /identity/v3/users/a76e42e901164464b3b0fa30881dd01d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:51.772722 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbbc76-2bdb-4402-86c0-d75c60ea1d10 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:51.780642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbbc76-2bdb-4402-86c0-d75c60ea1d10 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:51.780978 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbbc76-2bdb-4402-86c0-d75c60ea1d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:51.798955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-97dbbc76-2bdb-4402-86c0-d75c60ea1d10 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:51.800173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-97dbbc76-2bdb-4402-86c0-d75c60ea1d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:51.843611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb92331-8143-497d-b617-b2ae76c151b2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:51.845143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7cb92331-8143-497d-b617-b2ae76c151b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:51.869069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1073/2162] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:51.879748 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbbc76-2bdb-4402-86c0-d75c60ea1d10 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:51.881339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-97dbbc76-2bdb-4402-86c0-d75c60ea1d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:51.943835 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb92331-8143-497d-b617-b2ae76c151b2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:51.949166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cebe7-f1cd-47a8-94fc-57e9b12d1299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:51.950166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cebe7-f1cd-47a8-94fc-57e9b12d1299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:51.950544 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cebe7-f1cd-47a8-94fc-57e9b12d1299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:51.950932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cebe7-f1cd-47a8-94fc-57e9b12d1299 admin admin] PATH_INFO: `/v3/users/0999b7fe05a141508c52c70a3cf46a1a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:51.952227 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cebe7-f1cd-47a8-94fc-57e9b12d1299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0999b7fe05a141508c52c70a3cf46a1a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:51.954215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cebe7-f1cd-47a8-94fc-57e9b12d1299 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:51.959879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbbc76-2bdb-4402-86c0-d75c60ea1d10 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:51.964046 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c23d6-07bc-4b58-9452-9364ae4ef8b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:51.964709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c23d6-07bc-4b58-9452-9364ae4ef8b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:51.964972 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c23d6-07bc-4b58-9452-9364ae4ef8b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:51.965240 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c23d6-07bc-4b58-9452-9364ae4ef8b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:51.979889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c23d6-07bc-4b58-9452-9364ae4ef8b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:51.981996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c23d6-07bc-4b58-9452-9364ae4ef8b6 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:51.990141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:52.008294 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1074/2163] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:32:52.034614 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a99cebe7-f1cd-47a8-94fc-57e9b12d1299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0999b7fe05a141508c52c70a3cf46a1a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.042378 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a99cebe7-f1cd-47a8-94fc-57e9b12d1299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0999b7fe05a141508c52c70a3cf46a1a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.046425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:52.065436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a99cebe7-f1cd-47a8-94fc-57e9b12d1299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0999b7fe05a141508c52c70a3cf46a1a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.088097 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a99cebe7-f1cd-47a8-94fc-57e9b12d1299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0999b7fe05a141508c52c70a3cf46a1a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.088888 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a99cebe7-f1cd-47a8-94fc-57e9b12d1299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0999b7fe05a141508c52c70a3cf46a1a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.100232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1090/2164] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:51 2022] DELETE /identity/v3/users/0999b7fe05a141508c52c70a3cf46a1a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:52.521408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c23d6-07bc-4b58-9452-9364ae4ef8b6 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:52.533155 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c23d6-07bc-4b58-9452-9364ae4ef8b6 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:52.616379 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6579f0c-2f08-418e-9107-bc4d61f4fb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:52.617348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6579f0c-2f08-418e-9107-bc4d61f4fb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:52.617535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6579f0c-2f08-418e-9107-bc4d61f4fb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:52.617796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6579f0c-2f08-418e-9107-bc4d61f4fb90 admin admin] PATH_INFO: `/v3/projects/fcf9d61c72244694900327634f28ffae` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:52.619061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6579f0c-2f08-418e-9107-bc4d61f4fb90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf9d61c72244694900327634f28ffae)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:52.621297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6579f0c-2f08-418e-9107-bc4d61f4fb90 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:52.653945 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cebe7-f1cd-47a8-94fc-57e9b12d1299 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:52.656251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a99cebe7-f1cd-47a8-94fc-57e9b12d1299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:52.682158 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cebe7-f1cd-47a8-94fc-57e9b12d1299 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:52.711073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b6579f0c-2f08-418e-9107-bc4d61f4fb90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf9d61c72244694900327634f28ffae', 'request_id': 'req-b6579f0c-2f08-418e-9107-bc4d61f4fb90'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.723389 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b6579f0c-2f08-418e-9107-bc4d61f4fb90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf9d61c72244694900327634f28ffae', 'request_id': 'req-b6579f0c-2f08-418e-9107-bc4d61f4fb90'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.736351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b6579f0c-2f08-418e-9107-bc4d61f4fb90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf9d61c72244694900327634f28ffae', 'request_id': 'req-b6579f0c-2f08-418e-9107-bc4d61f4fb90'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.756305 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b6579f0c-2f08-418e-9107-bc4d61f4fb90 admin admin] The token cache is being invalidate because project fcf9d61c72244694900327634f28ffae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:52.757251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b6579f0c-2f08-418e-9107-bc4d61f4fb90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.759081 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b6579f0c-2f08-418e-9107-bc4d61f4fb90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.762799 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1075/2165] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:52 2022] DELETE /identity/v3/projects/fcf9d61c72244694900327634f28ffae => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:52.767065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6579f0c-2f08-418e-9107-bc4d61f4fb90 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:52.767326 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd2ebf-907d-417f-a1ed-359e483a3284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:52.768651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd2ebf-907d-417f-a1ed-359e483a3284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:52.769092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd2ebf-907d-417f-a1ed-359e483a3284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:52.769498 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b6579f0c-2f08-418e-9107-bc4d61f4fb90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:52.769715 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd2ebf-907d-417f-a1ed-359e483a3284 admin admin] PATH_INFO: `/v3/projects/944287727eb4456bacc7bc99036a2e80` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:52.771261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd2ebf-907d-417f-a1ed-359e483a3284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=944287727eb4456bacc7bc99036a2e80)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:52.773356 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd2ebf-907d-417f-a1ed-359e483a3284 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:52.783212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6579f0c-2f08-418e-9107-bc4d61f4fb90 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:52.788803 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798b4bd-ae4d-4f90-87ce-53838873be55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:52.789970 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798b4bd-ae4d-4f90-87ce-53838873be55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:52.790259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798b4bd-ae4d-4f90-87ce-53838873be55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:52.790535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798b4bd-ae4d-4f90-87ce-53838873be55 admin admin] PATH_INFO: `/v3/users/78132faa91bd42029d0c8c2868b68763` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:52.791852 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798b4bd-ae4d-4f90-87ce-53838873be55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78132faa91bd42029d0c8c2868b68763)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:52.795600 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798b4bd-ae4d-4f90-87ce-53838873be55 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:52.846157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b7bd2ebf-907d-417f-a1ed-359e483a3284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '944287727eb4456bacc7bc99036a2e80', 'request_id': 'req-b7bd2ebf-907d-417f-a1ed-359e483a3284'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.854825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b7bd2ebf-907d-417f-a1ed-359e483a3284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '944287727eb4456bacc7bc99036a2e80', 'request_id': 'req-b7bd2ebf-907d-417f-a1ed-359e483a3284'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.865450 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b7bd2ebf-907d-417f-a1ed-359e483a3284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '944287727eb4456bacc7bc99036a2e80', 'request_id': 'req-b7bd2ebf-907d-417f-a1ed-359e483a3284'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.882166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b7bd2ebf-907d-417f-a1ed-359e483a3284 admin admin] The token cache is being invalidate because project 944287727eb4456bacc7bc99036a2e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:52.882550 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b7bd2ebf-907d-417f-a1ed-359e483a3284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.883343 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b7bd2ebf-907d-417f-a1ed-359e483a3284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.883782 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5798b4bd-ae4d-4f90-87ce-53838873be55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78132faa91bd42029d0c8c2868b68763'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.887773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1091/2166] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:52 2022] DELETE /identity/v3/projects/944287727eb4456bacc7bc99036a2e80 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:52.888809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd2ebf-907d-417f-a1ed-359e483a3284 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:52.894533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b7bd2ebf-907d-417f-a1ed-359e483a3284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:52.894829 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5798b4bd-ae4d-4f90-87ce-53838873be55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78132faa91bd42029d0c8c2868b68763'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.925297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5798b4bd-ae4d-4f90-87ce-53838873be55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78132faa91bd42029d0c8c2868b68763'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.935129 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5798b4bd-ae4d-4f90-87ce-53838873be55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78132faa91bd42029d0c8c2868b68763'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.935896 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5798b4bd-ae4d-4f90-87ce-53838873be55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78132faa91bd42029d0c8c2868b68763'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:52.940789 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:52.950099 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1076/2167] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:52 2022] DELETE /identity/v3/users/78132faa91bd42029d0c8c2868b68763 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:52.995234 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd2ebf-907d-417f-a1ed-359e483a3284 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:53.007209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:53.062228 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798b4bd-ae4d-4f90-87ce-53838873be55 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:53.064857 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5798b4bd-ae4d-4f90-87ce-53838873be55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:53.096050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c855e84-0f46-4cb5-8dce-2d97a563b827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:53.096961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c855e84-0f46-4cb5-8dce-2d97a563b827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:53.097244 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c855e84-0f46-4cb5-8dce-2d97a563b827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:53.097525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c855e84-0f46-4cb5-8dce-2d97a563b827 admin admin] PATH_INFO: `/v3/users/f99b8a96baed4b34b1e064a982093d18` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:53.099553 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c855e84-0f46-4cb5-8dce-2d97a563b827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f99b8a96baed4b34b1e064a982093d18)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:53.101495 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c855e84-0f46-4cb5-8dce-2d97a563b827 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:53.199999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7c855e84-0f46-4cb5-8dce-2d97a563b827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f99b8a96baed4b34b1e064a982093d18'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.206943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798b4bd-ae4d-4f90-87ce-53838873be55 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:53.211270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7c855e84-0f46-4cb5-8dce-2d97a563b827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f99b8a96baed4b34b1e064a982093d18'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.217745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb37d2b-6960-4ce9-bbd7-43e240a7e8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:53.218640 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb37d2b-6960-4ce9-bbd7-43e240a7e8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:53.218972 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb37d2b-6960-4ce9-bbd7-43e240a7e8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:53.219246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb37d2b-6960-4ce9-bbd7-43e240a7e8c1 admin admin] PATH_INFO: `/v3/users/045b860303f14c5cb33556f3dd6bb422` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:53.220756 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb37d2b-6960-4ce9-bbd7-43e240a7e8c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=045b860303f14c5cb33556f3dd6bb422)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:53.222813 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb37d2b-6960-4ce9-bbd7-43e240a7e8c1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:53.228120 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7c855e84-0f46-4cb5-8dce-2d97a563b827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f99b8a96baed4b34b1e064a982093d18'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.238805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7c855e84-0f46-4cb5-8dce-2d97a563b827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f99b8a96baed4b34b1e064a982093d18'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.239509 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7c855e84-0f46-4cb5-8dce-2d97a563b827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f99b8a96baed4b34b1e064a982093d18'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.246846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1092/2168] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:52 2022] DELETE /identity/v3/users/f99b8a96baed4b34b1e064a982093d18 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:53.247780 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c855e84-0f46-4cb5-8dce-2d97a563b827 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:53.252878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7c855e84-0f46-4cb5-8dce-2d97a563b827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:53.304175 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ffb37d2b-6960-4ce9-bbd7-43e240a7e8c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '045b860303f14c5cb33556f3dd6bb422'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.324668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ffb37d2b-6960-4ce9-bbd7-43e240a7e8c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '045b860303f14c5cb33556f3dd6bb422'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.347177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ffb37d2b-6960-4ce9-bbd7-43e240a7e8c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '045b860303f14c5cb33556f3dd6bb422'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.359685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ffb37d2b-6960-4ce9-bbd7-43e240a7e8c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '045b860303f14c5cb33556f3dd6bb422'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.361940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ffb37d2b-6960-4ce9-bbd7-43e240a7e8c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '045b860303f14c5cb33556f3dd6bb422'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.364337 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c855e84-0f46-4cb5-8dce-2d97a563b827 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:53.370882 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fe4c8-8710-42f2-95c9-d3c42723babb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:53.371914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fe4c8-8710-42f2-95c9-d3c42723babb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:53.372897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fe4c8-8710-42f2-95c9-d3c42723babb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:53.372897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fe4c8-8710-42f2-95c9-d3c42723babb admin admin] PATH_INFO: `/v3/projects/6a38e7eba1c84937b47e8938c779e7df` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:53.377313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fe4c8-8710-42f2-95c9-d3c42723babb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a38e7eba1c84937b47e8938c779e7df)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:53.377457 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1077/2169] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:53 2022] DELETE /identity/v3/users/045b860303f14c5cb33556f3dd6bb422 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:53.377573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fe4c8-8710-42f2-95c9-d3c42723babb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:53.381702 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6c559-3f24-4c90-8ea4-173ce083d278 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:53.382100 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6c559-3f24-4c90-8ea4-173ce083d278 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:53.382986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6c559-3f24-4c90-8ea4-173ce083d278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:53.411267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-5cf6c559-3f24-4c90-8ea4-173ce083d278 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:53.413126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5cf6c559-3f24-4c90-8ea4-173ce083d278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:53.459434 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:53.483388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-847fe4c8-8710-42f2-95c9-d3c42723babb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a38e7eba1c84937b47e8938c779e7df', 'request_id': 'req-847fe4c8-8710-42f2-95c9-d3c42723babb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.499262 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-847fe4c8-8710-42f2-95c9-d3c42723babb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a38e7eba1c84937b47e8938c779e7df', 'request_id': 'req-847fe4c8-8710-42f2-95c9-d3c42723babb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.500085 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1078/2170] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:53.516208 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-847fe4c8-8710-42f2-95c9-d3c42723babb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a38e7eba1c84937b47e8938c779e7df', 'request_id': 'req-847fe4c8-8710-42f2-95c9-d3c42723babb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.520308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6c559-3f24-4c90-8ea4-173ce083d278 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:53.530786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5cf6c559-3f24-4c90-8ea4-173ce083d278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:53.534527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-847fe4c8-8710-42f2-95c9-d3c42723babb admin admin] The token cache is being invalidate because project 6a38e7eba1c84937b47e8938c779e7df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:53.535140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-847fe4c8-8710-42f2-95c9-d3c42723babb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.536058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-847fe4c8-8710-42f2-95c9-d3c42723babb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.538565 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1093/2171] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:53 2022] DELETE /identity/v3/projects/6a38e7eba1c84937b47e8938c779e7df => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:53.543539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6892302-b281-4864-bbac-d92c809cc971 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:53.544051 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6892302-b281-4864-bbac-d92c809cc971 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:53.544476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6892302-b281-4864-bbac-d92c809cc971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:53.569878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b6892302-b281-4864-bbac-d92c809cc971 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:53.571299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b6892302-b281-4864-bbac-d92c809cc971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:53.577846 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:53.642629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6c559-3f24-4c90-8ea4-173ce083d278 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:53.678820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1094/2172] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:53.680670 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde204c3-d835-4a74-b5f3-9da82756f64d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:53.681130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde204c3-d835-4a74-b5f3-9da82756f64d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:53.681544 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde204c3-d835-4a74-b5f3-9da82756f64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:53.723385 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-dde204c3-d835-4a74-b5f3-9da82756f64d None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:53.724955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dde204c3-d835-4a74-b5f3-9da82756f64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:53.734866 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1095/2173] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:53.739102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde204c3-d835-4a74-b5f3-9da82756f64d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:53.739102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dde204c3-d835-4a74-b5f3-9da82756f64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:53.744404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a79d82-bc1f-4383-bf40-c8f2e56b9b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:53.745269 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a79d82-bc1f-4383-bf40-c8f2e56b9b88 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:53.745548 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a79d82-bc1f-4383-bf40-c8f2e56b9b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:53.745823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a79d82-bc1f-4383-bf40-c8f2e56b9b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:53.747716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-53a79d82-bc1f-4383-bf40-c8f2e56b9b88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:53.756782 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde204c3-d835-4a74-b5f3-9da82756f64d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:53.761884 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea5224-7e35-4fbd-998a-3294cf48bc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:53.762633 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a79d82-bc1f-4383-bf40-c8f2e56b9b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:53.762899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea5224-7e35-4fbd-998a-3294cf48bc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:53.763029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea5224-7e35-4fbd-998a-3294cf48bc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:53.763302 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea5224-7e35-4fbd-998a-3294cf48bc06 admin admin] PATH_INFO: `/v3/projects/c9a1fcd44c30462a8ea4a6dbbc70e8eb` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:53.764305 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a79d82-bc1f-4383-bf40-c8f2e56b9b88 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:53.765561 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea5224-7e35-4fbd-998a-3294cf48bc06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9a1fcd44c30462a8ea4a6dbbc70e8eb)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:53.769248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea5224-7e35-4fbd-998a-3294cf48bc06 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:53.777728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1079/2174] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:53.779450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a79d82-bc1f-4383-bf40-c8f2e56b9b88 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:53.790226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a79d82-bc1f-4383-bf40-c8f2e56b9b88 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:53.801818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22703e-3e5e-4981-960a-d08bf615f160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:53.802683 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22703e-3e5e-4981-960a-d08bf615f160 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:53.803007 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22703e-3e5e-4981-960a-d08bf615f160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:53.803283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22703e-3e5e-4981-960a-d08bf615f160 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:53.804193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22703e-3e5e-4981-960a-d08bf615f160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:32:53.804670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22703e-3e5e-4981-960a-d08bf615f160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:53.806454 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22703e-3e5e-4981-960a-d08bf615f160 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:53.822672 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1080/2175] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:32:53.824252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22703e-3e5e-4981-960a-d08bf615f160 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:53.829110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-48ea5224-7e35-4fbd-998a-3294cf48bc06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9a1fcd44c30462a8ea4a6dbbc70e8eb', 'request_id': 'req-48ea5224-7e35-4fbd-998a-3294cf48bc06'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.836947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22703e-3e5e-4981-960a-d08bf615f160 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:53.841853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-48ea5224-7e35-4fbd-998a-3294cf48bc06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9a1fcd44c30462a8ea4a6dbbc70e8eb', 'request_id': 'req-48ea5224-7e35-4fbd-998a-3294cf48bc06'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.853955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-48ea5224-7e35-4fbd-998a-3294cf48bc06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9a1fcd44c30462a8ea4a6dbbc70e8eb', 'request_id': 'req-48ea5224-7e35-4fbd-998a-3294cf48bc06'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.875397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-48ea5224-7e35-4fbd-998a-3294cf48bc06 admin admin] The token cache is being invalidate because project c9a1fcd44c30462a8ea4a6dbbc70e8eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:53.875866 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-48ea5224-7e35-4fbd-998a-3294cf48bc06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.876904 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-48ea5224-7e35-4fbd-998a-3294cf48bc06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:53.880404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1096/2176] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:53 2022] DELETE /identity/v3/projects/c9a1fcd44c30462a8ea4a6dbbc70e8eb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:53.886678 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255018c-25d3-4a55-a8a6-f673295e7d3a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:53.887193 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255018c-25d3-4a55-a8a6-f673295e7d3a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:53.887620 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255018c-25d3-4a55-a8a6-f673295e7d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:53.903402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffa5c4-4002-4c22-8c7f-5fe82ec3c130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:53.904073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffa5c4-4002-4c22-8c7f-5fe82ec3c130 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:53.904359 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffa5c4-4002-4c22-8c7f-5fe82ec3c130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:53.904636 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffa5c4-4002-4c22-8c7f-5fe82ec3c130 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:53.905401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffa5c4-4002-4c22-8c7f-5fe82ec3c130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:53.907431 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffa5c4-4002-4c22-8c7f-5fe82ec3c130 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:53.924469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2255018c-25d3-4a55-a8a6-f673295e7d3a None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:53.926255 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2255018c-25d3-4a55-a8a6-f673295e7d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:53.948208 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1097/2177] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:53.950215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dda7e-818e-43f5-9d2c-1e2e7429e933 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:53.950508 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dda7e-818e-43f5-9d2c-1e2e7429e933 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:53.952890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dda7e-818e-43f5-9d2c-1e2e7429e933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:53.954053 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1081/2178] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:53 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:53.955766 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffa5c4-4002-4c22-8c7f-5fe82ec3c130 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:53.957999 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b1ffa5c4-4002-4c22-8c7f-5fe82ec3c130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:53.983513 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e32dda7e-818e-43f5-9d2c-1e2e7429e933 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:53.984806 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e32dda7e-818e-43f5-9d2c-1e2e7429e933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:54.033968 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:54.043136 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:54.064537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffa5c4-4002-4c22-8c7f-5fe82ec3c130 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:54.070880 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453c13c-460d-42f7-96f3-1c001b2d7dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:54.071728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453c13c-460d-42f7-96f3-1c001b2d7dde admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.072008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453c13c-460d-42f7-96f3-1c001b2d7dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.072953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453c13c-460d-42f7-96f3-1c001b2d7dde admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.073669 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453c13c-460d-42f7-96f3-1c001b2d7dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:54.077817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1098/2179] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:54.077983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453c13c-460d-42f7-96f3-1c001b2d7dde admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:54.079284 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dda7e-818e-43f5-9d2c-1e2e7429e933 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:54.090020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dda7e-818e-43f5-9d2c-1e2e7429e933 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:54.098002 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfb4a6-07e5-4d14-a72b-24a1844f0925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:54.099022 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfb4a6-07e5-4d14-a72b-24a1844f0925 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.099308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfb4a6-07e5-4d14-a72b-24a1844f0925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.099581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfb4a6-07e5-4d14-a72b-24a1844f0925 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.100317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfb4a6-07e5-4d14-a72b-24a1844f0925 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:32:54.100774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfb4a6-07e5-4d14-a72b-24a1844f0925 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:54.103200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfb4a6-07e5-4d14-a72b-24a1844f0925 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:54.104404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1082/2180] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:53 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:54.109457 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453c13c-460d-42f7-96f3-1c001b2d7dde admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:54.118984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1099/2181] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:32:54.124690 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfb4a6-07e5-4d14-a72b-24a1844f0925 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:54.126172 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453c13c-460d-42f7-96f3-1c001b2d7dde admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:54.142123 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfb4a6-07e5-4d14-a72b-24a1844f0925 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:54.147671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff3bb8-aa06-4bd7-8756-95b822220942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:54.147983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff3bb8-aa06-4bd7-8756-95b822220942 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.148268 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff3bb8-aa06-4bd7-8756-95b822220942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.148544 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff3bb8-aa06-4bd7-8756-95b822220942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.149288 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff3bb8-aa06-4bd7-8756-95b822220942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:54.150037 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e86422-df9d-449d-83aa-78ca8e0a250e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:54.150936 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff3bb8-aa06-4bd7-8756-95b822220942 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:54.151443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e86422-df9d-449d-83aa-78ca8e0a250e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.151966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e86422-df9d-449d-83aa-78ca8e0a250e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.152484 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e86422-df9d-449d-83aa-78ca8e0a250e admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.153355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e86422-df9d-449d-83aa-78ca8e0a250e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:54.155473 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e86422-df9d-449d-83aa-78ca8e0a250e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:54.168010 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1083/2182] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:54.169038 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff3bb8-aa06-4bd7-8756-95b822220942 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:54.181571 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff3bb8-aa06-4bd7-8756-95b822220942 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:54.189659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1332f9f-0289-4d8c-9f56-b981314393c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:54.190421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1332f9f-0289-4d8c-9f56-b981314393c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.190853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1332f9f-0289-4d8c-9f56-b981314393c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.191194 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1332f9f-0289-4d8c-9f56-b981314393c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.192007 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1332f9f-0289-4d8c-9f56-b981314393c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:54.193722 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1332f9f-0289-4d8c-9f56-b981314393c4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:54.200062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1100/2183] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:54 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:54.204013 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e86422-df9d-449d-83aa-78ca8e0a250e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:54.209060 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1084/2184] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:54.210029 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1332f9f-0289-4d8c-9f56-b981314393c4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:54.222527 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1332f9f-0289-4d8c-9f56-b981314393c4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:54.306062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e86422-df9d-449d-83aa-78ca8e0a250e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:54.312380 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bf066-3283-4d08-806e-bdc3c062ea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:54.313603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bf066-3283-4d08-806e-bdc3c062ea24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.314724 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b46e9b-3176-4893-bb36-9a07f7fbbfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:54.315754 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b46e9b-3176-4893-bb36-9a07f7fbbfaa admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.315962 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b46e9b-3176-4893-bb36-9a07f7fbbfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.316275 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b46e9b-3176-4893-bb36-9a07f7fbbfaa admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.317273 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b46e9b-3176-4893-bb36-9a07f7fbbfaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:54.317355 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bf066-3283-4d08-806e-bdc3c062ea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.317520 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bf066-3283-4d08-806e-bdc3c062ea24 admin admin] PATH_INFO: `/v3/projects/8d5e38746f2544b698d054b8d3ceded4/users/7af61f5e965a4eaca8337d74edf8b884/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.320327 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b46e9b-3176-4893-bb36-9a07f7fbbfaa admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:54.337529 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bf066-3283-4d08-806e-bdc3c062ea24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d5e38746f2544b698d054b8d3ceded4, user_id=7af61f5e965a4eaca8337d74edf8b884, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:54.346314 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bf066-3283-4d08-806e-bdc3c062ea24 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:54.348586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1101/2185] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:54 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:32:54.352284 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b46e9b-3176-4893-bb36-9a07f7fbbfaa admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:54.363049 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1085/2186] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:54 2022] PUT /identity/v3/projects/8d5e38746f2544b698d054b8d3ceded4/users/7af61f5e965a4eaca8337d74edf8b884/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:54.366865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b46e9b-3176-4893-bb36-9a07f7fbbfaa admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:54.374388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64be216-2e4c-44ca-9f26-a7e94128d35e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.374865 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64be216-2e4c-44ca-9f26-a7e94128d35e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.375282 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64be216-2e4c-44ca-9f26-a7e94128d35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.405106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a64be216-2e4c-44ca-9f26-a7e94128d35e None None] MFA Rules not processed for user `7af61f5e965a4eaca8337d74edf8b884`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:54.407028 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a64be216-2e4c-44ca-9f26-a7e94128d35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:54.442611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00597a-f015-4aa9-b344-0c73d2ff874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:54.443446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00597a-f015-4aa9-b344-0c73d2ff874e admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.443784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00597a-f015-4aa9-b344-0c73d2ff874e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.444127 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00597a-f015-4aa9-b344-0c73d2ff874e admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.446852 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00597a-f015-4aa9-b344-0c73d2ff874e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:54.448937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00597a-f015-4aa9-b344-0c73d2ff874e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:54.462525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1102/2187] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:32:54.466619 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00597a-f015-4aa9-b344-0c73d2ff874e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:54.485286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00597a-f015-4aa9-b344-0c73d2ff874e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:54.492054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496943b-866f-4fd6-ab32-19a51511c13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:54.493416 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496943b-866f-4fd6-ab32-19a51511c13b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.493901 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496943b-866f-4fd6-ab32-19a51511c13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.494359 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496943b-866f-4fd6-ab32-19a51511c13b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.496090 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496943b-866f-4fd6-ab32-19a51511c13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:54.498455 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496943b-866f-4fd6-ab32-19a51511c13b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:54.507372 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1086/2188] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:54.517754 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1103/2189] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:54.518544 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64be216-2e4c-44ca-9f26-a7e94128d35e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:54.520049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496943b-866f-4fd6-ab32-19a51511c13b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:54.520354 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a64be216-2e4c-44ca-9f26-a7e94128d35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:54.531824 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496943b-866f-4fd6-ab32-19a51511c13b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:54.537583 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eae97c-7368-442e-83b8-483b151cd45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:54.539626 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eae97c-7368-442e-83b8-483b151cd45a admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.539626 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eae97c-7368-442e-83b8-483b151cd45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.539626 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eae97c-7368-442e-83b8-483b151cd45a admin admin] PATH_INFO: `/v3/projects/a14046f2da524ee8b6fd7cfb4ec780b1/users/47b6fb8538294294b5f5a99e20650253/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.553500 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:54.558876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eae97c-7368-442e-83b8-483b151cd45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14046f2da524ee8b6fd7cfb4ec780b1, user_id=47b6fb8538294294b5f5a99e20650253, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:54.562421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eae97c-7368-442e-83b8-483b151cd45a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:54.574650 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:54.590780 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1104/2190] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:54 2022] PUT /identity/v3/projects/a14046f2da524ee8b6fd7cfb4ec780b1/users/47b6fb8538294294b5f5a99e20650253/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:54.597115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0079005-fd23-457c-9640-53db3056a068 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.597401 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0079005-fd23-457c-9640-53db3056a068 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.597943 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0079005-fd23-457c-9640-53db3056a068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.623180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64be216-2e4c-44ca-9f26-a7e94128d35e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:54.643229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c0079005-fd23-457c-9640-53db3056a068 None None] MFA Rules not processed for user `47b6fb8538294294b5f5a99e20650253`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:54.644828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c0079005-fd23-457c-9640-53db3056a068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:54.726474 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dce2cd-fb5d-4981-9235-6a88e4f8176f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:54.726474 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dce2cd-fb5d-4981-9235-6a88e4f8176f service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.726981 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dce2cd-fb5d-4981-9235-6a88e4f8176f service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.727331 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dce2cd-fb5d-4981-9235-6a88e4f8176f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.740785 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1105/2191] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:54.742460 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0079005-fd23-457c-9640-53db3056a068 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:54.744483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c0079005-fd23-457c-9640-53db3056a068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:54.792924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dce2cd-fb5d-4981-9235-6a88e4f8176f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:54.794275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dce2cd-fb5d-4981-9235-6a88e4f8176f service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:54.806557 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1087/2192] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:32:54.807448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dce2cd-fb5d-4981-9235-6a88e4f8176f service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:54.808819 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f8dce2cd-fb5d-4981-9235-6a88e4f8176f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:54.819877 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dce2cd-fb5d-4981-9235-6a88e4f8176f service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:54.824912 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca289cc-a986-421c-a755-b17ac1e65052 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:54.825763 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca289cc-a986-421c-a755-b17ac1e65052 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.826192 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca289cc-a986-421c-a755-b17ac1e65052 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.826976 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca289cc-a986-421c-a755-b17ac1e65052 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.835875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0079005-fd23-457c-9640-53db3056a068 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:54.837604 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca289cc-a986-421c-a755-b17ac1e65052 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:54.839062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca289cc-a986-421c-a755-b17ac1e65052 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:54.841801 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bb14b-8aea-4b2b-a8bc-b498eb544317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:54.846426 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bb14b-8aea-4b2b-a8bc-b498eb544317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.846796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bb14b-8aea-4b2b-a8bc-b498eb544317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.847090 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bb14b-8aea-4b2b-a8bc-b498eb544317 admin admin] PATH_INFO: `/v3/projects/fe2887e015494f139191ebcc6be4e0df` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.848346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bb14b-8aea-4b2b-a8bc-b498eb544317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2887e015494f139191ebcc6be4e0df)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:54.849296 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1088/2193] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:54.850553 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bb14b-8aea-4b2b-a8bc-b498eb544317 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:54.876780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca289cc-a986-421c-a755-b17ac1e65052 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:54.890784 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca289cc-a986-421c-a755-b17ac1e65052 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:54.900346 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73b8e8-156f-48bb-aed9-a591b5c06d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:54.902130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73b8e8-156f-48bb-aed9-a591b5c06d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.902566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73b8e8-156f-48bb-aed9-a591b5c06d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.902878 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73b8e8-156f-48bb-aed9-a591b5c06d49 admin admin] PATH_INFO: `/v3/users/47b6fb8538294294b5f5a99e20650253` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.904741 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73b8e8-156f-48bb-aed9-a591b5c06d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47b6fb8538294294b5f5a99e20650253)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:54.907187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73b8e8-156f-48bb-aed9-a591b5c06d49 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:54.947509 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b96bb14b-8aea-4b2b-a8bc-b498eb544317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2887e015494f139191ebcc6be4e0df', 'request_id': 'req-b96bb14b-8aea-4b2b-a8bc-b498eb544317'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:54.958368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b96bb14b-8aea-4b2b-a8bc-b498eb544317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2887e015494f139191ebcc6be4e0df', 'request_id': 'req-b96bb14b-8aea-4b2b-a8bc-b498eb544317'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:54.971957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b96bb14b-8aea-4b2b-a8bc-b498eb544317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2887e015494f139191ebcc6be4e0df', 'request_id': 'req-b96bb14b-8aea-4b2b-a8bc-b498eb544317'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:54.987898 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b96bb14b-8aea-4b2b-a8bc-b498eb544317 admin admin] The token cache is being invalidate because project fe2887e015494f139191ebcc6be4e0df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:54.987898 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b96bb14b-8aea-4b2b-a8bc-b498eb544317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:54.988894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b96bb14b-8aea-4b2b-a8bc-b498eb544317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:54.992679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1106/2194] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:54 2022] DELETE /identity/v3/projects/fe2887e015494f139191ebcc6be4e0df => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:54.995420 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0d73b8e8-156f-48bb-aed9-a591b5c06d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47b6fb8538294294b5f5a99e20650253'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:54.999381 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb8f28-46b5-4406-bd81-21c9d7688d26 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.999763 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb8f28-46b5-4406-bd81-21c9d7688d26 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:55.000207 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb8f28-46b5-4406-bd81-21c9d7688d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:55.004800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0d73b8e8-156f-48bb-aed9-a591b5c06d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47b6fb8538294294b5f5a99e20650253'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:55.022351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0d73b8e8-156f-48bb-aed9-a591b5c06d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47b6fb8538294294b5f5a99e20650253'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:55.024995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3bbb8f28-46b5-4406-bd81-21c9d7688d26 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:55.026373 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3bbb8f28-46b5-4406-bd81-21c9d7688d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:55.031495 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:55.035437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0d73b8e8-156f-48bb-aed9-a591b5c06d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47b6fb8538294294b5f5a99e20650253'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:55.036787 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0d73b8e8-156f-48bb-aed9-a591b5c06d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47b6fb8538294294b5f5a99e20650253'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:55.040394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:55.051297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1089/2195] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:54 2022] DELETE /identity/v3/users/47b6fb8538294294b5f5a99e20650253 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:55.056256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63a7ef-618c-4c57-8cdb-ad5fee2b93d2 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:55.056709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63a7ef-618c-4c57-8cdb-ad5fee2b93d2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:55.057196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63a7ef-618c-4c57-8cdb-ad5fee2b93d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:55.090193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7d63a7ef-618c-4c57-8cdb-ad5fee2b93d2 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:55.092005 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7d63a7ef-618c-4c57-8cdb-ad5fee2b93d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:55.117121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1107/2196] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:55.125002 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4d698-003a-403a-97d6-9e41ac40c763 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:55.125315 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4d698-003a-403a-97d6-9e41ac40c763 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:55.125600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4d698-003a-403a-97d6-9e41ac40c763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:55.149729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-91f4d698-003a-403a-97d6-9e41ac40c763 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:55.150974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-91f4d698-003a-403a-97d6-9e41ac40c763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:55.190783 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1090/2197] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:55.203057 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63a7ef-618c-4c57-8cdb-ad5fee2b93d2 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:55.205063 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7d63a7ef-618c-4c57-8cdb-ad5fee2b93d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:55.256089 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1108/2198] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:55.256089 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4d698-003a-403a-97d6-9e41ac40c763 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:55.263449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4d698-003a-403a-97d6-9e41ac40c763 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:55.271199 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e53fd-222c-4b82-b939-19eacb17e8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:55.272392 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e53fd-222c-4b82-b939-19eacb17e8dc admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:55.272745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e53fd-222c-4b82-b939-19eacb17e8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:55.273132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e53fd-222c-4b82-b939-19eacb17e8dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:55.274181 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e53fd-222c-4b82-b939-19eacb17e8dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:32:55.274493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e53fd-222c-4b82-b939-19eacb17e8dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:55.278661 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e53fd-222c-4b82-b939-19eacb17e8dc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:55.296621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1109/2199] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:32:55.297496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e53fd-222c-4b82-b939-19eacb17e8dc admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:55.320716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63a7ef-618c-4c57-8cdb-ad5fee2b93d2 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:55.321116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e53fd-222c-4b82-b939-19eacb17e8dc admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:55.325391 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c386f5-2a74-429f-852f-94c9e68cc8f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:55.326475 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c386f5-2a74-429f-852f-94c9e68cc8f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:55.326587 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f245922-8fe3-40a8-bf6c-865ad9ed668d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:55.326853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c386f5-2a74-429f-852f-94c9e68cc8f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:55.327073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c386f5-2a74-429f-852f-94c9e68cc8f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:55.327279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f245922-8fe3-40a8-bf6c-865ad9ed668d admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:55.327554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f245922-8fe3-40a8-bf6c-865ad9ed668d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:55.327829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f245922-8fe3-40a8-bf6c-865ad9ed668d admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:55.328673 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f245922-8fe3-40a8-bf6c-865ad9ed668d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:55.331278 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f245922-8fe3-40a8-bf6c-865ad9ed668d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:55.338428 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c386f5-2a74-429f-852f-94c9e68cc8f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:55.339951 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c386f5-2a74-429f-852f-94c9e68cc8f7 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:55.353701 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1091/2200] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:55.360288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1110/2201] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:32:55 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:55.364757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c386f5-2a74-429f-852f-94c9e68cc8f7 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:55.374939 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c386f5-2a74-429f-852f-94c9e68cc8f7 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:55.451002 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab833d-a6e6-4c1b-ae45-18630144399f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:55.451792 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab833d-a6e6-4c1b-ae45-18630144399f admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:55.452197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab833d-a6e6-4c1b-ae45-18630144399f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:55.452552 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab833d-a6e6-4c1b-ae45-18630144399f admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:55.453403 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab833d-a6e6-4c1b-ae45-18630144399f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:55.456347 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab833d-a6e6-4c1b-ae45-18630144399f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:55.481381 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1092/2202] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:32:55 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:32:55.482607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f245922-8fe3-40a8-bf6c-865ad9ed668d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:55.495089 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f245922-8fe3-40a8-bf6c-865ad9ed668d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:55.502503 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6b9d0-983d-4d51-969f-5af96f9927d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:55.504254 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6b9d0-983d-4d51-969f-5af96f9927d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:55.504254 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6b9d0-983d-4d51-969f-5af96f9927d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:55.504254 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6b9d0-983d-4d51-969f-5af96f9927d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:55.504588 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6b9d0-983d-4d51-969f-5af96f9927d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:55.506116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6b9d0-983d-4d51-969f-5af96f9927d0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:55.520727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1111/2203] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:32:55.522666 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab833d-a6e6-4c1b-ae45-18630144399f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:55.538976 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab833d-a6e6-4c1b-ae45-18630144399f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:55.544726 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae384a9-cb6c-438e-b8a5-82253f4ae9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:55.545604 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae384a9-cb6c-438e-b8a5-82253f4ae9fb admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:55.546258 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae384a9-cb6c-438e-b8a5-82253f4ae9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:55.546258 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae384a9-cb6c-438e-b8a5-82253f4ae9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:55.546921 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae384a9-cb6c-438e-b8a5-82253f4ae9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:55.548692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae384a9-cb6c-438e-b8a5-82253f4ae9fb admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:55.562834 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1093/2204] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:32:55.565564 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6b9d0-983d-4d51-969f-5af96f9927d0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:55.575629 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6b9d0-983d-4d51-969f-5af96f9927d0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:55.580974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d168d-0d65-4c0d-aaa3-4e0400a49c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:55.581791 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d168d-0d65-4c0d-aaa3-4e0400a49c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:55.582067 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d168d-0d65-4c0d-aaa3-4e0400a49c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:55.582339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d168d-0d65-4c0d-aaa3-4e0400a49c45 admin admin] PATH_INFO: `/v3/projects/8f34f3d671e84e7d82b43027aaa54d2b/users/074d31f2932545538ba05289aa4efd56/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:55.597497 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d168d-0d65-4c0d-aaa3-4e0400a49c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f34f3d671e84e7d82b43027aaa54d2b, user_id=074d31f2932545538ba05289aa4efd56, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:55.600189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d168d-0d65-4c0d-aaa3-4e0400a49c45 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:55.613502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1112/2205] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:32:55 2022] PUT /identity/v3/projects/8f34f3d671e84e7d82b43027aaa54d2b/users/074d31f2932545538ba05289aa4efd56/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:55.618558 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cea725-58ee-4f46-a957-6a11b20d7bbc None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:55.619078 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cea725-58ee-4f46-a957-6a11b20d7bbc None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:55.619360 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cea725-58ee-4f46-a957-6a11b20d7bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:55.638516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-84cea725-58ee-4f46-a957-6a11b20d7bbc None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:55.639835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-84cea725-58ee-4f46-a957-6a11b20d7bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:55.660419 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:55.665476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d168d-0d65-4c0d-aaa3-4e0400a49c45 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:55.667750 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-851d168d-0d65-4c0d-aaa3-4e0400a49c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:55.734787 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1094/2206] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:55.744996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cea725-58ee-4f46-a957-6a11b20d7bbc None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:55.747843 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-84cea725-58ee-4f46-a957-6a11b20d7bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:55.758179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:55.793471 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d168d-0d65-4c0d-aaa3-4e0400a49c45 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:55.798600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ac351-1b10-4491-958d-844eb48404fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:55.801001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ac351-1b10-4491-958d-844eb48404fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:55.801099 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ac351-1b10-4491-958d-844eb48404fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:55.801304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ac351-1b10-4491-958d-844eb48404fd admin admin] PATH_INFO: `/v3/projects/a14046f2da524ee8b6fd7cfb4ec780b1` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:55.802707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ac351-1b10-4491-958d-844eb48404fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a14046f2da524ee8b6fd7cfb4ec780b1)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:55.805159 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ac351-1b10-4491-958d-844eb48404fd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:55.843149 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cea725-58ee-4f46-a957-6a11b20d7bbc None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:55.860098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-047ac351-1b10-4491-958d-844eb48404fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14046f2da524ee8b6fd7cfb4ec780b1', 'request_id': 'req-047ac351-1b10-4491-958d-844eb48404fd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:55.866294 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-047ac351-1b10-4491-958d-844eb48404fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14046f2da524ee8b6fd7cfb4ec780b1', 'request_id': 'req-047ac351-1b10-4491-958d-844eb48404fd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:55.873485 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-047ac351-1b10-4491-958d-844eb48404fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14046f2da524ee8b6fd7cfb4ec780b1', 'request_id': 'req-047ac351-1b10-4491-958d-844eb48404fd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:55.885167 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-047ac351-1b10-4491-958d-844eb48404fd admin admin] The token cache is being invalidate because project a14046f2da524ee8b6fd7cfb4ec780b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:55.885423 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-047ac351-1b10-4491-958d-844eb48404fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:55.886127 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-047ac351-1b10-4491-958d-844eb48404fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:55.887817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1113/2207] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:55 2022] DELETE /identity/v3/projects/a14046f2da524ee8b6fd7cfb4ec780b1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:32:55.905455 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53050921-13ad-4e74-b4f3-584953fe370a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:55.906141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53050921-13ad-4e74-b4f3-584953fe370a service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:55.906425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53050921-13ad-4e74-b4f3-584953fe370a service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:55.906697 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53050921-13ad-4e74-b4f3-584953fe370a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:55.909665 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-53050921-13ad-4e74-b4f3-584953fe370a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:55.981727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53050921-13ad-4e74-b4f3-584953fe370a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:55.983227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53050921-13ad-4e74-b4f3-584953fe370a service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:55.995062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1095/2208] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:32:58.704369 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ac351-1b10-4491-958d-844eb48404fd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:58.707364 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-047ac351-1b10-4491-958d-844eb48404fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:58.725306 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ac351-1b10-4491-958d-844eb48404fd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:58.741227 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb08c1-cbd1-47b2-9c3c-b7a858efc7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:58.742522 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb08c1-cbd1-47b2-9c3c-b7a858efc7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:58.743227 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb08c1-cbd1-47b2-9c3c-b7a858efc7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:58.743748 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb08c1-cbd1-47b2-9c3c-b7a858efc7ee admin admin] PATH_INFO: `/v3/users/cdce8bd21fee472bab8b9ff92a35f3d0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:58.745263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb08c1-cbd1-47b2-9c3c-b7a858efc7ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdce8bd21fee472bab8b9ff92a35f3d0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:58.749956 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb08c1-cbd1-47b2-9c3c-b7a858efc7ee admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:58.811812 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e3fb08c1-cbd1-47b2-9c3c-b7a858efc7ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdce8bd21fee472bab8b9ff92a35f3d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:58.822657 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e3fb08c1-cbd1-47b2-9c3c-b7a858efc7ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdce8bd21fee472bab8b9ff92a35f3d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:58.839497 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e3fb08c1-cbd1-47b2-9c3c-b7a858efc7ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdce8bd21fee472bab8b9ff92a35f3d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:58.849012 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e3fb08c1-cbd1-47b2-9c3c-b7a858efc7ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdce8bd21fee472bab8b9ff92a35f3d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:58.850002 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e3fb08c1-cbd1-47b2-9c3c-b7a858efc7ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdce8bd21fee472bab8b9ff92a35f3d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:58.858609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1114/2209] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:58 2022] DELETE /identity/v3/users/cdce8bd21fee472bab8b9ff92a35f3d0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:58.864092 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babc591-4ea4-47ab-9298-af227fe4c938 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:58.864632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babc591-4ea4-47ab-9298-af227fe4c938 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:58.864632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babc591-4ea4-47ab-9298-af227fe4c938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:58.887171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2babc591-4ea4-47ab-9298-af227fe4c938 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:58.888565 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2babc591-4ea4-47ab-9298-af227fe4c938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:58.927719 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:58.979976 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1096/2210] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:58.990607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb08c1-cbd1-47b2-9c3c-b7a858efc7ee admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:58.992251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e3fb08c1-cbd1-47b2-9c3c-b7a858efc7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:59.050788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:59.075345 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb08c1-cbd1-47b2-9c3c-b7a858efc7ee admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:59.081051 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d822b-7b31-4e8e-ad04-b3474d691e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:59.081739 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d822b-7b31-4e8e-ad04-b3474d691e22 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:59.081987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d822b-7b31-4e8e-ad04-b3474d691e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:59.082259 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d822b-7b31-4e8e-ad04-b3474d691e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:59.094335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d822b-7b31-4e8e-ad04-b3474d691e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:59.096637 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d822b-7b31-4e8e-ad04-b3474d691e22 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:59.115104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1115/2211] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:59.452419 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babc591-4ea4-47ab-9298-af227fe4c938 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:59.457218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2babc591-4ea4-47ab-9298-af227fe4c938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:59.478105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babc591-4ea4-47ab-9298-af227fe4c938 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:59.509325 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f382b9b-30cd-479d-8cbf-9a748892412c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:59.510334 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382b9b-30cd-479d-8cbf-9a748892412c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:59.510623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382b9b-30cd-479d-8cbf-9a748892412c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:59.511031 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382b9b-30cd-479d-8cbf-9a748892412c admin admin] PATH_INFO: `/v3/users/b2062e2ea5564250ae838e538ce78565` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:59.515643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f382b9b-30cd-479d-8cbf-9a748892412c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2062e2ea5564250ae838e538ce78565)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:59.517754 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f382b9b-30cd-479d-8cbf-9a748892412c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:59.576169 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d822b-7b31-4e8e-ad04-b3474d691e22 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:59.578139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-161d822b-7b31-4e8e-ad04-b3474d691e22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:59.600770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d822b-7b31-4e8e-ad04-b3474d691e22 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:59.609470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db900a75-6455-4b4d-859e-26a31cb47102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:59.614281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db900a75-6455-4b4d-859e-26a31cb47102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:59.615218 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db900a75-6455-4b4d-859e-26a31cb47102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:59.615663 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db900a75-6455-4b4d-859e-26a31cb47102 admin admin] PATH_INFO: `/v3/projects/d8d29c8c196e439eb6881b67d24e872c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:59.620838 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db900a75-6455-4b4d-859e-26a31cb47102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8d29c8c196e439eb6881b67d24e872c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:59.642265 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db900a75-6455-4b4d-859e-26a31cb47102 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:59.654367 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6f382b9b-30cd-479d-8cbf-9a748892412c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2062e2ea5564250ae838e538ce78565'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:59.664958 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6f382b9b-30cd-479d-8cbf-9a748892412c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2062e2ea5564250ae838e538ce78565'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:59.681298 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6f382b9b-30cd-479d-8cbf-9a748892412c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2062e2ea5564250ae838e538ce78565'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:59.738307 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6f382b9b-30cd-479d-8cbf-9a748892412c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2062e2ea5564250ae838e538ce78565'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:59.738883 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6f382b9b-30cd-479d-8cbf-9a748892412c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2062e2ea5564250ae838e538ce78565'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:59.748001 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1097/2212] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:59 2022] DELETE /identity/v3/users/b2062e2ea5564250ae838e538ce78565 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:59.752576 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a3f37-cb8b-4f98-bc35-2cad6b8206c0 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:59.753167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a3f37-cb8b-4f98-bc35-2cad6b8206c0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:59.753686 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a3f37-cb8b-4f98-bc35-2cad6b8206c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:59.796600 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-fe3a3f37-cb8b-4f98-bc35-2cad6b8206c0 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:59.799456 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fe3a3f37-cb8b-4f98-bc35-2cad6b8206c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:59.803489 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-db900a75-6455-4b4d-859e-26a31cb47102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8d29c8c196e439eb6881b67d24e872c', 'request_id': 'req-db900a75-6455-4b4d-859e-26a31cb47102'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:59.822513 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-db900a75-6455-4b4d-859e-26a31cb47102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8d29c8c196e439eb6881b67d24e872c', 'request_id': 'req-db900a75-6455-4b4d-859e-26a31cb47102'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:59.854275 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-db900a75-6455-4b4d-859e-26a31cb47102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8d29c8c196e439eb6881b67d24e872c', 'request_id': 'req-db900a75-6455-4b4d-859e-26a31cb47102'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:59.901306 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1098/2213] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:32:59.903309 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-db900a75-6455-4b4d-859e-26a31cb47102 admin admin] The token cache is being invalidate because project d8d29c8c196e439eb6881b67d24e872c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:32:59.903555 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a3f37-cb8b-4f98-bc35-2cad6b8206c0 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:59.903694 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-db900a75-6455-4b4d-859e-26a31cb47102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:59.904915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-db900a75-6455-4b4d-859e-26a31cb47102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:32:59.906961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1116/2214] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:32:59 2022] DELETE /identity/v3/projects/d8d29c8c196e439eb6881b67d24e872c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:32:59.907143 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fe3a3f37-cb8b-4f98-bc35-2cad6b8206c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:59.911685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db900a75-6455-4b4d-859e-26a31cb47102 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:59.914703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-db900a75-6455-4b4d-859e-26a31cb47102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:59.932617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db900a75-6455-4b4d-859e-26a31cb47102 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:59.942676 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee55988-31cf-4040-81b2-47335da9d63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:59.944704 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee55988-31cf-4040-81b2-47335da9d63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:59.945300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee55988-31cf-4040-81b2-47335da9d63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:59.945957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee55988-31cf-4040-81b2-47335da9d63c admin admin] PATH_INFO: `/v3/users/96ee316a9dc2410f845aca47811ddeb4` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:59.947532 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee55988-31cf-4040-81b2-47335da9d63c admin admin] RBAC: Authorizing `identity:delete_user(user_id=96ee316a9dc2410f845aca47811ddeb4)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:59.951540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee55988-31cf-4040-81b2-47335da9d63c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:59.971239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:59.988977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a3f37-cb8b-4f98-bc35-2cad6b8206c0 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:59.996112 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2267421-ac66-40f4-9d84-5e1739052c24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:59.997025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2267421-ac66-40f4-9d84-5e1739052c24 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:59.997306 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2267421-ac66-40f4-9d84-5e1739052c24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:59.997635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2267421-ac66-40f4-9d84-5e1739052c24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:00.000915 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c2267421-ac66-40f4-9d84-5e1739052c24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:00.020256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2267421-ac66-40f4-9d84-5e1739052c24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:00.021885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2267421-ac66-40f4-9d84-5e1739052c24 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:00.027783 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0ee55988-31cf-4040-81b2-47335da9d63c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96ee316a9dc2410f845aca47811ddeb4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:00.035366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1099/2215] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:00.046273 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0ee55988-31cf-4040-81b2-47335da9d63c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96ee316a9dc2410f845aca47811ddeb4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:00.061352 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0ee55988-31cf-4040-81b2-47335da9d63c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96ee316a9dc2410f845aca47811ddeb4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:00.071586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0ee55988-31cf-4040-81b2-47335da9d63c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96ee316a9dc2410f845aca47811ddeb4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:00.072446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0ee55988-31cf-4040-81b2-47335da9d63c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96ee316a9dc2410f845aca47811ddeb4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:00.097410 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1117/2216] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:32:59 2022] DELETE /identity/v3/users/96ee316a9dc2410f845aca47811ddeb4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:00.779731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2267421-ac66-40f4-9d84-5e1739052c24 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:00.781995 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c2267421-ac66-40f4-9d84-5e1739052c24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:00.842226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2267421-ac66-40f4-9d84-5e1739052c24 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:00.906235 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee55988-31cf-4040-81b2-47335da9d63c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:00.910158 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0ee55988-31cf-4040-81b2-47335da9d63c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:01.010008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2660ce-c1e0-4987-b6f1-d135dd74047a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:01.012472 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2660ce-c1e0-4987-b6f1-d135dd74047a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:01.012964 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2660ce-c1e0-4987-b6f1-d135dd74047a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:01.013480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2660ce-c1e0-4987-b6f1-d135dd74047a admin admin] PATH_INFO: `/v3/users/7af61f5e965a4eaca8337d74edf8b884` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:01.015858 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2660ce-c1e0-4987-b6f1-d135dd74047a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af61f5e965a4eaca8337d74edf8b884)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:01.020102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2660ce-c1e0-4987-b6f1-d135dd74047a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:01.046913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:01.108119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee55988-31cf-4040-81b2-47335da9d63c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:01.115634 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5f2660ce-c1e0-4987-b6f1-d135dd74047a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af61f5e965a4eaca8337d74edf8b884'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:01.123070 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa912f19-57ee-4832-9897-db5d5df08eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:01.123974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa912f19-57ee-4832-9897-db5d5df08eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:01.124260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa912f19-57ee-4832-9897-db5d5df08eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:01.124531 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa912f19-57ee-4832-9897-db5d5df08eb7 admin admin] PATH_INFO: `/v3/projects/9c6d15ff96e54837b2dbb2dd56cce183` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:01.126853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5f2660ce-c1e0-4987-b6f1-d135dd74047a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af61f5e965a4eaca8337d74edf8b884'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:01.127727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa912f19-57ee-4832-9897-db5d5df08eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6d15ff96e54837b2dbb2dd56cce183)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:01.129973 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa912f19-57ee-4832-9897-db5d5df08eb7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:01.154544 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5f2660ce-c1e0-4987-b6f1-d135dd74047a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af61f5e965a4eaca8337d74edf8b884'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:01.169257 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5f2660ce-c1e0-4987-b6f1-d135dd74047a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af61f5e965a4eaca8337d74edf8b884'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:01.169896 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5f2660ce-c1e0-4987-b6f1-d135dd74047a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af61f5e965a4eaca8337d74edf8b884'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:01.182837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1100/2217] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:33:00 2022] DELETE /identity/v3/users/7af61f5e965a4eaca8337d74edf8b884 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:01.183826 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2660ce-c1e0-4987-b6f1-d135dd74047a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:01.186535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5f2660ce-c1e0-4987-b6f1-d135dd74047a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:01.229891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-aa912f19-57ee-4832-9897-db5d5df08eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6d15ff96e54837b2dbb2dd56cce183', 'request_id': 'req-aa912f19-57ee-4832-9897-db5d5df08eb7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:01.239170 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-aa912f19-57ee-4832-9897-db5d5df08eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6d15ff96e54837b2dbb2dd56cce183', 'request_id': 'req-aa912f19-57ee-4832-9897-db5d5df08eb7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:01.252031 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-aa912f19-57ee-4832-9897-db5d5df08eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6d15ff96e54837b2dbb2dd56cce183', 'request_id': 'req-aa912f19-57ee-4832-9897-db5d5df08eb7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:01.269894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-aa912f19-57ee-4832-9897-db5d5df08eb7 admin admin] The token cache is being invalidate because project 9c6d15ff96e54837b2dbb2dd56cce183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:01.270187 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-aa912f19-57ee-4832-9897-db5d5df08eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:01.271106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-aa912f19-57ee-4832-9897-db5d5df08eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:01.273617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1118/2218] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:00 2022] DELETE /identity/v3/projects/9c6d15ff96e54837b2dbb2dd56cce183 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:01.275274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1296f-0239-407e-b962-b291e3030dbb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:01.275560 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1296f-0239-407e-b962-b291e3030dbb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:01.275839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1296f-0239-407e-b962-b291e3030dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:01.302727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2660ce-c1e0-4987-b6f1-d135dd74047a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:01.312407 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-11b1296f-0239-407e-b962-b291e3030dbb None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:01.314784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-11b1296f-0239-407e-b962-b291e3030dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:01.322266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:01.412697 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa524f-f6de-4394-b16a-6b7132586b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:01.414457 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa524f-f6de-4394-b16a-6b7132586b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:01.415058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa524f-f6de-4394-b16a-6b7132586b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:01.415533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa524f-f6de-4394-b16a-6b7132586b39 admin admin] PATH_INFO: `/v3/projects/ff162f7e2adc4dd8a464bac5d0f4b313` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:01.417238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa524f-f6de-4394-b16a-6b7132586b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff162f7e2adc4dd8a464bac5d0f4b313)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:01.419825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa524f-f6de-4394-b16a-6b7132586b39 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:01.453469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1119/2219] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:01.466713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f83d3-4dd5-43bb-a4b1-6753c105732a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:01.467680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f83d3-4dd5-43bb-a4b1-6753c105732a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:01.467680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f83d3-4dd5-43bb-a4b1-6753c105732a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:01.501889 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d44f83d3-4dd5-43bb-a4b1-6753c105732a None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:01.505810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d44f83d3-4dd5-43bb-a4b1-6753c105732a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:01.509319 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d6aa524f-f6de-4394-b16a-6b7132586b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff162f7e2adc4dd8a464bac5d0f4b313', 'request_id': 'req-d6aa524f-f6de-4394-b16a-6b7132586b39'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:01.516293 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d6aa524f-f6de-4394-b16a-6b7132586b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff162f7e2adc4dd8a464bac5d0f4b313', 'request_id': 'req-d6aa524f-f6de-4394-b16a-6b7132586b39'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:01.527924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d6aa524f-f6de-4394-b16a-6b7132586b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff162f7e2adc4dd8a464bac5d0f4b313', 'request_id': 'req-d6aa524f-f6de-4394-b16a-6b7132586b39'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:01.543784 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d6aa524f-f6de-4394-b16a-6b7132586b39 admin admin] The token cache is being invalidate because project ff162f7e2adc4dd8a464bac5d0f4b313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:01.544357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d6aa524f-f6de-4394-b16a-6b7132586b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:01.545241 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d6aa524f-f6de-4394-b16a-6b7132586b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:01.548108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1101/2220] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:01 2022] DELETE /identity/v3/projects/ff162f7e2adc4dd8a464bac5d0f4b313 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:01.549260 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa524f-f6de-4394-b16a-6b7132586b39 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:01.551371 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d6aa524f-f6de-4394-b16a-6b7132586b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:01.639944 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa524f-f6de-4394-b16a-6b7132586b39 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:01.647033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288997b-45d7-4453-aba1-adb9ad36ef53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:01.647911 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288997b-45d7-4453-aba1-adb9ad36ef53 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:01.648846 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288997b-45d7-4453-aba1-adb9ad36ef53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:01.649383 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288997b-45d7-4453-aba1-adb9ad36ef53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:01.652988 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9288997b-45d7-4453-aba1-adb9ad36ef53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:01.661876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1120/2221] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:01.661876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6f171-0e77-478b-9478-c511c354272d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:01.661876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6f171-0e77-478b-9478-c511c354272d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:01.661876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6f171-0e77-478b-9478-c511c354272d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:01.676358 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288997b-45d7-4453-aba1-adb9ad36ef53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:01.678100 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288997b-45d7-4453-aba1-adb9ad36ef53 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:01.693088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a6e6f171-0e77-478b-9478-c511c354272d None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:01.699730 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a6e6f171-0e77-478b-9478-c511c354272d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:01.713819 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1102/2222] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:01.715004 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029eb2c-9879-46e6-b2c9-dc57e09066fe None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:01.717766 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029eb2c-9879-46e6-b2c9-dc57e09066fe None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:01.718050 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029eb2c-9879-46e6-b2c9-dc57e09066fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:01.730538 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1121/2223] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:01.738906 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4076f-4af6-4cf8-94b5-7b45dc6a7a6d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:01.739407 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4076f-4af6-4cf8-94b5-7b45dc6a7a6d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:01.739834 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4076f-4af6-4cf8-94b5-7b45dc6a7a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:01.750667 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-f029eb2c-9879-46e6-b2c9-dc57e09066fe None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:01.752439 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f029eb2c-9879-46e6-b2c9-dc57e09066fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:01.756797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:01.775552 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1103/2224] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:01.778955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8bc4076f-4af6-4cf8-94b5-7b45dc6a7a6d None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:01.783643 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8bc4076f-4af6-4cf8-94b5-7b45dc6a7a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:01.784605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029eb2c-9879-46e6-b2c9-dc57e09066fe None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:01.801343 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029eb2c-9879-46e6-b2c9-dc57e09066fe None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:01.804735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1122/2225] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:01.814304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4076f-4af6-4cf8-94b5-7b45dc6a7a6d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:01.828098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a527cd9-e874-450c-abc7-94b32d5744e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:01.832011 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4076f-4af6-4cf8-94b5-7b45dc6a7a6d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:01.832422 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a527cd9-e874-450c-abc7-94b32d5744e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:01.833288 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a527cd9-e874-450c-abc7-94b32d5744e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:01.834228 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a527cd9-e874-450c-abc7-94b32d5744e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:01.837403 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a527cd9-e874-450c-abc7-94b32d5744e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:33:01.838553 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a527cd9-e874-450c-abc7-94b32d5744e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:01.848598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a527cd9-e874-450c-abc7-94b32d5744e9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:01.857117 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71773d5d-cb03-49c8-b8ad-4c68874e9059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:01.858842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71773d5d-cb03-49c8-b8ad-4c68874e9059 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:01.858842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71773d5d-cb03-49c8-b8ad-4c68874e9059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:01.859026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71773d5d-cb03-49c8-b8ad-4c68874e9059 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:01.859647 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71773d5d-cb03-49c8-b8ad-4c68874e9059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:33:01.859958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71773d5d-cb03-49c8-b8ad-4c68874e9059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:01.862425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71773d5d-cb03-49c8-b8ad-4c68874e9059 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:01.893687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1104/2226] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:33:01.899880 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a527cd9-e874-450c-abc7-94b32d5744e9 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:01.914127 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1123/2227] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:33:01.919228 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71773d5d-cb03-49c8-b8ad-4c68874e9059 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:01.934070 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a527cd9-e874-450c-abc7-94b32d5744e9 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:01.939787 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7545747-321a-46c4-86de-19e22b9119e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:01.940400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7545747-321a-46c4-86de-19e22b9119e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:01.940764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7545747-321a-46c4-86de-19e22b9119e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:01.941056 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7545747-321a-46c4-86de-19e22b9119e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:01.941844 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7545747-321a-46c4-86de-19e22b9119e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:01.944228 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7545747-321a-46c4-86de-19e22b9119e5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:01.962857 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71773d5d-cb03-49c8-b8ad-4c68874e9059 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:01.977429 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73efee7-471c-4ab1-b6e7-d2ccbaeeeefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:01.978447 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73efee7-471c-4ab1-b6e7-d2ccbaeeeefb admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:01.979255 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73efee7-471c-4ab1-b6e7-d2ccbaeeeefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:01.981131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73efee7-471c-4ab1-b6e7-d2ccbaeeeefb admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:01.982440 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73efee7-471c-4ab1-b6e7-d2ccbaeeeefb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:01.989015 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73efee7-471c-4ab1-b6e7-d2ccbaeeeefb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:02.013720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1105/2228] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:01 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:02.019527 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7545747-321a-46c4-86de-19e22b9119e5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:02.025077 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:02.061175 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1124/2229] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:01 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:33:02.062166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73efee7-471c-4ab1-b6e7-d2ccbaeeeefb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:02.115730 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7545747-321a-46c4-86de-19e22b9119e5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:02.201862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b31724-a19b-4932-880f-d618f9b6bf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:02.202955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b31724-a19b-4932-880f-d618f9b6bf18 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:02.203652 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b31724-a19b-4932-880f-d618f9b6bf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:02.205017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b31724-a19b-4932-880f-d618f9b6bf18 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:02.206038 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b31724-a19b-4932-880f-d618f9b6bf18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:02.207910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73efee7-471c-4ab1-b6e7-d2ccbaeeeefb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:02.210391 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b31724-a19b-4932-880f-d618f9b6bf18 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:02.231543 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bcbc3-4921-425e-a04f-7c773ab6f2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:02.232235 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bcbc3-4921-425e-a04f-7c773ab6f2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:02.232516 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bcbc3-4921-425e-a04f-7c773ab6f2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:02.232791 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bcbc3-4921-425e-a04f-7c773ab6f2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:02.233487 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bcbc3-4921-425e-a04f-7c773ab6f2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:02.237317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bcbc3-4921-425e-a04f-7c773ab6f2e8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:02.282000 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1106/2230] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:02 2022] POST /identity/v3/users => generated 282 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:02.287739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54947c4-bbcc-4476-8420-88d6d5602e48 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:02.287739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54947c4-bbcc-4476-8420-88d6d5602e48 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:02.292353 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54947c4-bbcc-4476-8420-88d6d5602e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:02.304824 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1125/2231] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:02 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:02.306080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bcbc3-4921-425e-a04f-7c773ab6f2e8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:02.350988 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e54947c4-bbcc-4476-8420-88d6d5602e48 None None] MFA Rules not processed for user `074d31f2932545538ba05289aa4efd56`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:02.352998 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e54947c4-bbcc-4476-8420-88d6d5602e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:02.353147 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bcbc3-4921-425e-a04f-7c773ab6f2e8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:02.358521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c4fa6-4dda-48f6-918c-0a4a4f47c4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:02.359258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c4fa6-4dda-48f6-918c-0a4a4f47c4fd admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:02.359526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c4fa6-4dda-48f6-918c-0a4a4f47c4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:02.359797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c4fa6-4dda-48f6-918c-0a4a4f47c4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:02.360616 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c4fa6-4dda-48f6-918c-0a4a4f47c4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:02.362219 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c4fa6-4dda-48f6-918c-0a4a4f47c4fd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:02.374398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1126/2232] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:02.378984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c4fa6-4dda-48f6-918c-0a4a4f47c4fd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:02.395322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c4fa6-4dda-48f6-918c-0a4a4f47c4fd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:02.400355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fcdf0-4d3b-4eee-b3c6-80d777f3623b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:02.401032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fcdf0-4d3b-4eee-b3c6-80d777f3623b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:02.406160 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fcdf0-4d3b-4eee-b3c6-80d777f3623b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:02.406579 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fcdf0-4d3b-4eee-b3c6-80d777f3623b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:02.407570 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fcdf0-4d3b-4eee-b3c6-80d777f3623b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:02.409244 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fcdf0-4d3b-4eee-b3c6-80d777f3623b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:02.423565 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1127/2233] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:02.428725 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fcdf0-4d3b-4eee-b3c6-80d777f3623b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:02.449393 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fcdf0-4d3b-4eee-b3c6-80d777f3623b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:02.458328 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf91a26-ed48-4784-a4f1-6adf34511b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:02.459572 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf91a26-ed48-4784-a4f1-6adf34511b35 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:02.460108 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf91a26-ed48-4784-a4f1-6adf34511b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:02.460588 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf91a26-ed48-4784-a4f1-6adf34511b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:02.463274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf91a26-ed48-4784-a4f1-6adf34511b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:02.465685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf91a26-ed48-4784-a4f1-6adf34511b35 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:02.483415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1128/2234] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:02.484822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf91a26-ed48-4784-a4f1-6adf34511b35 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:02.502446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf91a26-ed48-4784-a4f1-6adf34511b35 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:02.508103 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9ca2f-11d5-4262-a6f5-cbbc612a3076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:02.508793 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9ca2f-11d5-4262-a6f5-cbbc612a3076 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:02.509072 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9ca2f-11d5-4262-a6f5-cbbc612a3076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:02.509346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9ca2f-11d5-4262-a6f5-cbbc612a3076 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:02.510083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9ca2f-11d5-4262-a6f5-cbbc612a3076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:02.512006 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9ca2f-11d5-4262-a6f5-cbbc612a3076 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:02.516464 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1107/2235] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:02.517446 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54947c4-bbcc-4476-8420-88d6d5602e48 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:02.549605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54947c4-bbcc-4476-8420-88d6d5602e48 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:02.549969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1129/2236] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:02.551360 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9ca2f-11d5-4262-a6f5-cbbc612a3076 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:02.553260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ebc9ca2f-11d5-4262-a6f5-cbbc612a3076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:02.556517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a05490-cbe6-49c2-99fb-5b82d4dd7581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:02.557911 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a05490-cbe6-49c2-99fb-5b82d4dd7581 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:02.558397 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a05490-cbe6-49c2-99fb-5b82d4dd7581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:02.558850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a05490-cbe6-49c2-99fb-5b82d4dd7581 admin admin] PATH_INFO: `/v3/projects/399d375539c74778a53061dde2705352/users/1b1a1643c79c4cdcb26fd4ac598cd91c/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:02.571262 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9ca2f-11d5-4262-a6f5-cbbc612a3076 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:02.577098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f3933-5bc4-484c-9622-9263fec6110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:02.578041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f3933-5bc4-484c-9622-9263fec6110c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:02.578322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f3933-5bc4-484c-9622-9263fec6110c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:02.578775 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f3933-5bc4-484c-9622-9263fec6110c admin admin] PATH_INFO: `/v3/projects/8d5e38746f2544b698d054b8d3ceded4` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:02.580310 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f3933-5bc4-484c-9622-9263fec6110c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d5e38746f2544b698d054b8d3ceded4)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:02.592216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a05490-cbe6-49c2-99fb-5b82d4dd7581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=399d375539c74778a53061dde2705352, user_id=1b1a1643c79c4cdcb26fd4ac598cd91c, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:02.594166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f3933-5bc4-484c-9622-9263fec6110c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:02.602711 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a05490-cbe6-49c2-99fb-5b82d4dd7581 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:02.623873 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1108/2237] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:02 2022] PUT /identity/v3/projects/399d375539c74778a53061dde2705352/users/1b1a1643c79c4cdcb26fd4ac598cd91c/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:02.636597 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a05490-cbe6-49c2-99fb-5b82d4dd7581 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:02.638595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-75a05490-cbe6-49c2-99fb-5b82d4dd7581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:02.647364 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:02.726606 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cc8f3933-5bc4-484c-9622-9263fec6110c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d5e38746f2544b698d054b8d3ceded4', 'request_id': 'req-cc8f3933-5bc4-484c-9622-9263fec6110c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:02.747741 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cc8f3933-5bc4-484c-9622-9263fec6110c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d5e38746f2544b698d054b8d3ceded4', 'request_id': 'req-cc8f3933-5bc4-484c-9622-9263fec6110c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:02.757793 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:02.779133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cc8f3933-5bc4-484c-9622-9263fec6110c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d5e38746f2544b698d054b8d3ceded4', 'request_id': 'req-cc8f3933-5bc4-484c-9622-9263fec6110c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:02.803508 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cc8f3933-5bc4-484c-9622-9263fec6110c admin admin] The token cache is being invalidate because project 8d5e38746f2544b698d054b8d3ceded4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:02.803796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cc8f3933-5bc4-484c-9622-9263fec6110c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:02.807905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cc8f3933-5bc4-484c-9622-9263fec6110c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:02.812833 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1130/2238] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:02 2022] DELETE /identity/v3/projects/8d5e38746f2544b698d054b8d3ceded4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:02.816211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f3933-5bc4-484c-9622-9263fec6110c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:02.818550 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cc8f3933-5bc4-484c-9622-9263fec6110c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:02.846171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a05490-cbe6-49c2-99fb-5b82d4dd7581 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:02.951837 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f3933-5bc4-484c-9622-9263fec6110c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:02.965308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051983a-9a5e-4c20-bc5f-ae829e7eb91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:02.966549 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051983a-9a5e-4c20-bc5f-ae829e7eb91c admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:02.966914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051983a-9a5e-4c20-bc5f-ae829e7eb91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:02.967188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051983a-9a5e-4c20-bc5f-ae829e7eb91c admin admin] PATH_INFO: `/v3/projects/bac15896b2a6476e9dfdd412ad39b73f/users/6579880842b3490190c93be746b43171/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:02.986502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051983a-9a5e-4c20-bc5f-ae829e7eb91c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac15896b2a6476e9dfdd412ad39b73f, user_id=6579880842b3490190c93be746b43171, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:02.989633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051983a-9a5e-4c20-bc5f-ae829e7eb91c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:03.008127 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1131/2239] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:02 2022] PUT /identity/v3/projects/bac15896b2a6476e9dfdd412ad39b73f/users/6579880842b3490190c93be746b43171/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:03.009609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b3440-3d0b-435b-b08c-89fa5eed6fba None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.010274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b3440-3d0b-435b-b08c-89fa5eed6fba None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.010274 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b3440-3d0b-435b-b08c-89fa5eed6fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.011444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b8254-0050-4793-96a4-da01356081f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:03.012144 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b8254-0050-4793-96a4-da01356081f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.012426 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b8254-0050-4793-96a4-da01356081f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.012698 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b8254-0050-4793-96a4-da01356081f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.014482 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b8254-0050-4793-96a4-da01356081f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:03.016104 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b8254-0050-4793-96a4-da01356081f3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:03.054920 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4c6b3440-3d0b-435b-b08c-89fa5eed6fba None None] MFA Rules not processed for user `1b1a1643c79c4cdcb26fd4ac598cd91c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:03.056202 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4c6b3440-3d0b-435b-b08c-89fa5eed6fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:03.091529 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1109/2240] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:02 2022] POST /identity/v3/projects => generated 385 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:03.093857 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7c587-6931-4242-bace-e61e63bf92dc None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.099058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7c587-6931-4242-bace-e61e63bf92dc None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.099058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7c587-6931-4242-bace-e61e63bf92dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.123174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b3b7c587-6931-4242-bace-e61e63bf92dc None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:03.127022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b3b7c587-6931-4242-bace-e61e63bf92dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:03.164858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1132/2241] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:03 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:03.166444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71f28c-a7f2-498d-9c88-55307a8bdd49 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.167054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71f28c-a7f2-498d-9c88-55307a8bdd49 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.167759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71f28c-a7f2-498d-9c88-55307a8bdd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.210448 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fc71f28c-a7f2-498d-9c88-55307a8bdd49 None None] MFA Rules not processed for user `6579880842b3490190c93be746b43171`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:03.212092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fc71f28c-a7f2-498d-9c88-55307a8bdd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:03.259903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1110/2242] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:03.266032 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7c587-6931-4242-bace-e61e63bf92dc None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:03.268936 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b3b7c587-6931-4242-bace-e61e63bf92dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:03.302523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7c587-6931-4242-bace-e61e63bf92dc None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:03.308802 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f492d76-b860-4acc-b76a-b5d67fdfe4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:03.309507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f492d76-b860-4acc-b76a-b5d67fdfe4be admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.309890 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f492d76-b860-4acc-b76a-b5d67fdfe4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.310175 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f492d76-b860-4acc-b76a-b5d67fdfe4be admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.310926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f492d76-b860-4acc-b76a-b5d67fdfe4be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:03.315110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f492d76-b860-4acc-b76a-b5d67fdfe4be admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:03.347539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:03.363690 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1111/2243] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:03 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:03.363690 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f492d76-b860-4acc-b76a-b5d67fdfe4be admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:03.365917 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2f492d76-b860-4acc-b76a-b5d67fdfe4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:03.379051 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1133/2244] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:03.384960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002fa39-09bd-475e-a29c-c54447565f6a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.385418 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002fa39-09bd-475e-a29c-c54447565f6a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.385696 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002fa39-09bd-475e-a29c-c54447565f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.386893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f492d76-b860-4acc-b76a-b5d67fdfe4be admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:03.394310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651b9ed-5527-4f48-9ff9-b31f29f25100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:03.395025 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651b9ed-5527-4f48-9ff9-b31f29f25100 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.395313 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651b9ed-5527-4f48-9ff9-b31f29f25100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.395588 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651b9ed-5527-4f48-9ff9-b31f29f25100 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.396344 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651b9ed-5527-4f48-9ff9-b31f29f25100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:03.398993 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651b9ed-5527-4f48-9ff9-b31f29f25100 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:03.406952 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d002fa39-09bd-475e-a29c-c54447565f6a None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:03.409194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d002fa39-09bd-475e-a29c-c54447565f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:03.418283 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1134/2245] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:03.419984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002fa39-09bd-475e-a29c-c54447565f6a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:03.436141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:03.442393 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002fa39-09bd-475e-a29c-c54447565f6a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:03.448357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1112/2246] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:03 2022] POST /identity/v3/projects => generated 363 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:03.448357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651b9ed-5527-4f48-9ff9-b31f29f25100 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:03.448622 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf84304-8867-43ff-9bcc-f0e842829d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:03.449277 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf84304-8867-43ff-9bcc-f0e842829d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.449863 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf84304-8867-43ff-9bcc-f0e842829d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.450410 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf84304-8867-43ff-9bcc-f0e842829d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.451219 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf84304-8867-43ff-9bcc-f0e842829d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:03.453797 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf84304-8867-43ff-9bcc-f0e842829d21 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:03.470046 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1135/2247] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:03.470046 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf84304-8867-43ff-9bcc-f0e842829d21 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:03.484743 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf84304-8867-43ff-9bcc-f0e842829d21 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:03.532496 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651b9ed-5527-4f48-9ff9-b31f29f25100 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:03.537907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153c965-30ac-4019-b4b9-15308d96d558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:03.538574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153c965-30ac-4019-b4b9-15308d96d558 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.538953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153c965-30ac-4019-b4b9-15308d96d558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.539167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153c965-30ac-4019-b4b9-15308d96d558 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.539856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153c965-30ac-4019-b4b9-15308d96d558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:03.541958 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2153c965-30ac-4019-b4b9-15308d96d558 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:03.561434 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3330360-d16e-4b75-9e79-d33260885d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:03.563440 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3330360-d16e-4b75-9e79-d33260885d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.565810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3330360-d16e-4b75-9e79-d33260885d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.566176 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3330360-d16e-4b75-9e79-d33260885d71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.567237 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3330360-d16e-4b75-9e79-d33260885d71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:33:03.568252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3330360-d16e-4b75-9e79-d33260885d71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:03.572370 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3330360-d16e-4b75-9e79-d33260885d71 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:03.582596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1113/2248] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:03 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:03.582917 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153c965-30ac-4019-b4b9-15308d96d558 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:03.589238 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1136/2249] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:33:03.590201 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3330360-d16e-4b75-9e79-d33260885d71 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:03.606028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3330360-d16e-4b75-9e79-d33260885d71 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:03.669331 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153c965-30ac-4019-b4b9-15308d96d558 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:03.684946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634fa82-c880-42ce-9701-eada134add5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:03.685696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634fa82-c880-42ce-9701-eada134add5f admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.686000 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634fa82-c880-42ce-9701-eada134add5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.686279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634fa82-c880-42ce-9701-eada134add5f admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.687275 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634fa82-c880-42ce-9701-eada134add5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:03.689638 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634fa82-c880-42ce-9701-eada134add5f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:03.694527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76dd4fc-c022-46c7-81ba-a408e79c6b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:03.699556 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76dd4fc-c022-46c7-81ba-a408e79c6b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.699694 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76dd4fc-c022-46c7-81ba-a408e79c6b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.700251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76dd4fc-c022-46c7-81ba-a408e79c6b80 admin admin] PATH_INFO: `/v3/projects/65c7b4eb647146ca9d61e2f2aa142e20/users/a8e59595697d46c2b27ef1a5a9518e05/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.714368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1114/2250] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:03 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:03.718397 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634fa82-c880-42ce-9701-eada134add5f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:03.722798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76dd4fc-c022-46c7-81ba-a408e79c6b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c7b4eb647146ca9d61e2f2aa142e20, user_id=a8e59595697d46c2b27ef1a5a9518e05, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:03.725860 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76dd4fc-c022-46c7-81ba-a408e79c6b80 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:03.731264 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634fa82-c880-42ce-9701-eada134add5f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:03.736653 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e183ac-0808-4bd0-99a2-0fcda89ff74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:03.737493 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e183ac-0808-4bd0-99a2-0fcda89ff74f admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.737842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e183ac-0808-4bd0-99a2-0fcda89ff74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.738129 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e183ac-0808-4bd0-99a2-0fcda89ff74f admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.738926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e183ac-0808-4bd0-99a2-0fcda89ff74f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:03.740849 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e183ac-0808-4bd0-99a2-0fcda89ff74f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:03.744739 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1137/2251] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:03 2022] PUT /identity/v3/projects/65c7b4eb647146ca9d61e2f2aa142e20/users/a8e59595697d46c2b27ef1a5a9518e05/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:03.745679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76dd4fc-c022-46c7-81ba-a408e79c6b80 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:03.774220 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1115/2252] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:03 2022] POST /identity/v3/users => generated 288 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:03.778264 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e183ac-0808-4bd0-99a2-0fcda89ff74f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:03.789239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e183ac-0808-4bd0-99a2-0fcda89ff74f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:03.821661 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:03.840829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76dd4fc-c022-46c7-81ba-a408e79c6b80 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:03.846124 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fb12c-50a4-45b6-b384-6703284dd97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:03.846928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:03.847167 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fb12c-50a4-45b6-b384-6703284dd97e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.847511 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fb12c-50a4-45b6-b384-6703284dd97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.847847 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fb12c-50a4-45b6-b384-6703284dd97e admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.848721 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fb12c-50a4-45b6-b384-6703284dd97e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:03.851065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fb12c-50a4-45b6-b384-6703284dd97e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:03.855644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d0f09-f299-48f9-91b4-cd4800e17e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:03.859534 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d0f09-f299-48f9-91b4-cd4800e17e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.860309 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d0f09-f299-48f9-91b4-cd4800e17e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.860697 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d0f09-f299-48f9-91b4-cd4800e17e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.861452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d0f09-f299-48f9-91b4-cd4800e17e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:03.863542 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d0f09-f299-48f9-91b4-cd4800e17e02 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:03.874681 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1116/2253] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:03.875616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d0f09-f299-48f9-91b4-cd4800e17e02 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:03.884759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1138/2254] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:03 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:03.884759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fb12c-50a4-45b6-b384-6703284dd97e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:03.888059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d0f09-f299-48f9-91b4-cd4800e17e02 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:03.948395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af6dac-1029-4061-a2c4-65f175d77a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:03.949067 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af6dac-1029-4061-a2c4-65f175d77a37 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.949347 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af6dac-1029-4061-a2c4-65f175d77a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.949674 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af6dac-1029-4061-a2c4-65f175d77a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.950352 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af6dac-1029-4061-a2c4-65f175d77a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:03.952000 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af6dac-1029-4061-a2c4-65f175d77a37 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:03.954781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fb12c-50a4-45b6-b384-6703284dd97e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:03.960300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e45c4-32d6-4c3e-9e8c-a44e28549e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:03.960975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e45c4-32d6-4c3e-9e8c-a44e28549e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.961260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e45c4-32d6-4c3e-9e8c-a44e28549e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.961537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e45c4-32d6-4c3e-9e8c-a44e28549e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.962421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e45c4-32d6-4c3e-9e8c-a44e28549e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:03.966892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1117/2255] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:03.967067 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e45c4-32d6-4c3e-9e8c-a44e28549e1d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:03.967158 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af6dac-1029-4061-a2c4-65f175d77a37 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:03.978298 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1139/2256] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:03.978298 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e45c4-32d6-4c3e-9e8c-a44e28549e1d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:03.978548 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af6dac-1029-4061-a2c4-65f175d77a37 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:03.983818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23270759-0e02-4ab5-a3cf-250d8c1d4a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:03.984776 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23270759-0e02-4ab5-a3cf-250d8c1d4a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.985124 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23270759-0e02-4ab5-a3cf-250d8c1d4a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.985510 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23270759-0e02-4ab5-a3cf-250d8c1d4a62 admin admin] PATH_INFO: `/v3/projects/0fb1af9230fb4ada923df575093b3c95/users/0186a1391e834b968fa731a4dc67d789/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.986650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e45c4-32d6-4c3e-9e8c-a44e28549e1d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:03.991699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01d75e-56fa-4bf1-953c-a19977f28aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:03.992364 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01d75e-56fa-4bf1-953c-a19977f28aec admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:03.992650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01d75e-56fa-4bf1-953c-a19977f28aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:03.992928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01d75e-56fa-4bf1-953c-a19977f28aec admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:03.993667 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01d75e-56fa-4bf1-953c-a19977f28aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:03.995556 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01d75e-56fa-4bf1-953c-a19977f28aec admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:04.004334 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23270759-0e02-4ab5-a3cf-250d8c1d4a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb1af9230fb4ada923df575093b3c95, user_id=0186a1391e834b968fa731a4dc67d789, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:04.007179 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23270759-0e02-4ab5-a3cf-250d8c1d4a62 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:04.022148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1140/2257] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:03 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:04.023216 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01d75e-56fa-4bf1-953c-a19977f28aec admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:04.026102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1118/2258] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:03 2022] PUT /identity/v3/projects/0fb1af9230fb4ada923df575093b3c95/users/0186a1391e834b968fa731a4dc67d789/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:04.026102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23270759-0e02-4ab5-a3cf-250d8c1d4a62 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:04.041410 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01d75e-56fa-4bf1-953c-a19977f28aec admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:04.101905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23270759-0e02-4ab5-a3cf-250d8c1d4a62 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:04.107784 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e8250-f046-4db5-906b-b27df278fd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:04.108543 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e8250-f046-4db5-906b-b27df278fd8a admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:04.108886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e8250-f046-4db5-906b-b27df278fd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:04.109228 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e8250-f046-4db5-906b-b27df278fd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:04.110042 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e8250-f046-4db5-906b-b27df278fd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:04.112338 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e8250-f046-4db5-906b-b27df278fd8a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:04.122383 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac625e17-f873-40d2-ba31-3acc962f946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:04.123748 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625e17-f873-40d2-ba31-3acc962f946b admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:04.123957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625e17-f873-40d2-ba31-3acc962f946b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:04.124691 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1119/2259] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:04.126137 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e8250-f046-4db5-906b-b27df278fd8a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:04.127938 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac625e17-f873-40d2-ba31-3acc962f946b admin admin] PATH_INFO: `/v3/projects/65c7b4eb647146ca9d61e2f2aa142e20/users/a8e59595697d46c2b27ef1a5a9518e05/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:04.130567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac625e17-f873-40d2-ba31-3acc962f946b admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c7b4eb647146ca9d61e2f2aa142e20, user_id=a8e59595697d46c2b27ef1a5a9518e05, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:04.134579 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac625e17-f873-40d2-ba31-3acc962f946b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:04.141101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e8250-f046-4db5-906b-b27df278fd8a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:04.163001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1141/2260] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:04 2022] PUT /identity/v3/projects/65c7b4eb647146ca9d61e2f2aa142e20/users/a8e59595697d46c2b27ef1a5a9518e05/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:04.171084 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac625e17-f873-40d2-ba31-3acc962f946b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:04.238108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958730b1-200b-48fb-9461-422f2d247073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:04.239774 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958730b1-200b-48fb-9461-422f2d247073 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:04.240114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958730b1-200b-48fb-9461-422f2d247073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:04.240363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958730b1-200b-48fb-9461-422f2d247073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:04.241889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958730b1-200b-48fb-9461-422f2d247073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:04.243710 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958730b1-200b-48fb-9461-422f2d247073 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:04.245450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:04.260216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1120/2261] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:04.261336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958730b1-200b-48fb-9461-422f2d247073 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:04.269271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:04.278684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958730b1-200b-48fb-9461-422f2d247073 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:04.285982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd575764-fde2-4b4d-8c60-812cc2a4e507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:04.287385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd575764-fde2-4b4d-8c60-812cc2a4e507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:04.287796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd575764-fde2-4b4d-8c60-812cc2a4e507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:04.288238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd575764-fde2-4b4d-8c60-812cc2a4e507 admin admin] PATH_INFO: `/v3/projects/04bafd9ba47d43f0bac6b5e0f373236a/users/d201748f0b9240deb2cb245865f1c338/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:04.289936 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac625e17-f873-40d2-ba31-3acc962f946b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:04.297915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413ebb7-42f4-4386-8a86-940a49f96e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:04.299405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413ebb7-42f4-4386-8a86-940a49f96e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:04.299903 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413ebb7-42f4-4386-8a86-940a49f96e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:04.300459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413ebb7-42f4-4386-8a86-940a49f96e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:04.301351 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413ebb7-42f4-4386-8a86-940a49f96e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:04.303497 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413ebb7-42f4-4386-8a86-940a49f96e49 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:04.307217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd575764-fde2-4b4d-8c60-812cc2a4e507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04bafd9ba47d43f0bac6b5e0f373236a, user_id=d201748f0b9240deb2cb245865f1c338, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:04.310789 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd575764-fde2-4b4d-8c60-812cc2a4e507 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:04.319221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1142/2262] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:04.321165 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413ebb7-42f4-4386-8a86-940a49f96e49 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:04.336975 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1121/2263] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:04 2022] PUT /identity/v3/projects/04bafd9ba47d43f0bac6b5e0f373236a/users/d201748f0b9240deb2cb245865f1c338/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:04.337483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413ebb7-42f4-4386-8a86-940a49f96e49 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:04.337954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd575764-fde2-4b4d-8c60-812cc2a4e507 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:04.416040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd575764-fde2-4b4d-8c60-812cc2a4e507 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:04.422551 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e16a7-4d6d-40c7-872c-cc6dc8a109a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:04.422710 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae81e9-b2e1-47a4-ab73-add736c8cc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:04.423929 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e16a7-4d6d-40c7-872c-cc6dc8a109a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:04.424216 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e16a7-4d6d-40c7-872c-cc6dc8a109a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:04.424319 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae81e9-b2e1-47a4-ab73-add736c8cc74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:04.424517 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e16a7-4d6d-40c7-872c-cc6dc8a109a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:04.424615 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae81e9-b2e1-47a4-ab73-add736c8cc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:04.424849 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae81e9-b2e1-47a4-ab73-add736c8cc74 admin admin] PATH_INFO: `/v3/projects/0fb1af9230fb4ada923df575093b3c95/users/0186a1391e834b968fa731a4dc67d789/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:04.425206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e16a7-4d6d-40c7-872c-cc6dc8a109a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:04.427024 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae81e9-b2e1-47a4-ab73-add736c8cc74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb1af9230fb4ada923df575093b3c95, user_id=0186a1391e834b968fa731a4dc67d789, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:04.427154 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e16a7-4d6d-40c7-872c-cc6dc8a109a1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:04.430407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae81e9-b2e1-47a4-ab73-add736c8cc74 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:04.438249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1143/2264] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:04.439983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92b4ca-95d3-457d-9b8a-2cb1c3b20c8a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:04.440399 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92b4ca-95d3-457d-9b8a-2cb1c3b20c8a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:04.440677 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92b4ca-95d3-457d-9b8a-2cb1c3b20c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:04.446228 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1122/2265] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:04 2022] PUT /identity/v3/projects/0fb1af9230fb4ada923df575093b3c95/users/0186a1391e834b968fa731a4dc67d789/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:04.447241 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae81e9-b2e1-47a4-ab73-add736c8cc74 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:04.480305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-da92b4ca-95d3-457d-9b8a-2cb1c3b20c8a None None] MFA Rules not processed for user `d201748f0b9240deb2cb245865f1c338`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:04.481668 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-da92b4ca-95d3-457d-9b8a-2cb1c3b20c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:04.546836 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae81e9-b2e1-47a4-ab73-add736c8cc74 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:04.553098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6c3cc-e0b3-4fa0-8190-957247651c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:04.554091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6c3cc-e0b3-4fa0-8190-957247651c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:04.554648 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6c3cc-e0b3-4fa0-8190-957247651c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:04.555000 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6c3cc-e0b3-4fa0-8190-957247651c54 admin admin] PATH_INFO: `/v3/projects/5d6762fb38e7440ab3954b1b9fbe3a46/users/9b92b72c637e4e389ab74606b14800cf/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:04.574039 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6c3cc-e0b3-4fa0-8190-957247651c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d6762fb38e7440ab3954b1b9fbe3a46, user_id=9b92b72c637e4e389ab74606b14800cf, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:04.577414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6c3cc-e0b3-4fa0-8190-957247651c54 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:04.584617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1144/2266] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:04.589718 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5adaaf-ba52-44a4-b57a-b163b4363413 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:04.591231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5adaaf-ba52-44a4-b57a-b163b4363413 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:04.591648 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5adaaf-ba52-44a4-b57a-b163b4363413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:04.600512 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1123/2267] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:04 2022] PUT /identity/v3/projects/5d6762fb38e7440ab3954b1b9fbe3a46/users/9b92b72c637e4e389ab74606b14800cf/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:04.603481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6c3cc-e0b3-4fa0-8190-957247651c54 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:04.648817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1c5adaaf-ba52-44a4-b57a-b163b4363413 None None] MFA Rules not processed for user `0186a1391e834b968fa731a4dc67d789`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:04.650484 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1c5adaaf-ba52-44a4-b57a-b163b4363413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:04.759185 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:04.790962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6c3cc-e0b3-4fa0-8190-957247651c54 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:04.809189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c5029-76c5-46d6-9dcf-97093bec0fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:04.809877 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c5029-76c5-46d6-9dcf-97093bec0fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:04.810447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c5029-76c5-46d6-9dcf-97093bec0fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:04.810447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c5029-76c5-46d6-9dcf-97093bec0fe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:04.811396 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c5029-76c5-46d6-9dcf-97093bec0fe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:04.814516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c5029-76c5-46d6-9dcf-97093bec0fe6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:04.815779 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:04.826338 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1145/2268] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:04 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:04.831538 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835ec10-f2ee-4443-a89e-1c03c57e4a61 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:04.831851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835ec10-f2ee-4443-a89e-1c03c57e4a61 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:04.832099 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835ec10-f2ee-4443-a89e-1c03c57e4a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:04.864381 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1124/2269] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:04 2022] POST /identity/v3/projects => generated 377 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:04.868617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c5029-76c5-46d6-9dcf-97093bec0fe6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:04.870549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ae1c5029-76c5-46d6-9dcf-97093bec0fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:04.906599 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0835ec10-f2ee-4443-a89e-1c03c57e4a61 None None] MFA Rules not processed for user `9b92b72c637e4e389ab74606b14800cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:04.910418 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0835ec10-f2ee-4443-a89e-1c03c57e4a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:04.940853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c5029-76c5-46d6-9dcf-97093bec0fe6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:04.945796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1fd37-e2c6-4b13-bff4-09321e77b123 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:04.946461 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1fd37-e2c6-4b13-bff4-09321e77b123 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:04.946804 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1fd37-e2c6-4b13-bff4-09321e77b123 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:04.947087 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1fd37-e2c6-4b13-bff4-09321e77b123 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:05.044199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1fd37-e2c6-4b13-bff4-09321e77b123 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:05.046454 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1fd37-e2c6-4b13-bff4-09321e77b123 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:05.057533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1146/2270] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:05.059916 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1125/2271] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:04 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:05.062423 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835ec10-f2ee-4443-a89e-1c03c57e4a61 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:05.072508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1fd37-e2c6-4b13-bff4-09321e77b123 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:05.074474 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3cd1fd37-e2c6-4b13-bff4-09321e77b123 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:05.095742 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1fd37-e2c6-4b13-bff4-09321e77b123 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:05.113819 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d40a2e-21bd-4967-87c1-fec26d845af3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:05.115237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d40a2e-21bd-4967-87c1-fec26d845af3 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:05.116165 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d40a2e-21bd-4967-87c1-fec26d845af3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:05.116486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d40a2e-21bd-4967-87c1-fec26d845af3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:05.128657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d40a2e-21bd-4967-87c1-fec26d845af3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:05.130237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d40a2e-21bd-4967-87c1-fec26d845af3 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:05.166800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1126/2272] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:05.254071 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d40a2e-21bd-4967-87c1-fec26d845af3 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:05.265590 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d40a2e-21bd-4967-87c1-fec26d845af3 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:05.278373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeae86f-2a94-462f-8226-465b09f53336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:05.280654 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835ec10-f2ee-4443-a89e-1c03c57e4a61 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:05.283293 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeae86f-2a94-462f-8226-465b09f53336 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:05.302164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeae86f-2a94-462f-8226-465b09f53336 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:05.303086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeae86f-2a94-462f-8226-465b09f53336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:05.322020 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ceb470-e0a0-4bcd-aa1c-07e5080b21b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:05.326442 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ceb470-e0a0-4bcd-aa1c-07e5080b21b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:05.327841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ceb470-e0a0-4bcd-aa1c-07e5080b21b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:05.328234 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ceb470-e0a0-4bcd-aa1c-07e5080b21b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:05.332962 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ceb470-e0a0-4bcd-aa1c-07e5080b21b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:05.340542 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ceb470-e0a0-4bcd-aa1c-07e5080b21b1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:05.408521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1147/2273] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:05 2022] POST /identity/v3/users => generated 295 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:05.416423 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ceb470-e0a0-4bcd-aa1c-07e5080b21b1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:05.460193 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ceb470-e0a0-4bcd-aa1c-07e5080b21b1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:05.477836 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9506c-e9f0-4850-91e2-315b30b66fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:05.488106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9506c-e9f0-4850-91e2-315b30b66fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:05.489100 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9506c-e9f0-4850-91e2-315b30b66fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:05.489503 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9506c-e9f0-4850-91e2-315b30b66fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:05.490409 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9506c-e9f0-4850-91e2-315b30b66fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:05.496495 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9506c-e9f0-4850-91e2-315b30b66fa9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:05.537099 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeae86f-2a94-462f-8226-465b09f53336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:05.538687 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1148/2274] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:05.539980 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeae86f-2a94-462f-8226-465b09f53336 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:05.546702 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9506c-e9f0-4850-91e2-315b30b66fa9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:05.563267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9506c-e9f0-4850-91e2-315b30b66fa9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:05.571005 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1127/2275] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:05 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:33:05.597224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee6ab4-217d-46a1-a05c-f4016c139959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:05.603024 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6ab4-217d-46a1-a05c-f4016c139959 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:05.604757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6ab4-217d-46a1-a05c-f4016c139959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:05.605757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6ab4-217d-46a1-a05c-f4016c139959 admin admin] PATH_INFO: `/v3/projects/4beda43c72be4b618c38334c8b3b2a94/users/ea88fee91d494f53b2f18c7f0fb85d57/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:05.656908 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee6ab4-217d-46a1-a05c-f4016c139959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4beda43c72be4b618c38334c8b3b2a94, user_id=ea88fee91d494f53b2f18c7f0fb85d57, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:05.661450 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee6ab4-217d-46a1-a05c-f4016c139959 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:05.698664 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1149/2276] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:05 2022] PUT /identity/v3/projects/4beda43c72be4b618c38334c8b3b2a94/users/ea88fee91d494f53b2f18c7f0fb85d57/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:05.702600 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeae86f-2a94-462f-8226-465b09f53336 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:05.727430 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeae86f-2a94-462f-8226-465b09f53336 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:05.748620 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:05.975765 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ce231-ede4-4572-93fb-ca80e4dd0f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:05.976206 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ce231-ede4-4572-93fb-ca80e4dd0f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:05.976408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ce231-ede4-4572-93fb-ca80e4dd0f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:05.976696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ce231-ede4-4572-93fb-ca80e4dd0f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:05.977438 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ce231-ede4-4572-93fb-ca80e4dd0f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:05.979251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ce231-ede4-4572-93fb-ca80e4dd0f79 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:06.012016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1128/2277] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:06.014433 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee6ab4-217d-46a1-a05c-f4016c139959 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:06.067447 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee6ab4-217d-46a1-a05c-f4016c139959 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:06.080205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92810375-35c4-4422-8b79-8876f644d166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:06.081357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92810375-35c4-4422-8b79-8876f644d166 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:06.081638 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92810375-35c4-4422-8b79-8876f644d166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:06.081909 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92810375-35c4-4422-8b79-8876f644d166 admin admin] PATH_INFO: `/v3/projects/4beda43c72be4b618c38334c8b3b2a94/users/ea88fee91d494f53b2f18c7f0fb85d57/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:06.091361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92810375-35c4-4422-8b79-8876f644d166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4beda43c72be4b618c38334c8b3b2a94, user_id=ea88fee91d494f53b2f18c7f0fb85d57, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:06.104700 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92810375-35c4-4422-8b79-8876f644d166 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:06.153754 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1150/2278] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:06 2022] PUT /identity/v3/projects/4beda43c72be4b618c38334c8b3b2a94/users/ea88fee91d494f53b2f18c7f0fb85d57/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:06.167250 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38858cb9-939a-4acb-a959-5fa9a3aa10d3 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:06.167767 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38858cb9-939a-4acb-a959-5fa9a3aa10d3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:06.167845 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38858cb9-939a-4acb-a959-5fa9a3aa10d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:06.216444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-38858cb9-939a-4acb-a959-5fa9a3aa10d3 None None] MFA Rules not processed for user `ea88fee91d494f53b2f18c7f0fb85d57`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:06.218026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-38858cb9-939a-4acb-a959-5fa9a3aa10d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:06.390600 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1129/2279] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:06.402216 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92810375-35c4-4422-8b79-8876f644d166 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:06.477571 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:06.535652 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92810375-35c4-4422-8b79-8876f644d166 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:06.544017 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd29b72-ae7f-4de6-8c8a-150fdc6825f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:06.547592 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd29b72-ae7f-4de6-8c8a-150fdc6825f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:06.548470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd29b72-ae7f-4de6-8c8a-150fdc6825f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:06.551657 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd29b72-ae7f-4de6-8c8a-150fdc6825f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:06.691607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd29b72-ae7f-4de6-8c8a-150fdc6825f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:06.693419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd29b72-ae7f-4de6-8c8a-150fdc6825f8 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:06.706904 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1151/2280] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:08.618345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38858cb9-939a-4acb-a959-5fa9a3aa10d3 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:08.719877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd29b72-ae7f-4de6-8c8a-150fdc6825f8 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:08.734667 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd29b72-ae7f-4de6-8c8a-150fdc6825f8 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:08.745812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38858cb9-939a-4acb-a959-5fa9a3aa10d3 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:08.748606 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa328d-4ec9-4e76-b406-97ce832c3429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:08.749447 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa328d-4ec9-4e76-b406-97ce832c3429 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:08.749729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa328d-4ec9-4e76-b406-97ce832c3429 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:08.750003 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa328d-4ec9-4e76-b406-97ce832c3429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:08.770523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93965b9b-25ff-4e27-b5e2-cca799c0f48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:08.775440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93965b9b-25ff-4e27-b5e2-cca799c0f48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:08.775812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93965b9b-25ff-4e27-b5e2-cca799c0f48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:08.775989 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93965b9b-25ff-4e27-b5e2-cca799c0f48a admin admin] PATH_INFO: `/v3/users/9b92b72c637e4e389ab74606b14800cf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:08.782949 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93965b9b-25ff-4e27-b5e2-cca799c0f48a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b92b72c637e4e389ab74606b14800cf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:08.788939 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93965b9b-25ff-4e27-b5e2-cca799c0f48a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:08.885997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa328d-4ec9-4e76-b406-97ce832c3429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:08.887649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa328d-4ec9-4e76-b406-97ce832c3429 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:08.891037 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:08.902070 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1152/2281] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:33:08.943836 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-93965b9b-25ff-4e27-b5e2-cca799c0f48a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b92b72c637e4e389ab74606b14800cf'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:08.956924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-93965b9b-25ff-4e27-b5e2-cca799c0f48a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b92b72c637e4e389ab74606b14800cf'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:09.001843 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-93965b9b-25ff-4e27-b5e2-cca799c0f48a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b92b72c637e4e389ab74606b14800cf'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:09.024478 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-93965b9b-25ff-4e27-b5e2-cca799c0f48a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b92b72c637e4e389ab74606b14800cf'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:09.025709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-93965b9b-25ff-4e27-b5e2-cca799c0f48a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b92b72c637e4e389ab74606b14800cf'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:09.039433 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dfdac-1e3e-441c-86dc-0e58a15e1b82 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:09.040096 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dfdac-1e3e-441c-86dc-0e58a15e1b82 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:09.040562 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dfdac-1e3e-441c-86dc-0e58a15e1b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:09.042367 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1130/2282] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:33:08 2022] DELETE /identity/v3/users/9b92b72c637e4e389ab74606b14800cf => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:09.070187 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8a9dfdac-1e3e-441c-86dc-0e58a15e1b82 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:09.077612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8a9dfdac-1e3e-441c-86dc-0e58a15e1b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:09.203755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1153/2283] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:33:09.216279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93965b9b-25ff-4e27-b5e2-cca799c0f48a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:09.218411 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-93965b9b-25ff-4e27-b5e2-cca799c0f48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:09.355599 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dfdac-1e3e-441c-86dc-0e58a15e1b82 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:09.357166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8a9dfdac-1e3e-441c-86dc-0e58a15e1b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:09.389077 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dfdac-1e3e-441c-86dc-0e58a15e1b82 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:09.405794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4037c-b4cb-473b-8a1c-db1281c09541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:09.407102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4037c-b4cb-473b-8a1c-db1281c09541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:09.407514 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4037c-b4cb-473b-8a1c-db1281c09541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:09.407893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4037c-b4cb-473b-8a1c-db1281c09541 admin admin] PATH_INFO: `/v3/users/1b1a1643c79c4cdcb26fd4ac598cd91c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:09.415019 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93965b9b-25ff-4e27-b5e2-cca799c0f48a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:09.421473 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4037c-b4cb-473b-8a1c-db1281c09541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b1a1643c79c4cdcb26fd4ac598cd91c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:09.424267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4037c-b4cb-473b-8a1c-db1281c09541 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:09.427146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36551dd5-6f83-46f8-89ad-93f77293fe5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:09.428568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36551dd5-6f83-46f8-89ad-93f77293fe5b service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:09.429299 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36551dd5-6f83-46f8-89ad-93f77293fe5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:09.429579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36551dd5-6f83-46f8-89ad-93f77293fe5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:09.446807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:09.466365 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36551dd5-6f83-46f8-89ad-93f77293fe5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:09.468074 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36551dd5-6f83-46f8-89ad-93f77293fe5b service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:09.486216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1131/2284] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:09.505164 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cfb4037c-b4cb-473b-8a1c-db1281c09541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b1a1643c79c4cdcb26fd4ac598cd91c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:09.518675 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cfb4037c-b4cb-473b-8a1c-db1281c09541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b1a1643c79c4cdcb26fd4ac598cd91c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:09.540214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cfb4037c-b4cb-473b-8a1c-db1281c09541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b1a1643c79c4cdcb26fd4ac598cd91c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:09.569180 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cfb4037c-b4cb-473b-8a1c-db1281c09541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b1a1643c79c4cdcb26fd4ac598cd91c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:09.570911 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cfb4037c-b4cb-473b-8a1c-db1281c09541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b1a1643c79c4cdcb26fd4ac598cd91c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:09.596745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1154/2285] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:33:09 2022] DELETE /identity/v3/users/1b1a1643c79c4cdcb26fd4ac598cd91c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:09.598937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0ea7c-4c59-4f9a-84d7-7bb547b63900 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:09.599338 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0ea7c-4c59-4f9a-84d7-7bb547b63900 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:09.599779 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0ea7c-4c59-4f9a-84d7-7bb547b63900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:09.629008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-89b0ea7c-4c59-4f9a-84d7-7bb547b63900 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:09.653436 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-89b0ea7c-4c59-4f9a-84d7-7bb547b63900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:09.806519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1132/2286] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:09.827524 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4037c-b4cb-473b-8a1c-db1281c09541 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:09.829677 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cfb4037c-b4cb-473b-8a1c-db1281c09541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:09.966869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0ea7c-4c59-4f9a-84d7-7bb547b63900 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:09.967135 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4037c-b4cb-473b-8a1c-db1281c09541 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:09.968469 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-89b0ea7c-4c59-4f9a-84d7-7bb547b63900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:09.971598 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de6989-4c7c-4421-9a98-d58a6c10b1f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:09.972978 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de6989-4c7c-4421-9a98-d58a6c10b1f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:09.973258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de6989-4c7c-4421-9a98-d58a6c10b1f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:09.973525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de6989-4c7c-4421-9a98-d58a6c10b1f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:09.985501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de6989-4c7c-4421-9a98-d58a6c10b1f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:09.987866 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de6989-4c7c-4421-9a98-d58a6c10b1f6 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:10.001780 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1155/2287] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:10.116580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0ea7c-4c59-4f9a-84d7-7bb547b63900 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:10.129019 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e169f-e7e4-4d29-bd9c-ada2be62f55e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:10.130877 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e169f-e7e4-4d29-bd9c-ada2be62f55e service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:10.131178 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e169f-e7e4-4d29-bd9c-ada2be62f55e service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:10.131488 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e169f-e7e4-4d29-bd9c-ada2be62f55e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:10.137883 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-da6e169f-e7e4-4d29-bd9c-ada2be62f55e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:10.152222 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:10.217686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de6989-4c7c-4421-9a98-d58a6c10b1f6 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:10.222040 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-57de6989-4c7c-4421-9a98-d58a6c10b1f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:10.245266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de6989-4c7c-4421-9a98-d58a6c10b1f6 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:10.285881 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff24dd-90af-4d9e-940a-bbf2effe0b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:10.291655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e169f-e7e4-4d29-bd9c-ada2be62f55e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:10.297829 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e169f-e7e4-4d29-bd9c-ada2be62f55e service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:10.315735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff24dd-90af-4d9e-940a-bbf2effe0b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:10.316059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff24dd-90af-4d9e-940a-bbf2effe0b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:10.316509 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff24dd-90af-4d9e-940a-bbf2effe0b84 admin admin] PATH_INFO: `/v3/projects/5d6762fb38e7440ab3954b1b9fbe3a46` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:10.317932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff24dd-90af-4d9e-940a-bbf2effe0b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d6762fb38e7440ab3954b1b9fbe3a46)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:10.320537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff24dd-90af-4d9e-940a-bbf2effe0b84 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:10.339692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1133/2288] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:10.465888 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-39ff24dd-90af-4d9e-940a-bbf2effe0b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d6762fb38e7440ab3954b1b9fbe3a46', 'request_id': 'req-39ff24dd-90af-4d9e-940a-bbf2effe0b84'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:10.473314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-39ff24dd-90af-4d9e-940a-bbf2effe0b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d6762fb38e7440ab3954b1b9fbe3a46', 'request_id': 'req-39ff24dd-90af-4d9e-940a-bbf2effe0b84'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:10.486987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-39ff24dd-90af-4d9e-940a-bbf2effe0b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d6762fb38e7440ab3954b1b9fbe3a46', 'request_id': 'req-39ff24dd-90af-4d9e-940a-bbf2effe0b84'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:10.507608 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-39ff24dd-90af-4d9e-940a-bbf2effe0b84 admin admin] The token cache is being invalidate because project 5d6762fb38e7440ab3954b1b9fbe3a46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:10.508422 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-39ff24dd-90af-4d9e-940a-bbf2effe0b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:10.510426 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-39ff24dd-90af-4d9e-940a-bbf2effe0b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:10.513888 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1156/2289] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:10 2022] DELETE /identity/v3/projects/5d6762fb38e7440ab3954b1b9fbe3a46 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:10.519327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646da75c-ff33-4dbf-85e9-ce827f97e4ce None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:10.519636 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646da75c-ff33-4dbf-85e9-ce827f97e4ce None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:10.519884 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646da75c-ff33-4dbf-85e9-ce827f97e4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:10.551407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-646da75c-ff33-4dbf-85e9-ce827f97e4ce None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:10.552652 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-646da75c-ff33-4dbf-85e9-ce827f97e4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:10.631154 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff24dd-90af-4d9e-940a-bbf2effe0b84 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:10.633090 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-39ff24dd-90af-4d9e-940a-bbf2effe0b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:10.663123 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1134/2290] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:10.667593 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed31956-08db-422d-8dee-c2bd94a831c6 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:10.668042 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed31956-08db-422d-8dee-c2bd94a831c6 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:10.668380 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed31956-08db-422d-8dee-c2bd94a831c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:10.676221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:10.690895 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7ed31956-08db-422d-8dee-c2bd94a831c6 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:10.692614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7ed31956-08db-422d-8dee-c2bd94a831c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:10.702412 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1135/2291] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:33:10.707203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed31956-08db-422d-8dee-c2bd94a831c6 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:10.722789 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed31956-08db-422d-8dee-c2bd94a831c6 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:10.727919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede81a05-8b6e-450e-8f95-c101729267d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:10.728603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede81a05-8b6e-450e-8f95-c101729267d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:10.729033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede81a05-8b6e-450e-8f95-c101729267d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:10.729251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede81a05-8b6e-450e-8f95-c101729267d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:10.730109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede81a05-8b6e-450e-8f95-c101729267d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:33:10.730288 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede81a05-8b6e-450e-8f95-c101729267d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:10.732337 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede81a05-8b6e-450e-8f95-c101729267d7 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:10.750231 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1136/2292] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:33:10.752098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede81a05-8b6e-450e-8f95-c101729267d7 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:10.768522 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede81a05-8b6e-450e-8f95-c101729267d7 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:10.777172 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcda576-aec4-4867-8332-b13675d3f06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:10.777907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcda576-aec4-4867-8332-b13675d3f06e admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:10.778287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcda576-aec4-4867-8332-b13675d3f06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:10.778479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcda576-aec4-4867-8332-b13675d3f06e admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:10.779211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcda576-aec4-4867-8332-b13675d3f06e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:10.785414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcda576-aec4-4867-8332-b13675d3f06e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:10.802434 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff24dd-90af-4d9e-940a-bbf2effe0b84 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:10.816863 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7bfb7-d2fc-407d-8dcb-b5cd8cb6dfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:10.818392 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7bfb7-d2fc-407d-8dcb-b5cd8cb6dfe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:10.818954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7bfb7-d2fc-407d-8dcb-b5cd8cb6dfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:10.819467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7bfb7-d2fc-407d-8dcb-b5cd8cb6dfe3 admin admin] PATH_INFO: `/v3/projects/399d375539c74778a53061dde2705352` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:10.820941 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7bfb7-d2fc-407d-8dcb-b5cd8cb6dfe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=399d375539c74778a53061dde2705352)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:10.823841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7bfb7-d2fc-407d-8dcb-b5cd8cb6dfe3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:10.823982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1137/2293] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:10 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:10.828578 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcda576-aec4-4867-8332-b13675d3f06e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:10.912543 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-21a7bfb7-d2fc-407d-8dcb-b5cd8cb6dfe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '399d375539c74778a53061dde2705352', 'request_id': 'req-21a7bfb7-d2fc-407d-8dcb-b5cd8cb6dfe3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:10.919622 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-21a7bfb7-d2fc-407d-8dcb-b5cd8cb6dfe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '399d375539c74778a53061dde2705352', 'request_id': 'req-21a7bfb7-d2fc-407d-8dcb-b5cd8cb6dfe3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:10.930455 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcda576-aec4-4867-8332-b13675d3f06e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:10.933079 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-21a7bfb7-d2fc-407d-8dcb-b5cd8cb6dfe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '399d375539c74778a53061dde2705352', 'request_id': 'req-21a7bfb7-d2fc-407d-8dcb-b5cd8cb6dfe3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:10.937630 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:10.957103 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-21a7bfb7-d2fc-407d-8dcb-b5cd8cb6dfe3 admin admin] The token cache is being invalidate because project 399d375539c74778a53061dde2705352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:10.957663 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-21a7bfb7-d2fc-407d-8dcb-b5cd8cb6dfe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:10.959134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-21a7bfb7-d2fc-407d-8dcb-b5cd8cb6dfe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:10.966348 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1157/2294] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:10 2022] DELETE /identity/v3/projects/399d375539c74778a53061dde2705352 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:33:10.971032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7bfb7-d2fc-407d-8dcb-b5cd8cb6dfe3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:10.972775 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-21a7bfb7-d2fc-407d-8dcb-b5cd8cb6dfe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:11.015567 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa086d3-4ec2-4465-9164-a39ebe552f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:11.017840 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa086d3-4ec2-4465-9164-a39ebe552f4c admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:11.017840 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa086d3-4ec2-4465-9164-a39ebe552f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:11.019098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa086d3-4ec2-4465-9164-a39ebe552f4c admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:11.033065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa086d3-4ec2-4465-9164-a39ebe552f4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:11.036502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa086d3-4ec2-4465-9164-a39ebe552f4c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:11.078713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1138/2295] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:10 2022] POST /identity/v3/users => generated 287 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:11.083085 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7bfb7-d2fc-407d-8dcb-b5cd8cb6dfe3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:11.085349 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa086d3-4ec2-4465-9164-a39ebe552f4c admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:11.087281 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7aa086d3-4ec2-4465-9164-a39ebe552f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:11.091830 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f56a0e-af06-43ea-b11b-626d09e580f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:11.092738 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f56a0e-af06-43ea-b11b-626d09e580f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:11.093157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f56a0e-af06-43ea-b11b-626d09e580f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:11.093444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f56a0e-af06-43ea-b11b-626d09e580f6 admin admin] PATH_INFO: `/v3/users/0186a1391e834b968fa731a4dc67d789` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:11.095409 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f56a0e-af06-43ea-b11b-626d09e580f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0186a1391e834b968fa731a4dc67d789)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:11.097370 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f56a0e-af06-43ea-b11b-626d09e580f6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:11.106777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa086d3-4ec2-4465-9164-a39ebe552f4c admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:11.116090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fff558-fa73-49d3-92b4-f258dfce5b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:11.116982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fff558-fa73-49d3-92b4-f258dfce5b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:11.117835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fff558-fa73-49d3-92b4-f258dfce5b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:11.118267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fff558-fa73-49d3-92b4-f258dfce5b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:11.119199 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fff558-fa73-49d3-92b4-f258dfce5b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:11.120972 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fff558-fa73-49d3-92b4-f258dfce5b72 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:11.164644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1139/2296] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:11.173930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fff558-fa73-49d3-92b4-f258dfce5b72 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:11.192556 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fff558-fa73-49d3-92b4-f258dfce5b72 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:11.212863 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b758d0-7acf-45f2-8258-6a76fae27fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:11.214776 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b758d0-7acf-45f2-8258-6a76fae27fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:11.215253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b758d0-7acf-45f2-8258-6a76fae27fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:11.223622 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b758d0-7acf-45f2-8258-6a76fae27fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:11.225267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-44f56a0e-af06-43ea-b11b-626d09e580f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0186a1391e834b968fa731a4dc67d789'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:11.226926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b758d0-7acf-45f2-8258-6a76fae27fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:11.230609 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b758d0-7acf-45f2-8258-6a76fae27fe5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:11.240774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:11.248633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-44f56a0e-af06-43ea-b11b-626d09e580f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0186a1391e834b968fa731a4dc67d789'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:11.256652 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1140/2297] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:11.260606 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b758d0-7acf-45f2-8258-6a76fae27fe5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:11.290051 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b758d0-7acf-45f2-8258-6a76fae27fe5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:11.292028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-44f56a0e-af06-43ea-b11b-626d09e580f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0186a1391e834b968fa731a4dc67d789'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:11.304804 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6479750-8589-4635-bd11-66ff4b0f9d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:11.312595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-44f56a0e-af06-43ea-b11b-626d09e580f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0186a1391e834b968fa731a4dc67d789'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:11.313891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-44f56a0e-af06-43ea-b11b-626d09e580f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0186a1391e834b968fa731a4dc67d789'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:11.317098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6479750-8589-4635-bd11-66ff4b0f9d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:11.317407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6479750-8589-4635-bd11-66ff4b0f9d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:11.317656 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6479750-8589-4635-bd11-66ff4b0f9d2d admin admin] PATH_INFO: `/v3/projects/8d0aae5945f64164857f554b913263a1/users/86b5138c0584453facfc07310f79dc2b/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:11.326929 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1158/2298] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:33:10 2022] DELETE /identity/v3/users/0186a1391e834b968fa731a4dc67d789 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:11.351197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6479750-8589-4635-bd11-66ff4b0f9d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d0aae5945f64164857f554b913263a1, user_id=86b5138c0584453facfc07310f79dc2b, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:11.353936 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6479750-8589-4635-bd11-66ff4b0f9d2d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:11.379101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1141/2299] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:11 2022] PUT /identity/v3/projects/8d0aae5945f64164857f554b913263a1/users/86b5138c0584453facfc07310f79dc2b/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:11.387769 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97e53e-fe6e-4a5a-a6d7-e26c8c95768c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:11.388077 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97e53e-fe6e-4a5a-a6d7-e26c8c95768c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:11.388318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97e53e-fe6e-4a5a-a6d7-e26c8c95768c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:11.437669 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cf97e53e-fe6e-4a5a-a6d7-e26c8c95768c None None] MFA Rules not processed for user `86b5138c0584453facfc07310f79dc2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:11.440277 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cf97e53e-fe6e-4a5a-a6d7-e26c8c95768c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:11.615323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1159/2300] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:11.619748 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36445b-d08c-4132-b843-92fd4ca41181 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:11.620042 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36445b-d08c-4132-b843-92fd4ca41181 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:11.620321 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36445b-d08c-4132-b843-92fd4ca41181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:11.630002 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97e53e-fe6e-4a5a-a6d7-e26c8c95768c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:11.631728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cf97e53e-fe6e-4a5a-a6d7-e26c8c95768c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:11.670397 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-5b36445b-d08c-4132-b843-92fd4ca41181 None None] MFA Rules not processed for user `a8e59595697d46c2b27ef1a5a9518e05`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:11.677616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5b36445b-d08c-4132-b843-92fd4ca41181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:11.785473 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97e53e-fe6e-4a5a-a6d7-e26c8c95768c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:11.794091 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82edf3-b010-4b35-9b5f-8da7791ebc1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:11.794800 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82edf3-b010-4b35-9b5f-8da7791ebc1f service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:11.795083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82edf3-b010-4b35-9b5f-8da7791ebc1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:11.798233 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82edf3-b010-4b35-9b5f-8da7791ebc1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:11.812190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82edf3-b010-4b35-9b5f-8da7791ebc1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:11.814397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82edf3-b010-4b35-9b5f-8da7791ebc1f service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:11.843123 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1142/2301] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:11.843392 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1160/2302] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:11.851538 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36445b-d08c-4132-b843-92fd4ca41181 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:11.853709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5b36445b-d08c-4132-b843-92fd4ca41181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:11.957851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:11.958651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82edf3-b010-4b35-9b5f-8da7791ebc1f service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:11.960692 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5c82edf3-b010-4b35-9b5f-8da7791ebc1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:12.017695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36445b-d08c-4132-b843-92fd4ca41181 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:12.028521 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48c194-26c5-4786-be64-616b1d78e8b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1af8b237e2df41668bc5409d8fdd3f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:12.034700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48c194-26c5-4786-be64-616b1d78e8b8 service glance] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:12.035416 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48c194-26c5-4786-be64-616b1d78e8b8 service glance] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:12.037489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48c194-26c5-4786-be64-616b1d78e8b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:12.043765 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9f48c194-26c5-4786-be64-616b1d78e8b8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:12.163256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82edf3-b010-4b35-9b5f-8da7791ebc1f service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:12.167221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48c194-26c5-4786-be64-616b1d78e8b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:12.173461 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48c194-26c5-4786-be64-616b1d78e8b8 service glance] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:12.181772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa2b90-7048-45f6-926c-5dce0f85e45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:12.182802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa2b90-7048-45f6-926c-5dce0f85e45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:12.182949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa2b90-7048-45f6-926c-5dce0f85e45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:12.183222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa2b90-7048-45f6-926c-5dce0f85e45a admin admin] PATH_INFO: `/v3/projects/0fb1af9230fb4ada923df575093b3c95` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:12.184470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa2b90-7048-45f6-926c-5dce0f85e45a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fb1af9230fb4ada923df575093b3c95)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:12.186419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa2b90-7048-45f6-926c-5dce0f85e45a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:12.187897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1143/2303] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:12.191925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:12.300884 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bbfa2b90-7048-45f6-926c-5dce0f85e45a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fb1af9230fb4ada923df575093b3c95', 'request_id': 'req-bbfa2b90-7048-45f6-926c-5dce0f85e45a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:12.349758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bbfa2b90-7048-45f6-926c-5dce0f85e45a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fb1af9230fb4ada923df575093b3c95', 'request_id': 'req-bbfa2b90-7048-45f6-926c-5dce0f85e45a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:12.366444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bbfa2b90-7048-45f6-926c-5dce0f85e45a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fb1af9230fb4ada923df575093b3c95', 'request_id': 'req-bbfa2b90-7048-45f6-926c-5dce0f85e45a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:12.400448 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bbfa2b90-7048-45f6-926c-5dce0f85e45a admin admin] The token cache is being invalidate because project 0fb1af9230fb4ada923df575093b3c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:12.403116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bbfa2b90-7048-45f6-926c-5dce0f85e45a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:12.404140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bbfa2b90-7048-45f6-926c-5dce0f85e45a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:12.412689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1161/2304] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:11 2022] DELETE /identity/v3/projects/0fb1af9230fb4ada923df575093b3c95 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:12.414937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f84fc5-92ae-4efd-be22-99e478003678 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:12.416865 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f84fc5-92ae-4efd-be22-99e478003678 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:12.417302 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f84fc5-92ae-4efd-be22-99e478003678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:12.450402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-15f84fc5-92ae-4efd-be22-99e478003678 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:12.452141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-15f84fc5-92ae-4efd-be22-99e478003678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:12.457361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3a81e-8a2c-43f7-bf3f-64b0adebd14a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:12.458037 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3a81e-8a2c-43f7-bf3f-64b0adebd14a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:12.458037 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3a81e-8a2c-43f7-bf3f-64b0adebd14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:12.497830 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f2b3a81e-8a2c-43f7-bf3f-64b0adebd14a None None] MFA Rules not processed for user `18030043de1942779baf3ad94aec4071`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:12.499112 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f2b3a81e-8a2c-43f7-bf3f-64b0adebd14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:12.543670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1144/2305] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:12.549638 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81f979-e94c-42a9-a6cd-ba5cb3993827 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:12.554504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81f979-e94c-42a9-a6cd-ba5cb3993827 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:12.554504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81f979-e94c-42a9-a6cd-ba5cb3993827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:12.574582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1162/2306] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 19 12:33:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:12.578233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-de81f979-e94c-42a9-a6cd-ba5cb3993827 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:12.580104 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-de81f979-e94c-42a9-a6cd-ba5cb3993827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:12.590781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1145/2307] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:33:12.593791 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3a81e-8a2c-43f7-bf3f-64b0adebd14a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:12.612206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3a81e-8a2c-43f7-bf3f-64b0adebd14a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:12.624298 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1219d27-83ae-49b8-a42e-34ad82a06691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:12.624855 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1219d27-83ae-49b8-a42e-34ad82a06691 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:12.625266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1219d27-83ae-49b8-a42e-34ad82a06691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:12.625399 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1219d27-83ae-49b8-a42e-34ad82a06691 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:12.626214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1219d27-83ae-49b8-a42e-34ad82a06691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:33:12.626703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1219d27-83ae-49b8-a42e-34ad82a06691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:12.628322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81f979-e94c-42a9-a6cd-ba5cb3993827 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:12.629722 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-de81f979-e94c-42a9-a6cd-ba5cb3993827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:12.629949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1219d27-83ae-49b8-a42e-34ad82a06691 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:12.644161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1163/2308] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:33:12.648470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1219d27-83ae-49b8-a42e-34ad82a06691 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:12.659138 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1219d27-83ae-49b8-a42e-34ad82a06691 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:12.663943 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c64363-4f2c-4c67-964e-9e1bdcf8e277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:12.664622 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c64363-4f2c-4c67-964e-9e1bdcf8e277 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:12.664898 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c64363-4f2c-4c67-964e-9e1bdcf8e277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:12.665196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c64363-4f2c-4c67-964e-9e1bdcf8e277 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:12.665872 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c64363-4f2c-4c67-964e-9e1bdcf8e277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:12.668192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c64363-4f2c-4c67-964e-9e1bdcf8e277 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:12.705005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1164/2309] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:12 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:33:12.706074 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c64363-4f2c-4c67-964e-9e1bdcf8e277 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:12.720133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81f979-e94c-42a9-a6cd-ba5cb3993827 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:12.746954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:12.779467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c64363-4f2c-4c67-964e-9e1bdcf8e277 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:12.784459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea9fad-e101-42de-b0ad-355ae693d4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:12.785238 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea9fad-e101-42de-b0ad-355ae693d4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:12.785625 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea9fad-e101-42de-b0ad-355ae693d4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:12.785728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63948ef9-6a2e-4932-9f51-2b0022c0bb9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc2e1079d34745a279588028945c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:12.786088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea9fad-e101-42de-b0ad-355ae693d4d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:12.786282 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63948ef9-6a2e-4932-9f51-2b0022c0bb9e service swift] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:12.786563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63948ef9-6a2e-4932-9f51-2b0022c0bb9e service swift] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:12.786869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63948ef9-6a2e-4932-9f51-2b0022c0bb9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:12.787215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea9fad-e101-42de-b0ad-355ae693d4d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:12.789316 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea9fad-e101-42de-b0ad-355ae693d4d5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:12.797289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:12.815179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1165/2310] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:12 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:12.816046 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea9fad-e101-42de-b0ad-355ae693d4d5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:12.826135 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea9fad-e101-42de-b0ad-355ae693d4d5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:12.830981 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dfb25-bcc1-4382-8a0e-6c02c5314e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:12.831640 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dfb25-bcc1-4382-8a0e-6c02c5314e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:12.831918 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dfb25-bcc1-4382-8a0e-6c02c5314e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:12.832235 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dfb25-bcc1-4382-8a0e-6c02c5314e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:12.833058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344dfb25-bcc1-4382-8a0e-6c02c5314e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:12.834696 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344dfb25-bcc1-4382-8a0e-6c02c5314e52 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:12.849058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1166/2311] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:33:12.850044 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dfb25-bcc1-4382-8a0e-6c02c5314e52 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:12.852924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63948ef9-6a2e-4932-9f51-2b0022c0bb9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:12.854540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63948ef9-6a2e-4932-9f51-2b0022c0bb9e service swift] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:12.859597 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dfb25-bcc1-4382-8a0e-6c02c5314e52 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:12.865051 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f63308-0f35-4a4b-972a-285763053c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:12.865257 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1146/2312] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 19 12:33:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 12:33:12.865704 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f63308-0f35-4a4b-972a-285763053c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:12.866008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f63308-0f35-4a4b-972a-285763053c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:12.866299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f63308-0f35-4a4b-972a-285763053c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:12.867178 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f63308-0f35-4a4b-972a-285763053c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:12.868773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f63308-0f35-4a4b-972a-285763053c29 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:12.880644 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1167/2313] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:33:12.885324 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63948ef9-6a2e-4932-9f51-2b0022c0bb9e service swift] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:12.899096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63948ef9-6a2e-4932-9f51-2b0022c0bb9e service swift] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:12.911986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574c75b-2235-4124-a13e-ce56289ba2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:12.913157 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574c75b-2235-4124-a13e-ce56289ba2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:12.913616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574c75b-2235-4124-a13e-ce56289ba2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:12.913970 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574c75b-2235-4124-a13e-ce56289ba2f4 admin admin] PATH_INFO: `/v3/projects/99394ac4128b4a36a98e0865e0a28256/users/3419c857a9794a239ea56679872c9240/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:12.936147 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574c75b-2235-4124-a13e-ce56289ba2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99394ac4128b4a36a98e0865e0a28256, user_id=3419c857a9794a239ea56679872c9240, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:12.941737 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574c75b-2235-4124-a13e-ce56289ba2f4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:12.993218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1147/2314] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:12 2022] PUT /identity/v3/projects/99394ac4128b4a36a98e0865e0a28256/users/3419c857a9794a239ea56679872c9240/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:12.998983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10334cb2-ef22-4a59-b5a5-6d369cd4e801 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:12.999554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10334cb2-ef22-4a59-b5a5-6d369cd4e801 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:12.999675 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10334cb2-ef22-4a59-b5a5-6d369cd4e801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:13.033717 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-10334cb2-ef22-4a59-b5a5-6d369cd4e801 None None] MFA Rules not processed for user `3419c857a9794a239ea56679872c9240`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:13.035282 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-10334cb2-ef22-4a59-b5a5-6d369cd4e801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:13.135246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1168/2315] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:13.141333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574c75b-2235-4124-a13e-ce56289ba2f4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:13.239365 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574c75b-2235-4124-a13e-ce56289ba2f4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:13.253974 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a018678-1ba9-4aca-94ae-2c9d652eb29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:13.254660 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a018678-1ba9-4aca-94ae-2c9d652eb29d admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:13.254965 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a018678-1ba9-4aca-94ae-2c9d652eb29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:13.255239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a018678-1ba9-4aca-94ae-2c9d652eb29d admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:13.255958 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a018678-1ba9-4aca-94ae-2c9d652eb29d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:13.257879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a018678-1ba9-4aca-94ae-2c9d652eb29d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:13.312870 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1148/2316] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:13 2022] POST /identity/v3/projects => generated 367 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:13.314033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10334cb2-ef22-4a59-b5a5-6d369cd4e801 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:13.336975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10334cb2-ef22-4a59-b5a5-6d369cd4e801 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:13.499327 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944b306-d856-4f79-968e-25f9707b48e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:13.501007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944b306-d856-4f79-968e-25f9707b48e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:13.501469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944b306-d856-4f79-968e-25f9707b48e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:13.501983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944b306-d856-4f79-968e-25f9707b48e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:13.503902 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944b306-d856-4f79-968e-25f9707b48e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:13.505176 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b64f2-5388-4df0-9d54-301a1d205ee9 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:13.505472 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b64f2-5388-4df0-9d54-301a1d205ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:13.505755 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b64f2-5388-4df0-9d54-301a1d205ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:13.507732 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944b306-d856-4f79-968e-25f9707b48e5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:13.534228 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-614b64f2-5388-4df0-9d54-301a1d205ee9 None None] MFA Rules not processed for user `86b5138c0584453facfc07310f79dc2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:13.535676 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-614b64f2-5388-4df0-9d54-301a1d205ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:13.574708 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1169/2317] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:13 2022] POST /identity/v3/users => generated 290 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:33:13.579208 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944b306-d856-4f79-968e-25f9707b48e5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:13.593626 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944b306-d856-4f79-968e-25f9707b48e5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:13.597325 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:13.603285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7994d6-6689-4990-ad7b-1ba6aceae649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:13.604352 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7994d6-6689-4990-ad7b-1ba6aceae649 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:13.604782 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7994d6-6689-4990-ad7b-1ba6aceae649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:13.606361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7994d6-6689-4990-ad7b-1ba6aceae649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:13.607475 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7994d6-6689-4990-ad7b-1ba6aceae649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:13.617206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7994d6-6689-4990-ad7b-1ba6aceae649 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:13.659365 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1170/2318] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:13.663251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7994d6-6689-4990-ad7b-1ba6aceae649 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:13.698694 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7994d6-6689-4990-ad7b-1ba6aceae649 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:13.713093 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ebab2-4211-4bb7-a826-2b51762bac7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:13.714025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ebab2-4211-4bb7-a826-2b51762bac7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:13.714309 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ebab2-4211-4bb7-a826-2b51762bac7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:13.714947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ebab2-4211-4bb7-a826-2b51762bac7f admin admin] PATH_INFO: `/v3/projects/169936a7f9b243a2bbbf8d23283dbd9c/users/b8ed161d88494f8297550b5ce4a831e5/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:13.726296 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1149/2319] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:33:13.800394 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ebab2-4211-4bb7-a826-2b51762bac7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=169936a7f9b243a2bbbf8d23283dbd9c, user_id=b8ed161d88494f8297550b5ce4a831e5, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:13.805843 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ebab2-4211-4bb7-a826-2b51762bac7f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:13.878129 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1171/2320] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:13 2022] PUT /identity/v3/projects/169936a7f9b243a2bbbf8d23283dbd9c/users/b8ed161d88494f8297550b5ce4a831e5/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:13.882149 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b64f2-5388-4df0-9d54-301a1d205ee9 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:13.895239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b64f2-5388-4df0-9d54-301a1d205ee9 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:13.997567 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecba9cf-14c3-4b6e-baa4-295a890e0b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:13.998782 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecba9cf-14c3-4b6e-baa4-295a890e0b38 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:13.999378 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecba9cf-14c3-4b6e-baa4-295a890e0b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:13.999990 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecba9cf-14c3-4b6e-baa4-295a890e0b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:14.001719 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecba9cf-14c3-4b6e-baa4-295a890e0b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:14.003937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecba9cf-14c3-4b6e-baa4-295a890e0b38 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:14.020471 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1150/2321] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:14.024596 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ebab2-4211-4bb7-a826-2b51762bac7f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:14.040772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ebab2-4211-4bb7-a826-2b51762bac7f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:14.051957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15929e9a-eb27-4281-9311-3a90dbaf8438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:14.053286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15929e9a-eb27-4281-9311-3a90dbaf8438 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:14.053642 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15929e9a-eb27-4281-9311-3a90dbaf8438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:14.054118 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15929e9a-eb27-4281-9311-3a90dbaf8438 admin admin] PATH_INFO: `/v3/projects/169936a7f9b243a2bbbf8d23283dbd9c/users/b8ed161d88494f8297550b5ce4a831e5/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:14.057030 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15929e9a-eb27-4281-9311-3a90dbaf8438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=169936a7f9b243a2bbbf8d23283dbd9c, user_id=b8ed161d88494f8297550b5ce4a831e5, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:14.060865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15929e9a-eb27-4281-9311-3a90dbaf8438 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:14.072157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:14.091315 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1172/2322] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:14 2022] PUT /identity/v3/projects/169936a7f9b243a2bbbf8d23283dbd9c/users/b8ed161d88494f8297550b5ce4a831e5/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:14.102278 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99227b-f936-42a5-8a6c-c22693ec3412 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:14.102564 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99227b-f936-42a5-8a6c-c22693ec3412 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:14.102874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99227b-f936-42a5-8a6c-c22693ec3412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:14.140667 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0b99227b-f936-42a5-8a6c-c22693ec3412 None None] MFA Rules not processed for user `b8ed161d88494f8297550b5ce4a831e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:14.161446 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0b99227b-f936-42a5-8a6c-c22693ec3412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:14.297071 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1151/2323] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:14.309993 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15929e9a-eb27-4281-9311-3a90dbaf8438 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:14.312160 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-15929e9a-eb27-4281-9311-3a90dbaf8438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:14.404958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15929e9a-eb27-4281-9311-3a90dbaf8438 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:14.409350 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded14c1-023a-421b-a6d4-5c6d3a40b6c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:14.410296 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded14c1-023a-421b-a6d4-5c6d3a40b6c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:14.410613 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded14c1-023a-421b-a6d4-5c6d3a40b6c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:14.411058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded14c1-023a-421b-a6d4-5c6d3a40b6c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:14.421987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded14c1-023a-421b-a6d4-5c6d3a40b6c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:14.424062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded14c1-023a-421b-a6d4-5c6d3a40b6c6 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:14.447295 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1173/2324] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:14 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:14.501453 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99227b-f936-42a5-8a6c-c22693ec3412 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:14.503050 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0b99227b-f936-42a5-8a6c-c22693ec3412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:14.517418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99227b-f936-42a5-8a6c-c22693ec3412 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:14.522364 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118da5b-5817-4b95-8960-fd4f32701044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:14.523420 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118da5b-5817-4b95-8960-fd4f32701044 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:14.523807 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118da5b-5817-4b95-8960-fd4f32701044 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:14.524344 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118da5b-5817-4b95-8960-fd4f32701044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:14.623458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:14.628724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118da5b-5817-4b95-8960-fd4f32701044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:14.630465 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118da5b-5817-4b95-8960-fd4f32701044 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:14.646642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1152/2325] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:15.053057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded14c1-023a-421b-a6d4-5c6d3a40b6c6 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:15.054941 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8ded14c1-023a-421b-a6d4-5c6d3a40b6c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:15.291823 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded14c1-023a-421b-a6d4-5c6d3a40b6c6 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:15.304557 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3dd58-31c6-471f-82bc-dbd4002623f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:15.305457 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3dd58-31c6-471f-82bc-dbd4002623f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:15.305736 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3dd58-31c6-471f-82bc-dbd4002623f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:15.306013 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3dd58-31c6-471f-82bc-dbd4002623f1 admin admin] PATH_INFO: `/v3/users/6579880842b3490190c93be746b43171` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:15.311536 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3dd58-31c6-471f-82bc-dbd4002623f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6579880842b3490190c93be746b43171)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:15.314138 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3dd58-31c6-471f-82bc-dbd4002623f1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:15.441645 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-72f3dd58-31c6-471f-82bc-dbd4002623f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6579880842b3490190c93be746b43171'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:15.462041 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-72f3dd58-31c6-471f-82bc-dbd4002623f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6579880842b3490190c93be746b43171'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:15.498209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-72f3dd58-31c6-471f-82bc-dbd4002623f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6579880842b3490190c93be746b43171'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:15.538450 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-72f3dd58-31c6-471f-82bc-dbd4002623f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6579880842b3490190c93be746b43171'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:15.539216 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-72f3dd58-31c6-471f-82bc-dbd4002623f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6579880842b3490190c93be746b43171'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:15.558856 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1174/2326] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:33:15 2022] DELETE /identity/v3/users/6579880842b3490190c93be746b43171 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:15.561039 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69413e62-8dc7-42fd-b1a9-047889f22e9b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:15.561534 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69413e62-8dc7-42fd-b1a9-047889f22e9b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:15.561647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69413e62-8dc7-42fd-b1a9-047889f22e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:15.595903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-69413e62-8dc7-42fd-b1a9-047889f22e9b None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:15.597178 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-69413e62-8dc7-42fd-b1a9-047889f22e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:15.740882 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1153/2327] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:15.748762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3dd58-31c6-471f-82bc-dbd4002623f1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:15.750246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-72f3dd58-31c6-471f-82bc-dbd4002623f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:15.809057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:15.869162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3dd58-31c6-471f-82bc-dbd4002623f1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:15.879358 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86750c5-a953-48a6-970f-6fce74574d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:15.880226 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86750c5-a953-48a6-970f-6fce74574d35 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:15.880572 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86750c5-a953-48a6-970f-6fce74574d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:15.881070 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86750c5-a953-48a6-970f-6fce74574d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:15.896220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86750c5-a953-48a6-970f-6fce74574d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:15.901844 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86750c5-a953-48a6-970f-6fce74574d35 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:15.916757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1175/2328] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:16.344289 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69413e62-8dc7-42fd-b1a9-047889f22e9b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:16.346156 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-69413e62-8dc7-42fd-b1a9-047889f22e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:16.393640 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69413e62-8dc7-42fd-b1a9-047889f22e9b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:16.410928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bffe73-60c7-4592-9f03-c474812817c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:16.412089 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bffe73-60c7-4592-9f03-c474812817c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:16.412546 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bffe73-60c7-4592-9f03-c474812817c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:16.413127 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bffe73-60c7-4592-9f03-c474812817c4 admin admin] PATH_INFO: `/v3/projects/bac15896b2a6476e9dfdd412ad39b73f` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:16.414767 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bffe73-60c7-4592-9f03-c474812817c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bac15896b2a6476e9dfdd412ad39b73f)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:16.418320 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bffe73-60c7-4592-9f03-c474812817c4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:16.483622 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-97bffe73-60c7-4592-9f03-c474812817c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bac15896b2a6476e9dfdd412ad39b73f', 'request_id': 'req-97bffe73-60c7-4592-9f03-c474812817c4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:16.490569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-97bffe73-60c7-4592-9f03-c474812817c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bac15896b2a6476e9dfdd412ad39b73f', 'request_id': 'req-97bffe73-60c7-4592-9f03-c474812817c4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:16.502056 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-97bffe73-60c7-4592-9f03-c474812817c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bac15896b2a6476e9dfdd412ad39b73f', 'request_id': 'req-97bffe73-60c7-4592-9f03-c474812817c4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:16.515655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-97bffe73-60c7-4592-9f03-c474812817c4 admin admin] The token cache is being invalidate because project bac15896b2a6476e9dfdd412ad39b73f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:16.515985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-97bffe73-60c7-4592-9f03-c474812817c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:16.516641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-97bffe73-60c7-4592-9f03-c474812817c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:16.521672 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1154/2329] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:16 2022] DELETE /identity/v3/projects/bac15896b2a6476e9dfdd412ad39b73f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:16.522941 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86750c5-a953-48a6-970f-6fce74574d35 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:16.546547 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86750c5-a953-48a6-970f-6fce74574d35 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:16.691086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5b279-a26d-466f-b8ae-5232b872dcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:16.694563 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5b279-a26d-466f-b8ae-5232b872dcb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:16.695014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5b279-a26d-466f-b8ae-5232b872dcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:16.702462 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5b279-a26d-466f-b8ae-5232b872dcb1 admin admin] PATH_INFO: `/v3/users/d201748f0b9240deb2cb245865f1c338` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:16.705877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5b279-a26d-466f-b8ae-5232b872dcb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d201748f0b9240deb2cb245865f1c338)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:16.707859 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5b279-a26d-466f-b8ae-5232b872dcb1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:16.834383 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1ef5b279-a26d-466f-b8ae-5232b872dcb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd201748f0b9240deb2cb245865f1c338'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:16.851253 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1ef5b279-a26d-466f-b8ae-5232b872dcb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd201748f0b9240deb2cb245865f1c338'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:16.885613 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1ef5b279-a26d-466f-b8ae-5232b872dcb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd201748f0b9240deb2cb245865f1c338'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:16.903876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1ef5b279-a26d-466f-b8ae-5232b872dcb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd201748f0b9240deb2cb245865f1c338'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:16.904502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1ef5b279-a26d-466f-b8ae-5232b872dcb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd201748f0b9240deb2cb245865f1c338'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:16.914781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1176/2330] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:33:16 2022] DELETE /identity/v3/users/d201748f0b9240deb2cb245865f1c338 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:17.656896 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bffe73-60c7-4592-9f03-c474812817c4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:17.661177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-97bffe73-60c7-4592-9f03-c474812817c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:17.734984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bffe73-60c7-4592-9f03-c474812817c4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:17.889632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e53da-34c7-4f01-86ea-9d0be7eddd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:17.894606 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e53da-34c7-4f01-86ea-9d0be7eddd50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:17.895697 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e53da-34c7-4f01-86ea-9d0be7eddd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:17.896809 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e53da-34c7-4f01-86ea-9d0be7eddd50 admin admin] PATH_INFO: `/v3/projects/04bafd9ba47d43f0bac6b5e0f373236a` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:17.902655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e53da-34c7-4f01-86ea-9d0be7eddd50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04bafd9ba47d43f0bac6b5e0f373236a)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:17.904950 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e53da-34c7-4f01-86ea-9d0be7eddd50 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:17.960294 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:18.020886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-550e53da-34c7-4f01-86ea-9d0be7eddd50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04bafd9ba47d43f0bac6b5e0f373236a', 'request_id': 'req-550e53da-34c7-4f01-86ea-9d0be7eddd50'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:18.032812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-550e53da-34c7-4f01-86ea-9d0be7eddd50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04bafd9ba47d43f0bac6b5e0f373236a', 'request_id': 'req-550e53da-34c7-4f01-86ea-9d0be7eddd50'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:18.050438 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-550e53da-34c7-4f01-86ea-9d0be7eddd50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04bafd9ba47d43f0bac6b5e0f373236a', 'request_id': 'req-550e53da-34c7-4f01-86ea-9d0be7eddd50'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:18.070608 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-550e53da-34c7-4f01-86ea-9d0be7eddd50 admin admin] The token cache is being invalidate because project 04bafd9ba47d43f0bac6b5e0f373236a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:18.071531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-550e53da-34c7-4f01-86ea-9d0be7eddd50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:18.072458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-550e53da-34c7-4f01-86ea-9d0be7eddd50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:18.075123 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1155/2331] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:17 2022] DELETE /identity/v3/projects/04bafd9ba47d43f0bac6b5e0f373236a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:18.079213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5b279-a26d-466f-b8ae-5232b872dcb1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:18.080896 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1ef5b279-a26d-466f-b8ae-5232b872dcb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:18.100202 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5b279-a26d-466f-b8ae-5232b872dcb1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:18.160440 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:18.217857 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2af5cd-d72d-4fcb-ad3e-f614f6785ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:18.220796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2af5cd-d72d-4fcb-ad3e-f614f6785ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:18.223317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2af5cd-d72d-4fcb-ad3e-f614f6785ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:18.224588 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2af5cd-d72d-4fcb-ad3e-f614f6785ede admin admin] PATH_INFO: `/v3/users/ea88fee91d494f53b2f18c7f0fb85d57` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:18.227497 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2af5cd-d72d-4fcb-ad3e-f614f6785ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea88fee91d494f53b2f18c7f0fb85d57)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:18.229622 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2af5cd-d72d-4fcb-ad3e-f614f6785ede admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:18.329944 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bb2af5cd-d72d-4fcb-ad3e-f614f6785ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea88fee91d494f53b2f18c7f0fb85d57'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:18.338766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bb2af5cd-d72d-4fcb-ad3e-f614f6785ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea88fee91d494f53b2f18c7f0fb85d57'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:18.357243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bb2af5cd-d72d-4fcb-ad3e-f614f6785ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea88fee91d494f53b2f18c7f0fb85d57'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:18.372620 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bb2af5cd-d72d-4fcb-ad3e-f614f6785ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea88fee91d494f53b2f18c7f0fb85d57'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:18.373686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bb2af5cd-d72d-4fcb-ad3e-f614f6785ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea88fee91d494f53b2f18c7f0fb85d57'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:18.388512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1177/2332] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:33:18 2022] DELETE /identity/v3/users/ea88fee91d494f53b2f18c7f0fb85d57 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:19.168918 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e53da-34c7-4f01-86ea-9d0be7eddd50 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:19.170672 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-550e53da-34c7-4f01-86ea-9d0be7eddd50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:19.215441 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e53da-34c7-4f01-86ea-9d0be7eddd50 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:19.479150 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b699db7-a03f-4c3a-abe0-fcec60938398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:19.480223 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b699db7-a03f-4c3a-abe0-fcec60938398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:19.480661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b699db7-a03f-4c3a-abe0-fcec60938398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:19.481094 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b699db7-a03f-4c3a-abe0-fcec60938398 admin admin] PATH_INFO: `/v3/projects/4beda43c72be4b618c38334c8b3b2a94` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:19.482589 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b699db7-a03f-4c3a-abe0-fcec60938398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4beda43c72be4b618c38334c8b3b2a94)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:19.485484 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b699db7-a03f-4c3a-abe0-fcec60938398 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:19.552962 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2af5cd-d72d-4fcb-ad3e-f614f6785ede admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:19.554826 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bb2af5cd-d72d-4fcb-ad3e-f614f6785ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:19.558043 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6b699db7-a03f-4c3a-abe0-fcec60938398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4beda43c72be4b618c38334c8b3b2a94', 'request_id': 'req-6b699db7-a03f-4c3a-abe0-fcec60938398'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:19.566698 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6b699db7-a03f-4c3a-abe0-fcec60938398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4beda43c72be4b618c38334c8b3b2a94', 'request_id': 'req-6b699db7-a03f-4c3a-abe0-fcec60938398'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:19.569969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2af5cd-d72d-4fcb-ad3e-f614f6785ede admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:19.577838 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6b699db7-a03f-4c3a-abe0-fcec60938398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4beda43c72be4b618c38334c8b3b2a94', 'request_id': 'req-6b699db7-a03f-4c3a-abe0-fcec60938398'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:19.608355 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6b699db7-a03f-4c3a-abe0-fcec60938398 admin admin] The token cache is being invalidate because project 4beda43c72be4b618c38334c8b3b2a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:19.608355 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6b699db7-a03f-4c3a-abe0-fcec60938398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:19.611180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6b699db7-a03f-4c3a-abe0-fcec60938398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:19.622059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1156/2333] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:19 2022] DELETE /identity/v3/projects/4beda43c72be4b618c38334c8b3b2a94 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:19.624107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3453c2-e38d-40a6-bdfb-456569d8d7cb None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:19.624467 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3453c2-e38d-40a6-bdfb-456569d8d7cb None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:19.625256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3453c2-e38d-40a6-bdfb-456569d8d7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:19.676223 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a013e9-e7b3-48ce-b3b0-e8434c5c7791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:19.676436 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7d3453c2-e38d-40a6-bdfb-456569d8d7cb None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:19.677571 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7d3453c2-e38d-40a6-bdfb-456569d8d7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:19.677849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a013e9-e7b3-48ce-b3b0-e8434c5c7791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:19.678615 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a013e9-e7b3-48ce-b3b0-e8434c5c7791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:19.679161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a013e9-e7b3-48ce-b3b0-e8434c5c7791 admin admin] PATH_INFO: `/v3/users/3419c857a9794a239ea56679872c9240` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:19.680849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a013e9-e7b3-48ce-b3b0-e8434c5c7791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3419c857a9794a239ea56679872c9240)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:19.683895 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a013e9-e7b3-48ce-b3b0-e8434c5c7791 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:19.713606 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1157/2334] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:19.715247 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4d307-1123-430b-9fbc-7fb8e09604b3 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:19.715538 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4d307-1123-430b-9fbc-7fb8e09604b3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:19.715812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4d307-1123-430b-9fbc-7fb8e09604b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:19.751858 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-27d4d307-1123-430b-9fbc-7fb8e09604b3 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:19.758693 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-27d4d307-1123-430b-9fbc-7fb8e09604b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:19.789022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1158/2335] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:33:19.790562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4d307-1123-430b-9fbc-7fb8e09604b3 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:19.796202 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f5a013e9-e7b3-48ce-b3b0-e8434c5c7791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3419c857a9794a239ea56679872c9240'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:19.802954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4d307-1123-430b-9fbc-7fb8e09604b3 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:19.809563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a2f83-b702-44c1-bb10-ee9d8f237fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:19.810330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a2f83-b702-44c1-bb10-ee9d8f237fdf admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:19.810622 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a2f83-b702-44c1-bb10-ee9d8f237fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:19.810982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a2f83-b702-44c1-bb10-ee9d8f237fdf admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:19.811843 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a2f83-b702-44c1-bb10-ee9d8f237fdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:33:19.812304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a2f83-b702-44c1-bb10-ee9d8f237fdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:19.815214 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a2f83-b702-44c1-bb10-ee9d8f237fdf admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:19.819458 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f5a013e9-e7b3-48ce-b3b0-e8434c5c7791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3419c857a9794a239ea56679872c9240'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:19.828374 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:19.837165 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1159/2336] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:33:19.840299 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a2f83-b702-44c1-bb10-ee9d8f237fdf admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:19.850881 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f5a013e9-e7b3-48ce-b3b0-e8434c5c7791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3419c857a9794a239ea56679872c9240'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:19.866014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f5a013e9-e7b3-48ce-b3b0-e8434c5c7791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3419c857a9794a239ea56679872c9240'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:19.866549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a2f83-b702-44c1-bb10-ee9d8f237fdf admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:19.867040 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f5a013e9-e7b3-48ce-b3b0-e8434c5c7791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3419c857a9794a239ea56679872c9240'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:19.895571 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1178/2337] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:33:19 2022] DELETE /identity/v3/users/3419c857a9794a239ea56679872c9240 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:33:19.898017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438b6e4-b845-42a8-8028-99610606b1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:19.899704 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438b6e4-b845-42a8-8028-99610606b1dd admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:19.899998 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438b6e4-b845-42a8-8028-99610606b1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:19.900277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438b6e4-b845-42a8-8028-99610606b1dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:19.901143 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438b6e4-b845-42a8-8028-99610606b1dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:19.902876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7339319-e53a-4158-971b-9958a4770712 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:19.903161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7339319-e53a-4158-971b-9958a4770712 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:19.903440 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7339319-e53a-4158-971b-9958a4770712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:19.910874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438b6e4-b845-42a8-8028-99610606b1dd admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:19.947911 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:19.952107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a7339319-e53a-4158-971b-9958a4770712 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:19.954997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a7339319-e53a-4158-971b-9958a4770712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:19.974095 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1160/2338] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:19 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:19.990286 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438b6e4-b845-42a8-8028-99610606b1dd admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:19.994828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8438b6e4-b845-42a8-8028-99610606b1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:20.068660 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1179/2339] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:20.078290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7339319-e53a-4158-971b-9958a4770712 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:20.080512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a7339319-e53a-4158-971b-9958a4770712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:20.085073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438b6e4-b845-42a8-8028-99610606b1dd admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:20.096765 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d4910-3a90-47cd-82ec-576a0a605260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:20.097448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d4910-3a90-47cd-82ec-576a0a605260 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:20.097731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d4910-3a90-47cd-82ec-576a0a605260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:20.098008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d4910-3a90-47cd-82ec-576a0a605260 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:20.098708 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d4910-3a90-47cd-82ec-576a0a605260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:20.100804 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d4910-3a90-47cd-82ec-576a0a605260 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:20.134863 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1161/2340] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:19 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:20.135779 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d4910-3a90-47cd-82ec-576a0a605260 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:20.150962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d4910-3a90-47cd-82ec-576a0a605260 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:20.152496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7339319-e53a-4158-971b-9958a4770712 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:20.155813 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1ab5f-eb29-46cc-922f-ae65274035dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:20.156484 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1ab5f-eb29-46cc-922f-ae65274035dc admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:20.157370 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1ab5f-eb29-46cc-922f-ae65274035dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:20.157710 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1ab5f-eb29-46cc-922f-ae65274035dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:20.158863 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1ab5f-eb29-46cc-922f-ae65274035dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:20.160497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1ab5f-eb29-46cc-922f-ae65274035dc admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:20.177407 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1162/2341] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:20.182016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1ab5f-eb29-46cc-922f-ae65274035dc admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:20.197737 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1ab5f-eb29-46cc-922f-ae65274035dc admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:20.204676 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66251d2-e6a4-4c85-a9ae-5b83482a4431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:20.205479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66251d2-e6a4-4c85-a9ae-5b83482a4431 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:20.206324 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66251d2-e6a4-4c85-a9ae-5b83482a4431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:20.206604 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66251d2-e6a4-4c85-a9ae-5b83482a4431 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:20.207604 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66251d2-e6a4-4c85-a9ae-5b83482a4431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:20.209430 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66251d2-e6a4-4c85-a9ae-5b83482a4431 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:20.211596 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78636f-620e-4453-9ac3-c6c40af5ff74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:20.212555 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78636f-620e-4453-9ac3-c6c40af5ff74 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:20.212713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78636f-620e-4453-9ac3-c6c40af5ff74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:20.213298 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78636f-620e-4453-9ac3-c6c40af5ff74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:20.223098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1163/2342] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:20.226228 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78636f-620e-4453-9ac3-c6c40af5ff74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:20.228012 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78636f-620e-4453-9ac3-c6c40af5ff74 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:20.229336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66251d2-e6a4-4c85-a9ae-5b83482a4431 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:20.240045 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66251d2-e6a4-4c85-a9ae-5b83482a4431 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:20.248966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1180/2343] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:20.256346 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee6f7e-a501-46c0-8aea-dc6e96cd4313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:20.257259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee6f7e-a501-46c0-8aea-dc6e96cd4313 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:20.257716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee6f7e-a501-46c0-8aea-dc6e96cd4313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:20.259217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee6f7e-a501-46c0-8aea-dc6e96cd4313 admin admin] PATH_INFO: `/v3/projects/27cf0fe8ac554bbe8077f6c5b399dd4b/users/956d7513c5f04c5ca77fd8900df22349/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:20.277429 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee6f7e-a501-46c0-8aea-dc6e96cd4313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27cf0fe8ac554bbe8077f6c5b399dd4b, user_id=956d7513c5f04c5ca77fd8900df22349, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:20.280479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee6f7e-a501-46c0-8aea-dc6e96cd4313 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:20.308845 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1164/2344] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:20 2022] PUT /identity/v3/projects/27cf0fe8ac554bbe8077f6c5b399dd4b/users/956d7513c5f04c5ca77fd8900df22349/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:20.311246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb410d-8041-4c4c-8728-0cd3c9c31ea9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:20.311704 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb410d-8041-4c4c-8728-0cd3c9c31ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:20.312224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb410d-8041-4c4c-8728-0cd3c9c31ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:20.359642 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-74cb410d-8041-4c4c-8728-0cd3c9c31ea9 None None] MFA Rules not processed for user `956d7513c5f04c5ca77fd8900df22349`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:20.361655 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-74cb410d-8041-4c4c-8728-0cd3c9c31ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:20.425262 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:20.505062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1181/2345] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:20.509218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee6f7e-a501-46c0-8aea-dc6e96cd4313 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:20.604455 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee6f7e-a501-46c0-8aea-dc6e96cd4313 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:20.611569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a55c78-e23d-4aa7-9875-602189317fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:20.612439 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a55c78-e23d-4aa7-9875-602189317fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:20.612789 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a55c78-e23d-4aa7-9875-602189317fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:20.613074 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a55c78-e23d-4aa7-9875-602189317fc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:20.613790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a55c78-e23d-4aa7-9875-602189317fc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:20.616887 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a55c78-e23d-4aa7-9875-602189317fc8 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:20.660205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1165/2346] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:20 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:20.664087 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb410d-8041-4c4c-8728-0cd3c9c31ea9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:20.681922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb410d-8041-4c4c-8728-0cd3c9c31ea9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:20.767299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db9ff5-4fc8-4f06-9929-c878433ab380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:20.768471 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db9ff5-4fc8-4f06-9929-c878433ab380 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:20.768900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db9ff5-4fc8-4f06-9929-c878433ab380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:20.769316 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db9ff5-4fc8-4f06-9929-c878433ab380 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:20.770178 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db9ff5-4fc8-4f06-9929-c878433ab380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:20.772317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db9ff5-4fc8-4f06-9929-c878433ab380 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:20.801095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1182/2347] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:20 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:33:20.804912 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a55c78-e23d-4aa7-9875-602189317fc8 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:20.821154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a55c78-e23d-4aa7-9875-602189317fc8 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:20.829500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c607abd-330a-4e30-a60b-9d7bf190d57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:20.830537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c607abd-330a-4e30-a60b-9d7bf190d57d admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:20.831149 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c607abd-330a-4e30-a60b-9d7bf190d57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:20.831430 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c607abd-330a-4e30-a60b-9d7bf190d57d admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:20.832492 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c607abd-330a-4e30-a60b-9d7bf190d57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:20.836348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c607abd-330a-4e30-a60b-9d7bf190d57d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:20.857688 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1166/2348] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:33:20.858625 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db9ff5-4fc8-4f06-9929-c878433ab380 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:20.876154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c607abd-330a-4e30-a60b-9d7bf190d57d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:20.880844 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db9ff5-4fc8-4f06-9929-c878433ab380 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:20.882139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4c607abd-330a-4e30-a60b-9d7bf190d57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:20.890938 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd76954-00ac-4d8a-8bc2-63a7620be4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:20.892223 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd76954-00ac-4d8a-8bc2-63a7620be4fc admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:20.892794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd76954-00ac-4d8a-8bc2-63a7620be4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:20.893498 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd76954-00ac-4d8a-8bc2-63a7620be4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:20.894486 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd76954-00ac-4d8a-8bc2-63a7620be4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:20.896688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd76954-00ac-4d8a-8bc2-63a7620be4fc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:20.909914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c607abd-330a-4e30-a60b-9d7bf190d57d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:20.920466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1183/2349] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:20.921675 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd76954-00ac-4d8a-8bc2-63a7620be4fc admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:20.937530 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd76954-00ac-4d8a-8bc2-63a7620be4fc admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:20.939674 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f4743-e1f9-436e-95a8-1fc21bcd4308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:20.941200 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f4743-e1f9-436e-95a8-1fc21bcd4308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:20.943195 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f4743-e1f9-436e-95a8-1fc21bcd4308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:20.943681 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f4743-e1f9-436e-95a8-1fc21bcd4308 admin admin] PATH_INFO: `/v3/projects/99394ac4128b4a36a98e0865e0a28256` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:20.945826 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f4743-e1f9-436e-95a8-1fc21bcd4308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99394ac4128b4a36a98e0865e0a28256)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:20.948538 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f5adf-c3dc-4413-bb17-5a2094cc5e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:20.949577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f5adf-c3dc-4413-bb17-5a2094cc5e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:20.949928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f5adf-c3dc-4413-bb17-5a2094cc5e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:20.950282 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f5adf-c3dc-4413-bb17-5a2094cc5e7d admin admin] PATH_INFO: `/v3/projects/850fcbdc800944c881a4a6d16cd61704/users/ae1582d9dfb24258a39e17bb70a836f7/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:20.950713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f4743-e1f9-436e-95a8-1fc21bcd4308 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:20.955880 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:20.977916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f5adf-c3dc-4413-bb17-5a2094cc5e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=850fcbdc800944c881a4a6d16cd61704, user_id=ae1582d9dfb24258a39e17bb70a836f7, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:20.980664 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f5adf-c3dc-4413-bb17-5a2094cc5e7d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:21.009692 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1184/2350] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:20 2022] PUT /identity/v3/projects/850fcbdc800944c881a4a6d16cd61704/users/ae1582d9dfb24258a39e17bb70a836f7/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:21.011703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd17f4-6e2a-46a1-b37a-62cacbd82f03 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:21.012093 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd17f4-6e2a-46a1-b37a-62cacbd82f03 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:21.012469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd17f4-6e2a-46a1-b37a-62cacbd82f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:21.029049 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-994f4743-e1f9-436e-95a8-1fc21bcd4308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99394ac4128b4a36a98e0865e0a28256', 'request_id': 'req-994f4743-e1f9-436e-95a8-1fc21bcd4308'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:21.041709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-994f4743-e1f9-436e-95a8-1fc21bcd4308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99394ac4128b4a36a98e0865e0a28256', 'request_id': 'req-994f4743-e1f9-436e-95a8-1fc21bcd4308'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:21.052234 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-994f4743-e1f9-436e-95a8-1fc21bcd4308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99394ac4128b4a36a98e0865e0a28256', 'request_id': 'req-994f4743-e1f9-436e-95a8-1fc21bcd4308'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:21.066190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-16dd17f4-6e2a-46a1-b37a-62cacbd82f03 None None] MFA Rules not processed for user `ae1582d9dfb24258a39e17bb70a836f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:21.067484 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-16dd17f4-6e2a-46a1-b37a-62cacbd82f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:21.073533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-994f4743-e1f9-436e-95a8-1fc21bcd4308 admin admin] The token cache is being invalidate because project 99394ac4128b4a36a98e0865e0a28256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:21.073935 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-994f4743-e1f9-436e-95a8-1fc21bcd4308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:21.074699 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-994f4743-e1f9-436e-95a8-1fc21bcd4308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:21.080235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1167/2351] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:20 2022] DELETE /identity/v3/projects/99394ac4128b4a36a98e0865e0a28256 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:21.084713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f4743-e1f9-436e-95a8-1fc21bcd4308 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:21.088001 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-994f4743-e1f9-436e-95a8-1fc21bcd4308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:21.186838 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1185/2352] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:21.190329 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd17f4-6e2a-46a1-b37a-62cacbd82f03 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:21.191844 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-16dd17f4-6e2a-46a1-b37a-62cacbd82f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:21.212767 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f4743-e1f9-436e-95a8-1fc21bcd4308 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:21.221322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f620535-e58c-424f-b128-39d5e39b8916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:21.222671 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f620535-e58c-424f-b128-39d5e39b8916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:21.223131 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f620535-e58c-424f-b128-39d5e39b8916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:21.223564 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f620535-e58c-424f-b128-39d5e39b8916 admin admin] PATH_INFO: `/v3/users/b8ed161d88494f8297550b5ce4a831e5` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:21.225273 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f620535-e58c-424f-b128-39d5e39b8916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ed161d88494f8297550b5ce4a831e5)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:21.226008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:21.228110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f620535-e58c-424f-b128-39d5e39b8916 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:21.314180 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd17f4-6e2a-46a1-b37a-62cacbd82f03 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:21.319352 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2bd3d-72db-43ab-a90d-bf021a3d8f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:21.320116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2bd3d-72db-43ab-a90d-bf021a3d8f57 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:21.320420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2bd3d-72db-43ab-a90d-bf021a3d8f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:21.320689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2bd3d-72db-43ab-a90d-bf021a3d8f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:21.321388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2bd3d-72db-43ab-a90d-bf021a3d8f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:21.323380 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2bd3d-72db-43ab-a90d-bf021a3d8f57 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:21.326655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4f620535-e58c-424f-b128-39d5e39b8916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ed161d88494f8297550b5ce4a831e5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:21.335986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4f620535-e58c-424f-b128-39d5e39b8916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ed161d88494f8297550b5ce4a831e5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:21.362162 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4f620535-e58c-424f-b128-39d5e39b8916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ed161d88494f8297550b5ce4a831e5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:21.366513 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1186/2353] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:21 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:33:21.367703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2bd3d-72db-43ab-a90d-bf021a3d8f57 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:21.378522 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4f620535-e58c-424f-b128-39d5e39b8916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ed161d88494f8297550b5ce4a831e5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:21.379495 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4f620535-e58c-424f-b128-39d5e39b8916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ed161d88494f8297550b5ce4a831e5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:21.390138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1168/2354] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:33:21 2022] DELETE /identity/v3/users/b8ed161d88494f8297550b5ce4a831e5 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:21.453007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2bd3d-72db-43ab-a90d-bf021a3d8f57 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:21.558403 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0ff90-88b6-482f-b04b-465f4b88fd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:21.559536 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0ff90-88b6-482f-b04b-465f4b88fd5c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:21.560004 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0ff90-88b6-482f-b04b-465f4b88fd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:21.560436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0ff90-88b6-482f-b04b-465f4b88fd5c admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:21.561330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0ff90-88b6-482f-b04b-465f4b88fd5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:21.564526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0ff90-88b6-482f-b04b-465f4b88fd5c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:21.593058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1187/2355] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:21 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:21.597914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f620535-e58c-424f-b128-39d5e39b8916 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:21.600192 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4f620535-e58c-424f-b128-39d5e39b8916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:21.618748 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f620535-e58c-424f-b128-39d5e39b8916 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:21.626768 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b2a9b-7326-4d85-b536-d0c8a67442b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:21.627258 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b2a9b-7326-4d85-b536-d0c8a67442b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:21.627556 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b2a9b-7326-4d85-b536-d0c8a67442b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:21.627948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b2a9b-7326-4d85-b536-d0c8a67442b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:21.629103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b2a9b-7326-4d85-b536-d0c8a67442b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:21.633979 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b2a9b-7326-4d85-b536-d0c8a67442b9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:21.644691 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:21.661878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0ff90-88b6-482f-b04b-465f4b88fd5c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:21.662837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1169/2356] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:21.678637 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0ff90-88b6-482f-b04b-465f4b88fd5c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:21.692890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c62ea5-f887-4b0a-97bf-f507982aa728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:21.694265 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c62ea5-f887-4b0a-97bf-f507982aa728 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:21.694754 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c62ea5-f887-4b0a-97bf-f507982aa728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:21.695193 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c62ea5-f887-4b0a-97bf-f507982aa728 admin admin] PATH_INFO: `/v3/projects/4bfc6f58207d46238e43c3bbf7587c40/users/25495cf28c81478cb4a599907708bcca/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:21.729814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c62ea5-f887-4b0a-97bf-f507982aa728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bfc6f58207d46238e43c3bbf7587c40, user_id=25495cf28c81478cb4a599907708bcca, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:21.734305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c62ea5-f887-4b0a-97bf-f507982aa728 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:21.767939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1188/2357] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:21 2022] PUT /identity/v3/projects/4bfc6f58207d46238e43c3bbf7587c40/users/25495cf28c81478cb4a599907708bcca/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:33:21.772340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b2a9b-7326-4d85-b536-d0c8a67442b9 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:21.785629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b2a9b-7326-4d85-b536-d0c8a67442b9 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:21.834502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c62ea5-f887-4b0a-97bf-f507982aa728 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:21.836425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a2c62ea5-f887-4b0a-97bf-f507982aa728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:21.853161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:21.935060 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed3985-781d-4bfa-9d85-1c10c3263db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:21.935760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed3985-781d-4bfa-9d85-1c10c3263db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:21.936031 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed3985-781d-4bfa-9d85-1c10c3263db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:21.936481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed3985-781d-4bfa-9d85-1c10c3263db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:21.939400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed3985-781d-4bfa-9d85-1c10c3263db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:21.941468 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed3985-781d-4bfa-9d85-1c10c3263db0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:21.945733 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c62ea5-f887-4b0a-97bf-f507982aa728 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:21.955676 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cbe26-4963-40fd-91b1-ca8ff587772f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:21.956999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cbe26-4963-40fd-91b1-ca8ff587772f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:21.957420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cbe26-4963-40fd-91b1-ca8ff587772f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:21.957883 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cbe26-4963-40fd-91b1-ca8ff587772f admin admin] PATH_INFO: `/v3/projects/169936a7f9b243a2bbbf8d23283dbd9c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:21.959401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1170/2358] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:21.960203 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cbe26-4963-40fd-91b1-ca8ff587772f admin admin] RBAC: Authorizing `identity:delete_project(project_id=169936a7f9b243a2bbbf8d23283dbd9c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:21.963434 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed3985-781d-4bfa-9d85-1c10c3263db0 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:21.963824 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cbe26-4963-40fd-91b1-ca8ff587772f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:21.975553 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed3985-781d-4bfa-9d85-1c10c3263db0 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:21.980925 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f4031-254e-45b4-bc29-98f8d0354e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:21.982013 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f4031-254e-45b4-bc29-98f8d0354e57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:21.982301 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f4031-254e-45b4-bc29-98f8d0354e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:21.982581 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f4031-254e-45b4-bc29-98f8d0354e57 admin admin] PATH_INFO: `/v3/projects/4bfc6f58207d46238e43c3bbf7587c40/users/25495cf28c81478cb4a599907708bcca/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:21.984646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f4031-254e-45b4-bc29-98f8d0354e57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bfc6f58207d46238e43c3bbf7587c40, user_id=25495cf28c81478cb4a599907708bcca, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:21.989631 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f4031-254e-45b4-bc29-98f8d0354e57 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:22.004019 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1171/2359] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:21 2022] PUT /identity/v3/projects/4bfc6f58207d46238e43c3bbf7587c40/users/25495cf28c81478cb4a599907708bcca/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:33:22.014931 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf57b8-eae8-4202-a19c-fdc8bee9b318 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:22.015885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf57b8-eae8-4202-a19c-fdc8bee9b318 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:22.016988 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf57b8-eae8-4202-a19c-fdc8bee9b318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:22.046644 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-af3cbe26-4963-40fd-91b1-ca8ff587772f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '169936a7f9b243a2bbbf8d23283dbd9c', 'request_id': 'req-af3cbe26-4963-40fd-91b1-ca8ff587772f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:22.059825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-af3cbe26-4963-40fd-91b1-ca8ff587772f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '169936a7f9b243a2bbbf8d23283dbd9c', 'request_id': 'req-af3cbe26-4963-40fd-91b1-ca8ff587772f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:22.077579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4ecf57b8-eae8-4202-a19c-fdc8bee9b318 None None] MFA Rules not processed for user `25495cf28c81478cb4a599907708bcca`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:22.078200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-af3cbe26-4963-40fd-91b1-ca8ff587772f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '169936a7f9b243a2bbbf8d23283dbd9c', 'request_id': 'req-af3cbe26-4963-40fd-91b1-ca8ff587772f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:22.081432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4ecf57b8-eae8-4202-a19c-fdc8bee9b318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:22.096168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-af3cbe26-4963-40fd-91b1-ca8ff587772f admin admin] The token cache is being invalidate because project 169936a7f9b243a2bbbf8d23283dbd9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:22.096729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-af3cbe26-4963-40fd-91b1-ca8ff587772f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:22.097595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-af3cbe26-4963-40fd-91b1-ca8ff587772f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:22.102875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1189/2360] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:21 2022] DELETE /identity/v3/projects/169936a7f9b243a2bbbf8d23283dbd9c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:22.109236 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ab1ed-7192-4185-90ed-a87f00b901a9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:22.109532 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ab1ed-7192-4185-90ed-a87f00b901a9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:22.110474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ab1ed-7192-4185-90ed-a87f00b901a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:22.151449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-874ab1ed-7192-4185-90ed-a87f00b901a9 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:22.152909 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-874ab1ed-7192-4185-90ed-a87f00b901a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:22.177913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1172/2361] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:22.190939 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf57b8-eae8-4202-a19c-fdc8bee9b318 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:22.193042 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4ecf57b8-eae8-4202-a19c-fdc8bee9b318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:22.314222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1190/2362] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:22.318150 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1b0c8-d8a6-4b75-8e9e-30c52a47e8ca None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:22.318420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1b0c8-d8a6-4b75-8e9e-30c52a47e8ca None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:22.318699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1b0c8-d8a6-4b75-8e9e-30c52a47e8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:22.354610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf57b8-eae8-4202-a19c-fdc8bee9b318 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:22.366785 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f807a8-1fb6-438f-955b-63fbd924b21a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:22.367721 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f807a8-1fb6-438f-955b-63fbd924b21a service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:22.368103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f807a8-1fb6-438f-955b-63fbd924b21a service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:22.369493 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f807a8-1fb6-438f-955b-63fbd924b21a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:22.371321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f7c1b0c8-d8a6-4b75-8e9e-30c52a47e8ca None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:22.372120 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-87f807a8-1fb6-438f-955b-63fbd924b21a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:22.374815 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f7c1b0c8-d8a6-4b75-8e9e-30c52a47e8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:22.405786 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1191/2363] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:22.411818 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1b0c8-d8a6-4b75-8e9e-30c52a47e8ca None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:22.426184 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:22.433327 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1b0c8-d8a6-4b75-8e9e-30c52a47e8ca None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:22.443752 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd0723-fb37-43cd-ac27-90c2f72b175f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:22.444436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0723-fb37-43cd-ac27-90c2f72b175f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:22.444710 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0723-fb37-43cd-ac27-90c2f72b175f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:22.444984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0723-fb37-43cd-ac27-90c2f72b175f admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:22.445713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd0723-fb37-43cd-ac27-90c2f72b175f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:33:22.446016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd0723-fb37-43cd-ac27-90c2f72b175f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:22.447651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd0723-fb37-43cd-ac27-90c2f72b175f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:22.464293 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1192/2364] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:33:22.472406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd0723-fb37-43cd-ac27-90c2f72b175f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:22.489711 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd0723-fb37-43cd-ac27-90c2f72b175f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:22.502431 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5bebf-8dc3-449d-aa62-dafbab9cb444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:22.503132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5bebf-8dc3-449d-aa62-dafbab9cb444 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:22.503411 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5bebf-8dc3-449d-aa62-dafbab9cb444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:22.503683 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5bebf-8dc3-449d-aa62-dafbab9cb444 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:22.504468 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5bebf-8dc3-449d-aa62-dafbab9cb444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:22.506483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5bebf-8dc3-449d-aa62-dafbab9cb444 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:22.509080 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f807a8-1fb6-438f-955b-63fbd924b21a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:22.511437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f807a8-1fb6-438f-955b-63fbd924b21a service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:22.540070 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1193/2365] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:22 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:22.543466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1173/2366] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:22.543937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5bebf-8dc3-449d-aa62-dafbab9cb444 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:22.563994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:22.682660 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5bebf-8dc3-449d-aa62-dafbab9cb444 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:22.713278 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80a05e-b6fc-49fb-b7ac-b761392a6923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:22.713983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80a05e-b6fc-49fb-b7ac-b761392a6923 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:22.714288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80a05e-b6fc-49fb-b7ac-b761392a6923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:22.714544 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80a05e-b6fc-49fb-b7ac-b761392a6923 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:22.715315 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80a05e-b6fc-49fb-b7ac-b761392a6923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:22.717631 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80a05e-b6fc-49fb-b7ac-b761392a6923 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:22.757919 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1194/2367] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:22 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:22.760546 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f807a8-1fb6-438f-955b-63fbd924b21a service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:22.779428 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f807a8-1fb6-438f-955b-63fbd924b21a service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:22.798136 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8affc4-98c8-44c2-aee6-ebac9018e600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:22.800076 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8affc4-98c8-44c2-aee6-ebac9018e600 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:22.800076 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8affc4-98c8-44c2-aee6-ebac9018e600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:22.800076 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8affc4-98c8-44c2-aee6-ebac9018e600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:22.800851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8affc4-98c8-44c2-aee6-ebac9018e600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:22.802958 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8affc4-98c8-44c2-aee6-ebac9018e600 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:22.816788 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1174/2368] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:22.821913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80a05e-b6fc-49fb-b7ac-b761392a6923 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:22.836058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80a05e-b6fc-49fb-b7ac-b761392a6923 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:22.843127 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64792ef1-28e7-4806-bbf6-ba939e18bc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:22.844453 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64792ef1-28e7-4806-bbf6-ba939e18bc16 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:22.844749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64792ef1-28e7-4806-bbf6-ba939e18bc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:22.845137 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64792ef1-28e7-4806-bbf6-ba939e18bc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:22.846184 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64792ef1-28e7-4806-bbf6-ba939e18bc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:22.848350 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64792ef1-28e7-4806-bbf6-ba939e18bc16 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:22.871562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8affc4-98c8-44c2-aee6-ebac9018e600 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:22.879942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1195/2369] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:22.885975 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8affc4-98c8-44c2-aee6-ebac9018e600 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:22.896013 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07175dd-6e93-4e50-b97f-38797bba5bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:22.898020 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07175dd-6e93-4e50-b97f-38797bba5bce admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:22.898366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07175dd-6e93-4e50-b97f-38797bba5bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:22.898652 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07175dd-6e93-4e50-b97f-38797bba5bce admin admin] PATH_INFO: `/v3/projects/473e8ce5e0ef4b7fa9bda947a5a275a8/users/aaddb5045cd2474bb781c8b0bd0d93a9/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:22.928858 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07175dd-6e93-4e50-b97f-38797bba5bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=473e8ce5e0ef4b7fa9bda947a5a275a8, user_id=aaddb5045cd2474bb781c8b0bd0d93a9, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:22.932091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07175dd-6e93-4e50-b97f-38797bba5bce admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:22.966143 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1175/2370] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:22 2022] PUT /identity/v3/projects/473e8ce5e0ef4b7fa9bda947a5a275a8/users/aaddb5045cd2474bb781c8b0bd0d93a9/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:22.979510 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e41f73-c5a7-4681-b32b-b891ef085d07 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:22.980618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e41f73-c5a7-4681-b32b-b891ef085d07 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:22.981178 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e41f73-c5a7-4681-b32b-b891ef085d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:23.036802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b5e41f73-c5a7-4681-b32b-b891ef085d07 None None] MFA Rules not processed for user `aaddb5045cd2474bb781c8b0bd0d93a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:23.038163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b5e41f73-c5a7-4681-b32b-b891ef085d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:23.162504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1196/2371] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:23.167657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07175dd-6e93-4e50-b97f-38797bba5bce admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:23.323686 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07175dd-6e93-4e50-b97f-38797bba5bce admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:23.331988 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf44bad-eceb-4315-91d6-12467b3840d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:23.332685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf44bad-eceb-4315-91d6-12467b3840d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:23.332969 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf44bad-eceb-4315-91d6-12467b3840d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:23.334516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf44bad-eceb-4315-91d6-12467b3840d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:23.334516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf44bad-eceb-4315-91d6-12467b3840d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:23.335980 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf44bad-eceb-4315-91d6-12467b3840d2 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:23.419564 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1176/2372] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:23 2022] POST /identity/v3/projects => generated 387 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:23.421439 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e41f73-c5a7-4681-b32b-b891ef085d07 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:23.433869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e41f73-c5a7-4681-b32b-b891ef085d07 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:23.568758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d17831-18fc-4f61-a407-fd2dc7fa5f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:23.569217 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d17831-18fc-4f61-a407-fd2dc7fa5f95 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:23.569506 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d17831-18fc-4f61-a407-fd2dc7fa5f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:23.574066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d17831-18fc-4f61-a407-fd2dc7fa5f95 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:23.574066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d17831-18fc-4f61-a407-fd2dc7fa5f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:23.575750 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d17831-18fc-4f61-a407-fd2dc7fa5f95 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:23.602005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:23.620120 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1197/2373] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:23 2022] POST /identity/v3/users => generated 300 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:23.623755 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf44bad-eceb-4315-91d6-12467b3840d2 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:23.640168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf44bad-eceb-4315-91d6-12467b3840d2 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:23.646936 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4037616-6a99-4d7a-91a9-316454f5d4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:23.647631 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4037616-6a99-4d7a-91a9-316454f5d4cf admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:23.648052 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4037616-6a99-4d7a-91a9-316454f5d4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:23.648335 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4037616-6a99-4d7a-91a9-316454f5d4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:23.649070 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4037616-6a99-4d7a-91a9-316454f5d4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:23.651153 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4037616-6a99-4d7a-91a9-316454f5d4cf admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:23.672849 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1177/2374] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:33:23.676975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d17831-18fc-4f61-a407-fd2dc7fa5f95 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:23.693905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d17831-18fc-4f61-a407-fd2dc7fa5f95 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:23.705311 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74f406-2f34-4af0-b125-847b602c6b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:23.706267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74f406-2f34-4af0-b125-847b602c6b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:23.706548 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74f406-2f34-4af0-b125-847b602c6b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:23.706873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74f406-2f34-4af0-b125-847b602c6b9b admin admin] PATH_INFO: `/v3/projects/100c462c4ffc4534875411dc40e8ea9a/users/aa0e38017eca4a989c3ff336360b4cbc/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:23.735471 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74f406-2f34-4af0-b125-847b602c6b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=100c462c4ffc4534875411dc40e8ea9a, user_id=aa0e38017eca4a989c3ff336360b4cbc, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:23.738549 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74f406-2f34-4af0-b125-847b602c6b9b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:23.775557 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1198/2375] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:23 2022] PUT /identity/v3/projects/100c462c4ffc4534875411dc40e8ea9a/users/aa0e38017eca4a989c3ff336360b4cbc/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:33:23.779597 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4037616-6a99-4d7a-91a9-316454f5d4cf admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:23.800046 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4037616-6a99-4d7a-91a9-316454f5d4cf admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:23.961250 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e503163-64c2-413b-a915-cf89869fde0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:23.964003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e503163-64c2-413b-a915-cf89869fde0d admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:23.964449 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e503163-64c2-413b-a915-cf89869fde0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:23.964868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e503163-64c2-413b-a915-cf89869fde0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:23.967301 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e503163-64c2-413b-a915-cf89869fde0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:23.970441 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e503163-64c2-413b-a915-cf89869fde0d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:23.977954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:24.023776 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1178/2376] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:24.027962 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74f406-2f34-4af0-b125-847b602c6b9b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:24.051285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74f406-2f34-4af0-b125-847b602c6b9b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:24.079995 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be8f46-e292-470c-8777-36a4c4d66de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:24.081000 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be8f46-e292-470c-8777-36a4c4d66de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:24.081279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be8f46-e292-470c-8777-36a4c4d66de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:24.081550 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be8f46-e292-470c-8777-36a4c4d66de7 admin admin] PATH_INFO: `/v3/projects/100c462c4ffc4534875411dc40e8ea9a/users/aa0e38017eca4a989c3ff336360b4cbc/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:24.089097 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be8f46-e292-470c-8777-36a4c4d66de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100c462c4ffc4534875411dc40e8ea9a, user_id=aa0e38017eca4a989c3ff336360b4cbc, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:24.094673 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be8f46-e292-470c-8777-36a4c4d66de7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:24.116018 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1199/2377] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:24 2022] PUT /identity/v3/projects/100c462c4ffc4534875411dc40e8ea9a/users/aa0e38017eca4a989c3ff336360b4cbc/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:24.126395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d650f-d4b2-4e54-9a17-cb1b3c313031 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:24.126898 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d650f-d4b2-4e54-9a17-cb1b3c313031 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:24.127339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d650f-d4b2-4e54-9a17-cb1b3c313031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:24.162715 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e63d650f-d4b2-4e54-9a17-cb1b3c313031 None None] MFA Rules not processed for user `aa0e38017eca4a989c3ff336360b4cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:24.164103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e63d650f-d4b2-4e54-9a17-cb1b3c313031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:24.279728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1179/2378] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:24.307199 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be8f46-e292-470c-8777-36a4c4d66de7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:24.311869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-13be8f46-e292-470c-8777-36a4c4d66de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:24.443219 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be8f46-e292-470c-8777-36a4c4d66de7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:24.453159 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd933c2d-9f28-4ed0-ba86-ab2020393331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:24.455093 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd933c2d-9f28-4ed0-ba86-ab2020393331 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:24.455874 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd933c2d-9f28-4ed0-ba86-ab2020393331 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:24.456300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd933c2d-9f28-4ed0-ba86-ab2020393331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:24.476753 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd933c2d-9f28-4ed0-ba86-ab2020393331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:24.478390 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd933c2d-9f28-4ed0-ba86-ab2020393331 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:24.499599 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1200/2379] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:24.533216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d650f-d4b2-4e54-9a17-cb1b3c313031 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:24.546778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd933c2d-9f28-4ed0-ba86-ab2020393331 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:24.551327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d650f-d4b2-4e54-9a17-cb1b3c313031 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:24.564725 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dc604-0f28-4ecd-9b36-815e2cfe7f29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:24.565796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dc604-0f28-4ecd-9b36-815e2cfe7f29 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:24.566178 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dc604-0f28-4ecd-9b36-815e2cfe7f29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:24.566497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dc604-0f28-4ecd-9b36-815e2cfe7f29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:24.571736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7d8dc604-0f28-4ecd-9b36-815e2cfe7f29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:24.738171 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd933c2d-9f28-4ed0-ba86-ab2020393331 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:24.745214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d4ff8-9e5d-4347-bb29-ff23690f9324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:24.746315 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d4ff8-9e5d-4347-bb29-ff23690f9324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:24.746598 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d4ff8-9e5d-4347-bb29-ff23690f9324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:24.746928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d4ff8-9e5d-4347-bb29-ff23690f9324 admin admin] PATH_INFO: `/v3/users/aaddb5045cd2474bb781c8b0bd0d93a9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:24.749500 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d4ff8-9e5d-4347-bb29-ff23690f9324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaddb5045cd2474bb781c8b0bd0d93a9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:24.751671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d4ff8-9e5d-4347-bb29-ff23690f9324 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:24.780731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dc604-0f28-4ecd-9b36-815e2cfe7f29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:24.789928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dc604-0f28-4ecd-9b36-815e2cfe7f29 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:24.830833 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1180/2380] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:33:24.846593 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a72d4ff8-9e5d-4347-bb29-ff23690f9324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaddb5045cd2474bb781c8b0bd0d93a9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:24.876949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a72d4ff8-9e5d-4347-bb29-ff23690f9324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaddb5045cd2474bb781c8b0bd0d93a9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:24.906035 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:24.918838 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a72d4ff8-9e5d-4347-bb29-ff23690f9324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaddb5045cd2474bb781c8b0bd0d93a9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:24.933612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a72d4ff8-9e5d-4347-bb29-ff23690f9324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaddb5045cd2474bb781c8b0bd0d93a9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:24.936891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a72d4ff8-9e5d-4347-bb29-ff23690f9324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaddb5045cd2474bb781c8b0bd0d93a9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:24.949657 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1201/2381] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:33:24 2022] DELETE /identity/v3/users/aaddb5045cd2474bb781c8b0bd0d93a9 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:24.951418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7705f-6bbd-4397-aa17-2006503c8407 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:24.951712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7705f-6bbd-4397-aa17-2006503c8407 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:24.951992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7705f-6bbd-4397-aa17-2006503c8407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:24.977970 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4fc7705f-6bbd-4397-aa17-2006503c8407 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:24.979665 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4fc7705f-6bbd-4397-aa17-2006503c8407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:25.072197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1181/2382] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:25.083333 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d4ff8-9e5d-4347-bb29-ff23690f9324 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:25.084772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a72d4ff8-9e5d-4347-bb29-ff23690f9324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:25.172833 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d4ff8-9e5d-4347-bb29-ff23690f9324 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:25.176923 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21633d9-638f-4f7f-9c50-b5dca4bcbc51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:25.177722 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21633d9-638f-4f7f-9c50-b5dca4bcbc51 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:25.178434 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21633d9-638f-4f7f-9c50-b5dca4bcbc51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:25.178986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21633d9-638f-4f7f-9c50-b5dca4bcbc51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:25.190817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21633d9-638f-4f7f-9c50-b5dca4bcbc51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:25.192569 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21633d9-638f-4f7f-9c50-b5dca4bcbc51 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:25.212702 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1202/2383] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:25.595265 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7705f-6bbd-4397-aa17-2006503c8407 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:25.599582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4fc7705f-6bbd-4397-aa17-2006503c8407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:25.633952 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7705f-6bbd-4397-aa17-2006503c8407 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:25.644504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6faa0b-41b8-499d-830c-5c01feb127ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:25.645395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6faa0b-41b8-499d-830c-5c01feb127ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:25.645680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6faa0b-41b8-499d-830c-5c01feb127ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:25.645955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6faa0b-41b8-499d-830c-5c01feb127ce admin admin] PATH_INFO: `/v3/projects/473e8ce5e0ef4b7fa9bda947a5a275a8` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:25.647223 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6faa0b-41b8-499d-830c-5c01feb127ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=473e8ce5e0ef4b7fa9bda947a5a275a8)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:25.649461 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6faa0b-41b8-499d-830c-5c01feb127ce admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:25.685577 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:25.712389 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21633d9-638f-4f7f-9c50-b5dca4bcbc51 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:25.714119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c21633d9-638f-4f7f-9c50-b5dca4bcbc51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:25.733868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-cf6faa0b-41b8-499d-830c-5c01feb127ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473e8ce5e0ef4b7fa9bda947a5a275a8', 'request_id': 'req-cf6faa0b-41b8-499d-830c-5c01feb127ce'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:25.740375 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-cf6faa0b-41b8-499d-830c-5c01feb127ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473e8ce5e0ef4b7fa9bda947a5a275a8', 'request_id': 'req-cf6faa0b-41b8-499d-830c-5c01feb127ce'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:25.754775 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-cf6faa0b-41b8-499d-830c-5c01feb127ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473e8ce5e0ef4b7fa9bda947a5a275a8', 'request_id': 'req-cf6faa0b-41b8-499d-830c-5c01feb127ce'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:25.769185 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-cf6faa0b-41b8-499d-830c-5c01feb127ce admin admin] The token cache is being invalidate because project 473e8ce5e0ef4b7fa9bda947a5a275a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:25.769563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-cf6faa0b-41b8-499d-830c-5c01feb127ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:25.772570 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-cf6faa0b-41b8-499d-830c-5c01feb127ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:25.774688 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1182/2384] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:25 2022] DELETE /identity/v3/projects/473e8ce5e0ef4b7fa9bda947a5a275a8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:25.778774 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6faa0b-41b8-499d-830c-5c01feb127ce admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:25.780382 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cf6faa0b-41b8-499d-830c-5c01feb127ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:25.784860 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21633d9-638f-4f7f-9c50-b5dca4bcbc51 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:25.853260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53248404-2c24-465a-bad0-42a2237b296f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:25.854221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53248404-2c24-465a-bad0-42a2237b296f service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:25.854650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53248404-2c24-465a-bad0-42a2237b296f service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:25.855107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53248404-2c24-465a-bad0-42a2237b296f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:25.859409 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-53248404-2c24-465a-bad0-42a2237b296f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:25.869187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6faa0b-41b8-499d-830c-5c01feb127ce admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:25.874485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6efa3c-2cb7-4b3f-8f69-0f62159e6f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:25.875505 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6efa3c-2cb7-4b3f-8f69-0f62159e6f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:25.875862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6efa3c-2cb7-4b3f-8f69-0f62159e6f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:25.876204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6efa3c-2cb7-4b3f-8f69-0f62159e6f04 admin admin] PATH_INFO: `/v3/users/aa0e38017eca4a989c3ff336360b4cbc` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:25.877519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6efa3c-2cb7-4b3f-8f69-0f62159e6f04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa0e38017eca4a989c3ff336360b4cbc)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:25.879533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6efa3c-2cb7-4b3f-8f69-0f62159e6f04 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:25.949406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:25.959620 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53248404-2c24-465a-bad0-42a2237b296f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:25.962531 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53248404-2c24-465a-bad0-42a2237b296f service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:25.983337 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5c6efa3c-2cb7-4b3f-8f69-0f62159e6f04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa0e38017eca4a989c3ff336360b4cbc'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:25.986115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1203/2385] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:26.006322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5c6efa3c-2cb7-4b3f-8f69-0f62159e6f04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa0e38017eca4a989c3ff336360b4cbc'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:26.035875 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5c6efa3c-2cb7-4b3f-8f69-0f62159e6f04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa0e38017eca4a989c3ff336360b4cbc'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:26.050617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5c6efa3c-2cb7-4b3f-8f69-0f62159e6f04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa0e38017eca4a989c3ff336360b4cbc'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:26.051522 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5c6efa3c-2cb7-4b3f-8f69-0f62159e6f04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa0e38017eca4a989c3ff336360b4cbc'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:26.072625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1183/2386] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:33:25 2022] DELETE /identity/v3/users/aa0e38017eca4a989c3ff336360b4cbc => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:33:26.534633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53248404-2c24-465a-bad0-42a2237b296f service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:26.552224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53248404-2c24-465a-bad0-42a2237b296f service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:26.623179 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984bbda-5148-4560-a9bf-770d90f7f8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:26.624212 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984bbda-5148-4560-a9bf-770d90f7f8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:26.624596 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984bbda-5148-4560-a9bf-770d90f7f8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:26.624969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984bbda-5148-4560-a9bf-770d90f7f8d0 admin admin] PATH_INFO: `/v3/projects/100c462c4ffc4534875411dc40e8ea9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:26.626289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984bbda-5148-4560-a9bf-770d90f7f8d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=100c462c4ffc4534875411dc40e8ea9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:26.628370 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984bbda-5148-4560-a9bf-770d90f7f8d0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:26.691572 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e984bbda-5148-4560-a9bf-770d90f7f8d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100c462c4ffc4534875411dc40e8ea9a', 'request_id': 'req-e984bbda-5148-4560-a9bf-770d90f7f8d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:26.705331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e984bbda-5148-4560-a9bf-770d90f7f8d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100c462c4ffc4534875411dc40e8ea9a', 'request_id': 'req-e984bbda-5148-4560-a9bf-770d90f7f8d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:26.714307 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e984bbda-5148-4560-a9bf-770d90f7f8d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100c462c4ffc4534875411dc40e8ea9a', 'request_id': 'req-e984bbda-5148-4560-a9bf-770d90f7f8d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:26.730899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e984bbda-5148-4560-a9bf-770d90f7f8d0 admin admin] The token cache is being invalidate because project 100c462c4ffc4534875411dc40e8ea9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:26.731253 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e984bbda-5148-4560-a9bf-770d90f7f8d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:26.732027 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e984bbda-5148-4560-a9bf-770d90f7f8d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:26.733867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1204/2387] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:26 2022] DELETE /identity/v3/projects/100c462c4ffc4534875411dc40e8ea9a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:26.739318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b288-1b2f-42b8-9cf4-97d96e3828a3 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:26.739806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b288-1b2f-42b8-9cf4-97d96e3828a3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:26.739898 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b288-1b2f-42b8-9cf4-97d96e3828a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:26.761233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-89f2b288-1b2f-42b8-9cf4-97d96e3828a3 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:26.762172 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-89f2b288-1b2f-42b8-9cf4-97d96e3828a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:26.789266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:26.839504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1184/2388] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:26.848507 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49d7bb-afe9-4e12-b8df-1b91d853057b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:26.849033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49d7bb-afe9-4e12-b8df-1b91d853057b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:26.849033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49d7bb-afe9-4e12-b8df-1b91d853057b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:26.868717 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4b49d7bb-afe9-4e12-b8df-1b91d853057b None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:26.870092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4b49d7bb-afe9-4e12-b8df-1b91d853057b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:26.879674 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1205/2389] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:26.884164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2b288-1b2f-42b8-9cf4-97d96e3828a3 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:26.895229 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2b288-1b2f-42b8-9cf4-97d96e3828a3 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:26.902515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010dafb-5c40-4e4b-92ba-92fb50b90fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:26.903342 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010dafb-5c40-4e4b-92ba-92fb50b90fba admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:26.903722 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010dafb-5c40-4e4b-92ba-92fb50b90fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:26.904097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010dafb-5c40-4e4b-92ba-92fb50b90fba admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:26.904931 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010dafb-5c40-4e4b-92ba-92fb50b90fba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:33:26.905337 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010dafb-5c40-4e4b-92ba-92fb50b90fba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:26.907892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010dafb-5c40-4e4b-92ba-92fb50b90fba admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:26.921554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1185/2390] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:33:26.926093 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49d7bb-afe9-4e12-b8df-1b91d853057b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:26.936655 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49d7bb-afe9-4e12-b8df-1b91d853057b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:26.942343 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecad6ac-5f51-4b14-b86c-4b5fc234b24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:26.943048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecad6ac-5f51-4b14-b86c-4b5fc234b24c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:26.943334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecad6ac-5f51-4b14-b86c-4b5fc234b24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:26.943613 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecad6ac-5f51-4b14-b86c-4b5fc234b24c admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:26.944436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecad6ac-5f51-4b14-b86c-4b5fc234b24c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:26.946453 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecad6ac-5f51-4b14-b86c-4b5fc234b24c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:26.982851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1206/2391] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:26 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:33:26.985976 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010dafb-5c40-4e4b-92ba-92fb50b90fba admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:27.000081 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010dafb-5c40-4e4b-92ba-92fb50b90fba admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:27.125735 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b67c42-0016-4e04-9bf0-fb6313abeeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:27.126580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b67c42-0016-4e04-9bf0-fb6313abeeae admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:27.126910 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b67c42-0016-4e04-9bf0-fb6313abeeae admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:27.127164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b67c42-0016-4e04-9bf0-fb6313abeeae admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:27.127862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b67c42-0016-4e04-9bf0-fb6313abeeae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:27.130166 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b67c42-0016-4e04-9bf0-fb6313abeeae admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:27.198299 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1186/2392] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:26 2022] POST /identity/v3/users => generated 284 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:33:27.199033 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecad6ac-5f51-4b14-b86c-4b5fc234b24c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:27.214782 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecad6ac-5f51-4b14-b86c-4b5fc234b24c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:27.243937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bebe3f-662c-4d00-9261-dd459fcd3792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:27.245097 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bebe3f-662c-4d00-9261-dd459fcd3792 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:27.245097 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bebe3f-662c-4d00-9261-dd459fcd3792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:27.245291 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bebe3f-662c-4d00-9261-dd459fcd3792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:27.249459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bebe3f-662c-4d00-9261-dd459fcd3792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:27.257342 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bebe3f-662c-4d00-9261-dd459fcd3792 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:27.310915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1207/2393] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:33:27.315262 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b67c42-0016-4e04-9bf0-fb6313abeeae admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:27.327953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b67c42-0016-4e04-9bf0-fb6313abeeae admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:27.343886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc2386-3944-43ba-9f61-d02053448af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:27.344867 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc2386-3944-43ba-9f61-d02053448af7 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:27.345207 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc2386-3944-43ba-9f61-d02053448af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:27.345705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc2386-3944-43ba-9f61-d02053448af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:27.346465 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc2386-3944-43ba-9f61-d02053448af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:27.360590 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc2386-3944-43ba-9f61-d02053448af7 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:27.430578 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1187/2394] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:27.431651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bebe3f-662c-4d00-9261-dd459fcd3792 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:27.446122 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bebe3f-662c-4d00-9261-dd459fcd3792 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:27.461596 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce559b76-5472-41c9-b04a-abfe57487ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:27.462432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce559b76-5472-41c9-b04a-abfe57487ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:27.462814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce559b76-5472-41c9-b04a-abfe57487ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:27.463074 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce559b76-5472-41c9-b04a-abfe57487ff2 admin admin] PATH_INFO: `/v3/projects/b21a6a68bc674e8aad68703ba858cf3b/users/69fdbdb58f36451283d9720baf6681a1/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:27.508292 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce559b76-5472-41c9-b04a-abfe57487ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21a6a68bc674e8aad68703ba858cf3b, user_id=69fdbdb58f36451283d9720baf6681a1, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:27.520184 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce559b76-5472-41c9-b04a-abfe57487ff2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:27.586049 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388f4c2-b80f-4569-805b-3380e07f7fbd None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:27.586589 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388f4c2-b80f-4569-805b-3380e07f7fbd None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:27.588183 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388f4c2-b80f-4569-805b-3380e07f7fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:27.596214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1208/2395] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:27 2022] PUT /identity/v3/projects/b21a6a68bc674e8aad68703ba858cf3b/users/69fdbdb58f36451283d9720baf6681a1/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:27.650765 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8388f4c2-b80f-4569-805b-3380e07f7fbd None None] MFA Rules not processed for user `69fdbdb58f36451283d9720baf6681a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:27.650765 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8388f4c2-b80f-4569-805b-3380e07f7fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:27.871749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce559b76-5472-41c9-b04a-abfe57487ff2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:27.896066 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1188/2396] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:27.959641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:28.031318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce559b76-5472-41c9-b04a-abfe57487ff2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:28.051849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2760d2-1633-43b1-8c19-351ab0df3e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:28.054978 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2760d2-1633-43b1-8c19-351ab0df3e36 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:28.055604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2760d2-1633-43b1-8c19-351ab0df3e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:28.056037 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2760d2-1633-43b1-8c19-351ab0df3e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:28.056898 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2760d2-1633-43b1-8c19-351ab0df3e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:28.065801 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2760d2-1633-43b1-8c19-351ab0df3e36 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:28.127401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388f4c2-b80f-4569-805b-3380e07f7fbd None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:28.133413 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1209/2397] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:27 2022] POST /identity/v3/projects => generated 367 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:33:28.141485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388f4c2-b80f-4569-805b-3380e07f7fbd None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:28.189050 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:28.303519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafef3d-f0bf-4a7b-8c71-4d21ae1d9414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:28.304108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafef3d-f0bf-4a7b-8c71-4d21ae1d9414 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:28.304386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafef3d-f0bf-4a7b-8c71-4d21ae1d9414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:28.304663 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafef3d-f0bf-4a7b-8c71-4d21ae1d9414 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:28.305352 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acafef3d-f0bf-4a7b-8c71-4d21ae1d9414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:28.307831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acafef3d-f0bf-4a7b-8c71-4d21ae1d9414 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:28.350331 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1189/2398] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:28 2022] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:33:28.353963 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2760d2-1633-43b1-8c19-351ab0df3e36 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:28.370839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2760d2-1633-43b1-8c19-351ab0df3e36 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:28.376723 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bab81-d3d7-40d2-9761-5d1d7e0f0641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:28.377409 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bab81-d3d7-40d2-9761-5d1d7e0f0641 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:28.377788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bab81-d3d7-40d2-9761-5d1d7e0f0641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:28.378160 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bab81-d3d7-40d2-9761-5d1d7e0f0641 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:28.379038 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bab81-d3d7-40d2-9761-5d1d7e0f0641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:28.380806 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bab81-d3d7-40d2-9761-5d1d7e0f0641 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:28.395243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1210/2399] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:28.399373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafef3d-f0bf-4a7b-8c71-4d21ae1d9414 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:28.412702 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafef3d-f0bf-4a7b-8c71-4d21ae1d9414 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:28.418829 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5a77a-280e-48b1-909f-278136c6aa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:28.420107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5a77a-280e-48b1-909f-278136c6aa8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:28.420573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5a77a-280e-48b1-909f-278136c6aa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:28.420879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5a77a-280e-48b1-909f-278136c6aa8b admin admin] PATH_INFO: `/v3/projects/ca12f57ac3fe47b5accd9969b026f989/users/9d03d98078c542c088b73415682e9ff6/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:28.447078 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5a77a-280e-48b1-909f-278136c6aa8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca12f57ac3fe47b5accd9969b026f989, user_id=9d03d98078c542c088b73415682e9ff6, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:28.450936 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5a77a-280e-48b1-909f-278136c6aa8b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:28.477901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1190/2400] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:28 2022] PUT /identity/v3/projects/ca12f57ac3fe47b5accd9969b026f989/users/9d03d98078c542c088b73415682e9ff6/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:33:28.481997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bab81-d3d7-40d2-9761-5d1d7e0f0641 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:28.494930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bab81-d3d7-40d2-9761-5d1d7e0f0641 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:28.562128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a683a85-1b01-4d01-a897-6513c9803ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:28.563581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a683a85-1b01-4d01-a897-6513c9803ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:28.563943 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a683a85-1b01-4d01-a897-6513c9803ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:28.564288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a683a85-1b01-4d01-a897-6513c9803ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:28.565085 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a683a85-1b01-4d01-a897-6513c9803ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:28.566832 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a683a85-1b01-4d01-a897-6513c9803ef1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:28.582110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1211/2401] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:33:28.583287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5a77a-280e-48b1-909f-278136c6aa8b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:28.596634 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5a77a-280e-48b1-909f-278136c6aa8b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:28.602223 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cff426-ab86-46f9-bf2d-5d5b73b4b040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:28.603400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cff426-ab86-46f9-bf2d-5d5b73b4b040 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:28.603690 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cff426-ab86-46f9-bf2d-5d5b73b4b040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:28.603972 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cff426-ab86-46f9-bf2d-5d5b73b4b040 admin admin] PATH_INFO: `/v3/projects/ca12f57ac3fe47b5accd9969b026f989/users/9d03d98078c542c088b73415682e9ff6/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:28.606137 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cff426-ab86-46f9-bf2d-5d5b73b4b040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca12f57ac3fe47b5accd9969b026f989, user_id=9d03d98078c542c088b73415682e9ff6, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:28.608802 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cff426-ab86-46f9-bf2d-5d5b73b4b040 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:28.623606 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1191/2402] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:28 2022] PUT /identity/v3/projects/ca12f57ac3fe47b5accd9969b026f989/users/9d03d98078c542c088b73415682e9ff6/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:28.634683 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2104df3-a8c1-48c7-8f79-29064842eaea None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:28.635064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2104df3-a8c1-48c7-8f79-29064842eaea None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:28.635350 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2104df3-a8c1-48c7-8f79-29064842eaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:28.671938 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d2104df3-a8c1-48c7-8f79-29064842eaea None None] MFA Rules not processed for user `9d03d98078c542c088b73415682e9ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:28.673418 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d2104df3-a8c1-48c7-8f79-29064842eaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:28.754463 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1212/2403] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:28.769228 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cff426-ab86-46f9-bf2d-5d5b73b4b040 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:28.770999 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b7cff426-ab86-46f9-bf2d-5d5b73b4b040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:28.840118 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cff426-ab86-46f9-bf2d-5d5b73b4b040 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:28.844400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560307c-4779-4424-bf1c-180f6a206bb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:28.845824 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560307c-4779-4424-bf1c-180f6a206bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:28.846027 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560307c-4779-4424-bf1c-180f6a206bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:28.846349 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560307c-4779-4424-bf1c-180f6a206bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:28.864592 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560307c-4779-4424-bf1c-180f6a206bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:28.866363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560307c-4779-4424-bf1c-180f6a206bb4 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:28.867165 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c1d2e-f2d7-4e19-9719-1df234afa5f5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:28.867534 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c1d2e-f2d7-4e19-9719-1df234afa5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:28.868488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c1d2e-f2d7-4e19-9719-1df234afa5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:28.879015 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1192/2404] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:28 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:28.888151 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ea5c1d2e-f2d7-4e19-9719-1df234afa5f5 None None] MFA Rules not processed for user `074d31f2932545538ba05289aa4efd56`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:28.889774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ea5c1d2e-f2d7-4e19-9719-1df234afa5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:28.900490 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:28.965574 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1213/2405] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:33:28.972553 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560307c-4779-4424-bf1c-180f6a206bb4 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:28.973999 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c560307c-4779-4424-bf1c-180f6a206bb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:28.988081 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560307c-4779-4424-bf1c-180f6a206bb4 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:28.993034 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd623f-3d8e-424d-96cc-5040c074f86a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:28.993691 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd623f-3d8e-424d-96cc-5040c074f86a service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:28.993978 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd623f-3d8e-424d-96cc-5040c074f86a service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:28.994257 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd623f-3d8e-424d-96cc-5040c074f86a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:29.073635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd623f-3d8e-424d-96cc-5040c074f86a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:29.075613 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd623f-3d8e-424d-96cc-5040c074f86a service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:29.102752 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1193/2406] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:30.558515 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c1d2e-f2d7-4e19-9719-1df234afa5f5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:30.560104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ea5c1d2e-f2d7-4e19-9719-1df234afa5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:30.632729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c1d2e-f2d7-4e19-9719-1df234afa5f5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:30.637248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1899c-a021-4416-96e8-9b20a994e937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:30.638104 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1899c-a021-4416-96e8-9b20a994e937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:30.638377 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1899c-a021-4416-96e8-9b20a994e937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:30.638649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1899c-a021-4416-96e8-9b20a994e937 admin admin] PATH_INFO: `/v3/users/956d7513c5f04c5ca77fd8900df22349` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:30.639879 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1899c-a021-4416-96e8-9b20a994e937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=956d7513c5f04c5ca77fd8900df22349)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:30.641960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1899c-a021-4416-96e8-9b20a994e937 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:30.705994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-01e1899c-a021-4416-96e8-9b20a994e937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956d7513c5f04c5ca77fd8900df22349'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:30.715681 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-01e1899c-a021-4416-96e8-9b20a994e937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956d7513c5f04c5ca77fd8900df22349'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:30.735965 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-01e1899c-a021-4416-96e8-9b20a994e937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956d7513c5f04c5ca77fd8900df22349'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:30.744121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-01e1899c-a021-4416-96e8-9b20a994e937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956d7513c5f04c5ca77fd8900df22349'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:30.745072 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-01e1899c-a021-4416-96e8-9b20a994e937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956d7513c5f04c5ca77fd8900df22349'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:30.753452 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1214/2407] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:33:30 2022] DELETE /identity/v3/users/956d7513c5f04c5ca77fd8900df22349 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:30.758401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aad0e4-5a8d-4dfa-a88d-e4dc9be9706b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:30.759033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aad0e4-5a8d-4dfa-a88d-e4dc9be9706b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:30.759033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aad0e4-5a8d-4dfa-a88d-e4dc9be9706b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:30.801882 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-91aad0e4-5a8d-4dfa-a88d-e4dc9be9706b None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:30.821106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-91aad0e4-5a8d-4dfa-a88d-e4dc9be9706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:30.841453 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:30.915034 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1194/2408] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:30.925018 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1899c-a021-4416-96e8-9b20a994e937 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:30.926531 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-01e1899c-a021-4416-96e8-9b20a994e937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:30.973280 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:30.989081 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1899c-a021-4416-96e8-9b20a994e937 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:30.992766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d58115-0750-4a83-9dda-e30c1f24b44f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:30.993476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d58115-0750-4a83-9dda-e30c1f24b44f service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:30.993756 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d58115-0750-4a83-9dda-e30c1f24b44f service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:30.994024 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d58115-0750-4a83-9dda-e30c1f24b44f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:31.003843 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d58115-0750-4a83-9dda-e30c1f24b44f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:31.005255 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d58115-0750-4a83-9dda-e30c1f24b44f service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:31.014869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1215/2409] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:33:31.290665 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aad0e4-5a8d-4dfa-a88d-e4dc9be9706b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:31.292289 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-91aad0e4-5a8d-4dfa-a88d-e4dc9be9706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:31.306348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aad0e4-5a8d-4dfa-a88d-e4dc9be9706b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:31.312205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee14863-866f-4228-83db-9086f4eec564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:31.314192 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee14863-866f-4228-83db-9086f4eec564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:31.314321 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee14863-866f-4228-83db-9086f4eec564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:31.314553 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee14863-866f-4228-83db-9086f4eec564 admin admin] PATH_INFO: `/v3/projects/27cf0fe8ac554bbe8077f6c5b399dd4b` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:31.315806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee14863-866f-4228-83db-9086f4eec564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27cf0fe8ac554bbe8077f6c5b399dd4b)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:31.317688 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee14863-866f-4228-83db-9086f4eec564 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:31.367401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-eee14863-866f-4228-83db-9086f4eec564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27cf0fe8ac554bbe8077f6c5b399dd4b', 'request_id': 'req-eee14863-866f-4228-83db-9086f4eec564'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:31.372831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-eee14863-866f-4228-83db-9086f4eec564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27cf0fe8ac554bbe8077f6c5b399dd4b', 'request_id': 'req-eee14863-866f-4228-83db-9086f4eec564'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:31.380953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-eee14863-866f-4228-83db-9086f4eec564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27cf0fe8ac554bbe8077f6c5b399dd4b', 'request_id': 'req-eee14863-866f-4228-83db-9086f4eec564'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:31.392537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-eee14863-866f-4228-83db-9086f4eec564 admin admin] The token cache is being invalidate because project 27cf0fe8ac554bbe8077f6c5b399dd4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:31.392836 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-eee14863-866f-4228-83db-9086f4eec564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:31.393739 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-eee14863-866f-4228-83db-9086f4eec564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:31.395336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1195/2410] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:31 2022] DELETE /identity/v3/projects/27cf0fe8ac554bbe8077f6c5b399dd4b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:31.399323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d58115-0750-4a83-9dda-e30c1f24b44f service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:31.410925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d58115-0750-4a83-9dda-e30c1f24b44f service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:31.486424 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4465689-4251-4228-87d2-e411fcaa5958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:31.487382 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4465689-4251-4228-87d2-e411fcaa5958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:31.487727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4465689-4251-4228-87d2-e411fcaa5958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:31.488174 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4465689-4251-4228-87d2-e411fcaa5958 admin admin] PATH_INFO: `/v3/users/ae1582d9dfb24258a39e17bb70a836f7` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:31.489541 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4465689-4251-4228-87d2-e411fcaa5958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae1582d9dfb24258a39e17bb70a836f7)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:31.491649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4465689-4251-4228-87d2-e411fcaa5958 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:31.569566 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d4465689-4251-4228-87d2-e411fcaa5958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae1582d9dfb24258a39e17bb70a836f7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:31.577800 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d4465689-4251-4228-87d2-e411fcaa5958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae1582d9dfb24258a39e17bb70a836f7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:31.593371 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d4465689-4251-4228-87d2-e411fcaa5958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae1582d9dfb24258a39e17bb70a836f7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:31.603303 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d4465689-4251-4228-87d2-e411fcaa5958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae1582d9dfb24258a39e17bb70a836f7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:31.603984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d4465689-4251-4228-87d2-e411fcaa5958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae1582d9dfb24258a39e17bb70a836f7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:31.612318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1216/2411] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:33:31 2022] DELETE /identity/v3/users/ae1582d9dfb24258a39e17bb70a836f7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:31.898677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee14863-866f-4228-83db-9086f4eec564 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:31.901192 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-eee14863-866f-4228-83db-9086f4eec564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:31.918626 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee14863-866f-4228-83db-9086f4eec564 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:32.044622 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdd602-9d10-4839-bf51-97690f9594ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:32.045977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdd602-9d10-4839-bf51-97690f9594ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:32.046488 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdd602-9d10-4839-bf51-97690f9594ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:32.053491 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdd602-9d10-4839-bf51-97690f9594ff admin admin] PATH_INFO: `/v3/projects/850fcbdc800944c881a4a6d16cd61704` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:32.055232 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdd602-9d10-4839-bf51-97690f9594ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=850fcbdc800944c881a4a6d16cd61704)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:32.057556 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdd602-9d10-4839-bf51-97690f9594ff admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:32.112957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:32.123289 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2fbdd602-9d10-4839-bf51-97690f9594ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '850fcbdc800944c881a4a6d16cd61704', 'request_id': 'req-2fbdd602-9d10-4839-bf51-97690f9594ff'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:32.130388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2fbdd602-9d10-4839-bf51-97690f9594ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '850fcbdc800944c881a4a6d16cd61704', 'request_id': 'req-2fbdd602-9d10-4839-bf51-97690f9594ff'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:32.139085 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2fbdd602-9d10-4839-bf51-97690f9594ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '850fcbdc800944c881a4a6d16cd61704', 'request_id': 'req-2fbdd602-9d10-4839-bf51-97690f9594ff'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:32.151823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2fbdd602-9d10-4839-bf51-97690f9594ff admin admin] The token cache is being invalidate because project 850fcbdc800944c881a4a6d16cd61704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:32.152195 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2fbdd602-9d10-4839-bf51-97690f9594ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:32.152923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2fbdd602-9d10-4839-bf51-97690f9594ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:32.159660 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1196/2412] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:31 2022] DELETE /identity/v3/projects/850fcbdc800944c881a4a6d16cd61704 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:32.163463 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4465689-4251-4228-87d2-e411fcaa5958 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:32.164862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d4465689-4251-4228-87d2-e411fcaa5958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:32.177898 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4465689-4251-4228-87d2-e411fcaa5958 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:32.245863 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3806f3-c04d-42e7-b182-28f906de8626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:32.246802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3806f3-c04d-42e7-b182-28f906de8626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:32.247107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3806f3-c04d-42e7-b182-28f906de8626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:32.247382 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3806f3-c04d-42e7-b182-28f906de8626 admin admin] PATH_INFO: `/v3/users/25495cf28c81478cb4a599907708bcca` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:32.248577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3806f3-c04d-42e7-b182-28f906de8626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25495cf28c81478cb4a599907708bcca)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:32.251120 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3806f3-c04d-42e7-b182-28f906de8626 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:32.253591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:32.303311 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6c3806f3-c04d-42e7-b182-28f906de8626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25495cf28c81478cb4a599907708bcca'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:32.312220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6c3806f3-c04d-42e7-b182-28f906de8626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25495cf28c81478cb4a599907708bcca'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:32.330457 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6c3806f3-c04d-42e7-b182-28f906de8626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25495cf28c81478cb4a599907708bcca'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:32.357103 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6c3806f3-c04d-42e7-b182-28f906de8626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25495cf28c81478cb4a599907708bcca'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:32.357971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6c3806f3-c04d-42e7-b182-28f906de8626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25495cf28c81478cb4a599907708bcca'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:32.383501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1217/2413] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:33:32 2022] DELETE /identity/v3/users/25495cf28c81478cb4a599907708bcca => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:33.041897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294358b4-160f-4925-b47e-ddc65e9eb512 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:33.042396 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294358b4-160f-4925-b47e-ddc65e9eb512 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:33.042396 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294358b4-160f-4925-b47e-ddc65e9eb512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:33.076734 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-294358b4-160f-4925-b47e-ddc65e9eb512 None None] MFA Rules not processed for user `18030043de1942779baf3ad94aec4071`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:33.082551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-294358b4-160f-4925-b47e-ddc65e9eb512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:33.224011 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1197/2414] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 19 12:33:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:33.251903 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3806f3-c04d-42e7-b182-28f906de8626 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:33.258836 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6c3806f3-c04d-42e7-b182-28f906de8626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:33.382769 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294358b4-160f-4925-b47e-ddc65e9eb512 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:33.383384 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-294358b4-160f-4925-b47e-ddc65e9eb512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:33.400683 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3806f3-c04d-42e7-b182-28f906de8626 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:33.405989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f25582-4a7c-4177-a2b4-5edb78b77578 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc2e1079d34745a279588028945c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:33.407250 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f25582-4a7c-4177-a2b4-5edb78b77578 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:33.407527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f25582-4a7c-4177-a2b4-5edb78b77578 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:33.407798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f25582-4a7c-4177-a2b4-5edb78b77578 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:33.417514 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f25582-4a7c-4177-a2b4-5edb78b77578 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:33.419134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f25582-4a7c-4177-a2b4-5edb78b77578 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:33.440320 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1218/2415] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 19 12:33:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 12:33:33.488914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294358b4-160f-4925-b47e-ddc65e9eb512 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:33.496581 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f023ab6-20b9-435c-9c97-079fa1fac823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:33.497761 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f023ab6-20b9-435c-9c97-079fa1fac823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:33.498332 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f023ab6-20b9-435c-9c97-079fa1fac823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:33.498808 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f023ab6-20b9-435c-9c97-079fa1fac823 admin admin] PATH_INFO: `/v3/projects/4bfc6f58207d46238e43c3bbf7587c40` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:33.500515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f023ab6-20b9-435c-9c97-079fa1fac823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bfc6f58207d46238e43c3bbf7587c40)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:33.503288 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f023ab6-20b9-435c-9c97-079fa1fac823 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:33.586684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1f023ab6-20b9-435c-9c97-079fa1fac823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bfc6f58207d46238e43c3bbf7587c40', 'request_id': 'req-1f023ab6-20b9-435c-9c97-079fa1fac823'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:33.601848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1f023ab6-20b9-435c-9c97-079fa1fac823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bfc6f58207d46238e43c3bbf7587c40', 'request_id': 'req-1f023ab6-20b9-435c-9c97-079fa1fac823'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:33.618340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1f023ab6-20b9-435c-9c97-079fa1fac823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bfc6f58207d46238e43c3bbf7587c40', 'request_id': 'req-1f023ab6-20b9-435c-9c97-079fa1fac823'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:33.647073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1f023ab6-20b9-435c-9c97-079fa1fac823 admin admin] The token cache is being invalidate because project 4bfc6f58207d46238e43c3bbf7587c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:33.647673 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1f023ab6-20b9-435c-9c97-079fa1fac823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:33.648516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1f023ab6-20b9-435c-9c97-079fa1fac823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:33.650561 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1198/2416] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:33 2022] DELETE /identity/v3/projects/4bfc6f58207d46238e43c3bbf7587c40 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:33.655441 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab7eb2-02a4-4654-a216-cdde8ef3cb30 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:33.656069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab7eb2-02a4-4654-a216-cdde8ef3cb30 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:33.657111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab7eb2-02a4-4654-a216-cdde8ef3cb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:33.681614 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9dab7eb2-02a4-4654-a216-cdde8ef3cb30 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:33.683537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9dab7eb2-02a4-4654-a216-cdde8ef3cb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:33.727806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152ac56-2511-47fe-bfd4-f131ba463b9b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:33.729772 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152ac56-2511-47fe-bfd4-f131ba463b9b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:33.729939 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152ac56-2511-47fe-bfd4-f131ba463b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:33.743941 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:33.770922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2152ac56-2511-47fe-bfd4-f131ba463b9b None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:33.773383 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2152ac56-2511-47fe-bfd4-f131ba463b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:33.789094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1219/2417] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:33.796780 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74f09a-fe5e-4bf6-997b-f24a289cdaf0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:33.797256 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74f09a-fe5e-4bf6-997b-f24a289cdaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:33.797562 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74f09a-fe5e-4bf6-997b-f24a289cdaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:33.834585 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fa74f09a-fe5e-4bf6-997b-f24a289cdaf0 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:33.837188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fa74f09a-fe5e-4bf6-997b-f24a289cdaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:33.848157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1220/2418] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:33.852187 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74f09a-fe5e-4bf6-997b-f24a289cdaf0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:33.858907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:33.865120 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74f09a-fe5e-4bf6-997b-f24a289cdaf0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:33.871316 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89418842-c1e7-4563-ac5b-acd677fdebee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:33.872308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89418842-c1e7-4563-ac5b-acd677fdebee admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:33.872594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89418842-c1e7-4563-ac5b-acd677fdebee admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:33.873005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89418842-c1e7-4563-ac5b-acd677fdebee admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:33.874206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89418842-c1e7-4563-ac5b-acd677fdebee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:33:33.874834 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89418842-c1e7-4563-ac5b-acd677fdebee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:33.878123 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89418842-c1e7-4563-ac5b-acd677fdebee admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:33.912192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1221/2419] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:33:33.917484 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89418842-c1e7-4563-ac5b-acd677fdebee admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:33.934054 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1199/2420] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 19 12:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:33.956461 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152ac56-2511-47fe-bfd4-f131ba463b9b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:33.960464 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2152ac56-2511-47fe-bfd4-f131ba463b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:33.983347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89418842-c1e7-4563-ac5b-acd677fdebee admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:34.002876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfc5ba-7125-4897-88a9-ec042d39428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:34.004991 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfc5ba-7125-4897-88a9-ec042d39428e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:34.008944 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfc5ba-7125-4897-88a9-ec042d39428e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:34.009512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfc5ba-7125-4897-88a9-ec042d39428e admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:34.013155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfc5ba-7125-4897-88a9-ec042d39428e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:34.017971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfc5ba-7125-4897-88a9-ec042d39428e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:34.101117 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1222/2421] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:33 2022] POST /identity/v3/projects => generated 367 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:34.105380 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfc5ba-7125-4897-88a9-ec042d39428e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:34.197716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152ac56-2511-47fe-bfd4-f131ba463b9b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:34.239002 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfc5ba-7125-4897-88a9-ec042d39428e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:34.244634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892252e-3801-4382-b4ed-73966dbf63c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:34.246835 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892252e-3801-4382-b4ed-73966dbf63c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:34.247314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892252e-3801-4382-b4ed-73966dbf63c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:34.247587 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892252e-3801-4382-b4ed-73966dbf63c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:34.248534 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892252e-3801-4382-b4ed-73966dbf63c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:34.251420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892252e-3801-4382-b4ed-73966dbf63c6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:34.310841 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1223/2422] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:34 2022] POST /identity/v3/users => generated 284 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:34.314237 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892252e-3801-4382-b4ed-73966dbf63c6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:34.327251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892252e-3801-4382-b4ed-73966dbf63c6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:34.336696 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416f87f-d3dd-4975-af59-8965470330a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:34.337650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416f87f-d3dd-4975-af59-8965470330a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:34.337952 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416f87f-d3dd-4975-af59-8965470330a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:34.338218 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416f87f-d3dd-4975-af59-8965470330a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:34.350438 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416f87f-d3dd-4975-af59-8965470330a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:34.350438 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416f87f-d3dd-4975-af59-8965470330a5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:34.368343 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1224/2423] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:33:34.370982 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416f87f-d3dd-4975-af59-8965470330a5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:34.386904 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9ed6f-a329-4c2c-aecb-789cebdaa1d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:34.389378 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9ed6f-a329-4c2c-aecb-789cebdaa1d7 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:34.390964 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9ed6f-a329-4c2c-aecb-789cebdaa1d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:34.391443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9ed6f-a329-4c2c-aecb-789cebdaa1d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:34.412396 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416f87f-d3dd-4975-af59-8965470330a5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:34.421430 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aaac9d-fdfe-4ea6-b0ef-aaf8e19151d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:34.422932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaac9d-fdfe-4ea6-b0ef-aaf8e19151d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:34.423106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaac9d-fdfe-4ea6-b0ef-aaf8e19151d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:34.423473 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaac9d-fdfe-4ea6-b0ef-aaf8e19151d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:34.424202 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aaac9d-fdfe-4ea6-b0ef-aaf8e19151d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:34.424406 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9ed6f-a329-4c2c-aecb-789cebdaa1d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:34.426173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aaac9d-fdfe-4ea6-b0ef-aaf8e19151d8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:34.426310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9ed6f-a329-4c2c-aecb-789cebdaa1d7 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:34.442026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1225/2424] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:34.448057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aaac9d-fdfe-4ea6-b0ef-aaf8e19151d8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:34.455578 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1200/2425] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:34.503231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aaac9d-fdfe-4ea6-b0ef-aaf8e19151d8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:34.514934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47726fc7-fccc-466d-bdfe-c69879cdcd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:34.515953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47726fc7-fccc-466d-bdfe-c69879cdcd44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:34.516226 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47726fc7-fccc-466d-bdfe-c69879cdcd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:34.516496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47726fc7-fccc-466d-bdfe-c69879cdcd44 admin admin] PATH_INFO: `/v3/projects/9e9358361aef457c8029d2ac74b6a1fc/users/470987def68645d7834bafeace3588c4/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:34.558922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47726fc7-fccc-466d-bdfe-c69879cdcd44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9358361aef457c8029d2ac74b6a1fc, user_id=470987def68645d7834bafeace3588c4, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:34.568147 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47726fc7-fccc-466d-bdfe-c69879cdcd44 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:34.599153 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1226/2426] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:34 2022] PUT /identity/v3/projects/9e9358361aef457c8029d2ac74b6a1fc/users/470987def68645d7834bafeace3588c4/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:34.611166 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8a6cf-68d6-423b-9b04-092a3c49e048 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:34.611452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8a6cf-68d6-423b-9b04-092a3c49e048 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:34.611733 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8a6cf-68d6-423b-9b04-092a3c49e048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:34.644394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-63d8a6cf-68d6-423b-9b04-092a3c49e048 None None] MFA Rules not processed for user `470987def68645d7834bafeace3588c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:34.646193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-63d8a6cf-68d6-423b-9b04-092a3c49e048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:34.662039 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:34.701950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47726fc7-fccc-466d-bdfe-c69879cdcd44 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:34.701950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-47726fc7-fccc-466d-bdfe-c69879cdcd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:34.786869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1201/2427] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:34.795245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8a6cf-68d6-423b-9b04-092a3c49e048 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:34.800987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-63d8a6cf-68d6-423b-9b04-092a3c49e048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:34.846325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47726fc7-fccc-466d-bdfe-c69879cdcd44 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:34.863832 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04f99a-2c8a-4ae6-adc7-8e93aee518db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:34.864731 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04f99a-2c8a-4ae6-adc7-8e93aee518db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:34.865008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04f99a-2c8a-4ae6-adc7-8e93aee518db admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:34.865277 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04f99a-2c8a-4ae6-adc7-8e93aee518db admin admin] PATH_INFO: `/v3/users/69fdbdb58f36451283d9720baf6681a1` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:34.866782 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04f99a-2c8a-4ae6-adc7-8e93aee518db admin admin] RBAC: Authorizing `identity:delete_user(user_id=69fdbdb58f36451283d9720baf6681a1)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:34.869103 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04f99a-2c8a-4ae6-adc7-8e93aee518db admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:34.888747 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8a6cf-68d6-423b-9b04-092a3c49e048 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:34.896992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af81424-24a8-4d0b-9f43-20daad3a881b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1af8b237e2df41668bc5409d8fdd3f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:34.898290 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af81424-24a8-4d0b-9f43-20daad3a881b service glance] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:34.898724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af81424-24a8-4d0b-9f43-20daad3a881b service glance] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:34.899105 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af81424-24a8-4d0b-9f43-20daad3a881b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:34.904954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:34.919480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af81424-24a8-4d0b-9f43-20daad3a881b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:34.925126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af81424-24a8-4d0b-9f43-20daad3a881b service glance] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:34.958778 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1202/2428] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:34.960651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8c04f99a-2c8a-4ae6-adc7-8e93aee518db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69fdbdb58f36451283d9720baf6681a1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:34.973251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8c04f99a-2c8a-4ae6-adc7-8e93aee518db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69fdbdb58f36451283d9720baf6681a1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:35.019881 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8c04f99a-2c8a-4ae6-adc7-8e93aee518db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69fdbdb58f36451283d9720baf6681a1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:35.044110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8c04f99a-2c8a-4ae6-adc7-8e93aee518db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69fdbdb58f36451283d9720baf6681a1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:35.045323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8c04f99a-2c8a-4ae6-adc7-8e93aee518db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69fdbdb58f36451283d9720baf6681a1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:35.076382 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1227/2429] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:33:34 2022] DELETE /identity/v3/users/69fdbdb58f36451283d9720baf6681a1 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:33:35.078785 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464216e0-9b96-43fb-acd2-d9d850ed6519 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:35.079267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464216e0-9b96-43fb-acd2-d9d850ed6519 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:35.080086 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464216e0-9b96-43fb-acd2-d9d850ed6519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:35.133596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-464216e0-9b96-43fb-acd2-d9d850ed6519 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:35.138563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-464216e0-9b96-43fb-acd2-d9d850ed6519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:35.292154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1203/2430] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:33:35.304880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04f99a-2c8a-4ae6-adc7-8e93aee518db admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:35.308250 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8c04f99a-2c8a-4ae6-adc7-8e93aee518db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:35.433021 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04f99a-2c8a-4ae6-adc7-8e93aee518db admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:35.446125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddea86e-1792-4ba5-9c7a-08b54f032049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:35.446959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddea86e-1792-4ba5-9c7a-08b54f032049 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:35.448276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddea86e-1792-4ba5-9c7a-08b54f032049 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:35.448661 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddea86e-1792-4ba5-9c7a-08b54f032049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:35.474723 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddea86e-1792-4ba5-9c7a-08b54f032049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:35.477101 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddea86e-1792-4ba5-9c7a-08b54f032049 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:35.495557 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1228/2431] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:36.139693 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464216e0-9b96-43fb-acd2-d9d850ed6519 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:36.149483 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-464216e0-9b96-43fb-acd2-d9d850ed6519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:36.179925 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464216e0-9b96-43fb-acd2-d9d850ed6519 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:36.202754 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a3742-ba08-4021-b1f2-c37aad7deb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:36.203983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a3742-ba08-4021-b1f2-c37aad7deb32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:36.205604 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a3742-ba08-4021-b1f2-c37aad7deb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:36.206097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a3742-ba08-4021-b1f2-c37aad7deb32 admin admin] PATH_INFO: `/v3/projects/b21a6a68bc674e8aad68703ba858cf3b` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:36.219886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a3742-ba08-4021-b1f2-c37aad7deb32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b21a6a68bc674e8aad68703ba858cf3b)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:36.222062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a3742-ba08-4021-b1f2-c37aad7deb32 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:36.314284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-524a3742-ba08-4021-b1f2-c37aad7deb32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b21a6a68bc674e8aad68703ba858cf3b', 'request_id': 'req-524a3742-ba08-4021-b1f2-c37aad7deb32'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:36.319098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:36.321705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-524a3742-ba08-4021-b1f2-c37aad7deb32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b21a6a68bc674e8aad68703ba858cf3b', 'request_id': 'req-524a3742-ba08-4021-b1f2-c37aad7deb32'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:36.335338 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-524a3742-ba08-4021-b1f2-c37aad7deb32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b21a6a68bc674e8aad68703ba858cf3b', 'request_id': 'req-524a3742-ba08-4021-b1f2-c37aad7deb32'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:36.357178 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-524a3742-ba08-4021-b1f2-c37aad7deb32 admin admin] The token cache is being invalidate because project b21a6a68bc674e8aad68703ba858cf3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:36.357385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-524a3742-ba08-4021-b1f2-c37aad7deb32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:36.358120 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-524a3742-ba08-4021-b1f2-c37aad7deb32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:36.360889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1204/2432] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:36 2022] DELETE /identity/v3/projects/b21a6a68bc674e8aad68703ba858cf3b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:36.366089 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddea86e-1792-4ba5-9c7a-08b54f032049 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:36.378422 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddea86e-1792-4ba5-9c7a-08b54f032049 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:36.462457 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1998d-29e1-4624-9741-9659b81cae89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:36.463923 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1998d-29e1-4624-9741-9659b81cae89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:36.464647 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1998d-29e1-4624-9741-9659b81cae89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:36.464870 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1998d-29e1-4624-9741-9659b81cae89 admin admin] PATH_INFO: `/v3/users/9d03d98078c542c088b73415682e9ff6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:36.467197 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1998d-29e1-4624-9741-9659b81cae89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d03d98078c542c088b73415682e9ff6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:36.470504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1998d-29e1-4624-9741-9659b81cae89 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:36.535794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:36.556286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c4d1998d-29e1-4624-9741-9659b81cae89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d03d98078c542c088b73415682e9ff6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:36.567720 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c4d1998d-29e1-4624-9741-9659b81cae89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d03d98078c542c088b73415682e9ff6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:36.599145 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c4d1998d-29e1-4624-9741-9659b81cae89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d03d98078c542c088b73415682e9ff6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:36.610489 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c4d1998d-29e1-4624-9741-9659b81cae89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d03d98078c542c088b73415682e9ff6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:36.611193 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c4d1998d-29e1-4624-9741-9659b81cae89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d03d98078c542c088b73415682e9ff6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:36.619505 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1229/2433] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:33:36 2022] DELETE /identity/v3/users/9d03d98078c542c088b73415682e9ff6 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:36.948354 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3611cb-04cf-42a1-b4fa-62c2b0eb59e0 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:36.948674 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3611cb-04cf-42a1-b4fa-62c2b0eb59e0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:36.948907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3611cb-04cf-42a1-b4fa-62c2b0eb59e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:36.989304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ea3611cb-04cf-42a1-b4fa-62c2b0eb59e0 None None] MFA Rules not processed for user `2410dc00847f42eb853780b399950899`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:36.991642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ea3611cb-04cf-42a1-b4fa-62c2b0eb59e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:37.003141 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1998d-29e1-4624-9741-9659b81cae89 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:37.004629 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c4d1998d-29e1-4624-9741-9659b81cae89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:37.118785 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1205/2434] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:37.128214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1998d-29e1-4624-9741-9659b81cae89 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:37.133058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9af9e4-c0d2-415a-a848-b89df6f340ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:37.134069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9af9e4-c0d2-415a-a848-b89df6f340ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:37.134351 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9af9e4-c0d2-415a-a848-b89df6f340ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:37.135651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9af9e4-c0d2-415a-a848-b89df6f340ef admin admin] PATH_INFO: `/v3/projects/ca12f57ac3fe47b5accd9969b026f989` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:37.136119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9af9e4-c0d2-415a-a848-b89df6f340ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca12f57ac3fe47b5accd9969b026f989)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:37.138036 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9af9e4-c0d2-415a-a848-b89df6f340ef admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:37.217346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5c9af9e4-c0d2-415a-a848-b89df6f340ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca12f57ac3fe47b5accd9969b026f989', 'request_id': 'req-5c9af9e4-c0d2-415a-a848-b89df6f340ef'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:37.225731 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5c9af9e4-c0d2-415a-a848-b89df6f340ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca12f57ac3fe47b5accd9969b026f989', 'request_id': 'req-5c9af9e4-c0d2-415a-a848-b89df6f340ef'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:37.235836 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5c9af9e4-c0d2-415a-a848-b89df6f340ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca12f57ac3fe47b5accd9969b026f989', 'request_id': 'req-5c9af9e4-c0d2-415a-a848-b89df6f340ef'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:37.253719 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5c9af9e4-c0d2-415a-a848-b89df6f340ef admin admin] The token cache is being invalidate because project ca12f57ac3fe47b5accd9969b026f989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:37.254061 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5c9af9e4-c0d2-415a-a848-b89df6f340ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:37.254685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5c9af9e4-c0d2-415a-a848-b89df6f340ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:37.256637 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1230/2435] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:37 2022] DELETE /identity/v3/projects/ca12f57ac3fe47b5accd9969b026f989 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:33:37.261457 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad601c-ccfd-4f4b-ac8c-f35c3b2dc26e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:37.261802 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad601c-ccfd-4f4b-ac8c-f35c3b2dc26e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:37.262154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad601c-ccfd-4f4b-ac8c-f35c3b2dc26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:37.286631 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-cdad601c-ccfd-4f4b-ac8c-f35c3b2dc26e None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:37.287891 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cdad601c-ccfd-4f4b-ac8c-f35c3b2dc26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:37.358907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1206/2436] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:37.363717 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c5407-1717-4464-abef-d19dd1cafde7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:37.364016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c5407-1717-4464-abef-d19dd1cafde7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:37.364296 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c5407-1717-4464-abef-d19dd1cafde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:37.384820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2e1c5407-1717-4464-abef-d19dd1cafde7 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:37.385994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2e1c5407-1717-4464-abef-d19dd1cafde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:37.395651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1231/2437] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:33:37.400285 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad601c-ccfd-4f4b-ac8c-f35c3b2dc26e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:37.411277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad601c-ccfd-4f4b-ac8c-f35c3b2dc26e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:37.422559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e79a97-8c1e-4941-8570-000fc0a552ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:37.423375 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e79a97-8c1e-4941-8570-000fc0a552ab admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:37.425830 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e79a97-8c1e-4941-8570-000fc0a552ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:37.425830 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e79a97-8c1e-4941-8570-000fc0a552ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:37.426597 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e79a97-8c1e-4941-8570-000fc0a552ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:33:37.426953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e79a97-8c1e-4941-8570-000fc0a552ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:37.428667 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e79a97-8c1e-4941-8570-000fc0a552ab admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:37.442755 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1207/2438] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:33:37.447159 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c5407-1717-4464-abef-d19dd1cafde7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:37.458089 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c5407-1717-4464-abef-d19dd1cafde7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:37.463554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb603421-8871-4ae7-9329-5b2fd369dbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:37.464342 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb603421-8871-4ae7-9329-5b2fd369dbd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:37.464627 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb603421-8871-4ae7-9329-5b2fd369dbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:37.464903 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb603421-8871-4ae7-9329-5b2fd369dbd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:37.465592 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb603421-8871-4ae7-9329-5b2fd369dbd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:37.467613 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb603421-8871-4ae7-9329-5b2fd369dbd4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:37.506672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1232/2439] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:37 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:37.511373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e79a97-8c1e-4941-8570-000fc0a552ab admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:37.524113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e79a97-8c1e-4941-8570-000fc0a552ab admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:37.595037 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ac6f4-6d84-42f3-a45d-678c47b3d210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:37.595722 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ac6f4-6d84-42f3-a45d-678c47b3d210 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:37.596003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ac6f4-6d84-42f3-a45d-678c47b3d210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:37.596274 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ac6f4-6d84-42f3-a45d-678c47b3d210 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:37.596975 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ac6f4-6d84-42f3-a45d-678c47b3d210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:37.598902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ac6f4-6d84-42f3-a45d-678c47b3d210 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:37.628947 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1208/2440] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:37 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:37.630464 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb603421-8871-4ae7-9329-5b2fd369dbd4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:37.646245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb603421-8871-4ae7-9329-5b2fd369dbd4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:37.651232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f32a41-0b5c-4e4b-a4f2-5b58427687a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:37.651909 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f32a41-0b5c-4e4b-a4f2-5b58427687a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:37.652190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f32a41-0b5c-4e4b-a4f2-5b58427687a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:37.652460 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f32a41-0b5c-4e4b-a4f2-5b58427687a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:37.653180 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f32a41-0b5c-4e4b-a4f2-5b58427687a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:37.654810 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f32a41-0b5c-4e4b-a4f2-5b58427687a1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:37.668193 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1233/2441] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:37.672507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ac6f4-6d84-42f3-a45d-678c47b3d210 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:37.679968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:37.684186 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ac6f4-6d84-42f3-a45d-678c47b3d210 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:37.692154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efca1c4-c887-466c-bc1e-a4bbba75fcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:37.693122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efca1c4-c887-466c-bc1e-a4bbba75fcde admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:37.693629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efca1c4-c887-466c-bc1e-a4bbba75fcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:37.694099 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efca1c4-c887-466c-bc1e-a4bbba75fcde admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:37.695089 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efca1c4-c887-466c-bc1e-a4bbba75fcde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:37.697571 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efca1c4-c887-466c-bc1e-a4bbba75fcde admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:37.716445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1209/2442] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:37.720889 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f32a41-0b5c-4e4b-a4f2-5b58427687a1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:37.727539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:37.731798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f32a41-0b5c-4e4b-a4f2-5b58427687a1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:37.740663 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719367b-c807-4fd0-a0b0-dd58e656b2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:37.741803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719367b-c807-4fd0-a0b0-dd58e656b2cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:37.742094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719367b-c807-4fd0-a0b0-dd58e656b2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:37.742339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719367b-c807-4fd0-a0b0-dd58e656b2cd admin admin] PATH_INFO: `/v3/projects/7a05a2db8a50463181ddd711a9ef1b33/users/473585ba4c9f40c88a290c9f3bb56b08/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:37.758317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719367b-c807-4fd0-a0b0-dd58e656b2cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a05a2db8a50463181ddd711a9ef1b33, user_id=473585ba4c9f40c88a290c9f3bb56b08, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:37.761950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719367b-c807-4fd0-a0b0-dd58e656b2cd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:37.777027 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1234/2443] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:37 2022] PUT /identity/v3/projects/7a05a2db8a50463181ddd711a9ef1b33/users/473585ba4c9f40c88a290c9f3bb56b08/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:37.846975 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec111e-16e8-4df4-9949-5a5c83e4f989 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:37.847333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec111e-16e8-4df4-9949-5a5c83e4f989 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:37.847639 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec111e-16e8-4df4-9949-5a5c83e4f989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:37.885119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-98ec111e-16e8-4df4-9949-5a5c83e4f989 None None] MFA Rules not processed for user `473585ba4c9f40c88a290c9f3bb56b08`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:37.886350 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-98ec111e-16e8-4df4-9949-5a5c83e4f989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:37.978782 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1210/2444] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:37.979520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719367b-c807-4fd0-a0b0-dd58e656b2cd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:38.080262 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719367b-c807-4fd0-a0b0-dd58e656b2cd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:38.086616 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a879aa-d851-4b0a-b09b-c0b805bacc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:38.086867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a879aa-d851-4b0a-b09b-c0b805bacc2c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:38.087453 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a879aa-d851-4b0a-b09b-c0b805bacc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:38.087453 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a879aa-d851-4b0a-b09b-c0b805bacc2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:38.088038 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a879aa-d851-4b0a-b09b-c0b805bacc2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:38.090296 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a879aa-d851-4b0a-b09b-c0b805bacc2c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:38.123831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1235/2445] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:37 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:38.128713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec111e-16e8-4df4-9949-5a5c83e4f989 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:38.139933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec111e-16e8-4df4-9949-5a5c83e4f989 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:38.202595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95c3bb-5604-49fa-80af-eb48fdf62030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:38.203337 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95c3bb-5604-49fa-80af-eb48fdf62030 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:38.203615 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95c3bb-5604-49fa-80af-eb48fdf62030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:38.203887 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95c3bb-5604-49fa-80af-eb48fdf62030 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:38.204575 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95c3bb-5604-49fa-80af-eb48fdf62030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:38.206501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95c3bb-5604-49fa-80af-eb48fdf62030 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:38.228488 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1211/2446] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:38 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:38.232252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a879aa-d851-4b0a-b09b-c0b805bacc2c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:38.244714 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a879aa-d851-4b0a-b09b-c0b805bacc2c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:38.249620 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942b0ff-784a-44b3-958d-f794c895a3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:38.250900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942b0ff-784a-44b3-958d-f794c895a3ef admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:38.251383 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942b0ff-784a-44b3-958d-f794c895a3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:38.251651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942b0ff-784a-44b3-958d-f794c895a3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:38.252378 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942b0ff-784a-44b3-958d-f794c895a3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:38.254031 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942b0ff-784a-44b3-958d-f794c895a3ef admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:38.266337 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1236/2447] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:38.271023 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95c3bb-5604-49fa-80af-eb48fdf62030 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:38.284291 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95c3bb-5604-49fa-80af-eb48fdf62030 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:38.291897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5a993-9330-4f2c-907e-55c6942437e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:38.292868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5a993-9330-4f2c-907e-55c6942437e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:38.293224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5a993-9330-4f2c-907e-55c6942437e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:38.293554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5a993-9330-4f2c-907e-55c6942437e0 admin admin] PATH_INFO: `/v3/projects/2344c82d9ca54a5faf81a3c0cca07526/users/5b17baf21beb41c18d3f9855614e2dc5/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:38.317492 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5a993-9330-4f2c-907e-55c6942437e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2344c82d9ca54a5faf81a3c0cca07526, user_id=5b17baf21beb41c18d3f9855614e2dc5, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:38.321778 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5a993-9330-4f2c-907e-55c6942437e0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:38.344541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1212/2448] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:38 2022] PUT /identity/v3/projects/2344c82d9ca54a5faf81a3c0cca07526/users/5b17baf21beb41c18d3f9855614e2dc5/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:38.348488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942b0ff-784a-44b3-958d-f794c895a3ef admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:38.364595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942b0ff-784a-44b3-958d-f794c895a3ef admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:38.438759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d0624-2e66-49b5-99d0-89703b873c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:38.439538 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d0624-2e66-49b5-99d0-89703b873c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:38.439736 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d0624-2e66-49b5-99d0-89703b873c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:38.440029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d0624-2e66-49b5-99d0-89703b873c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:38.440749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d0624-2e66-49b5-99d0-89703b873c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:38.442370 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d0624-2e66-49b5-99d0-89703b873c51 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:38.454246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1237/2449] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:38.458293 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5a993-9330-4f2c-907e-55c6942437e0 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:38.471586 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5a993-9330-4f2c-907e-55c6942437e0 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:38.482653 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5b564-30ec-4be4-99aa-124d2956d667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:38.483928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5b564-30ec-4be4-99aa-124d2956d667 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:38.484998 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5b564-30ec-4be4-99aa-124d2956d667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:38.485112 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5b564-30ec-4be4-99aa-124d2956d667 admin admin] PATH_INFO: `/v3/projects/2344c82d9ca54a5faf81a3c0cca07526/users/5b17baf21beb41c18d3f9855614e2dc5/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:38.487299 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5b564-30ec-4be4-99aa-124d2956d667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2344c82d9ca54a5faf81a3c0cca07526, user_id=5b17baf21beb41c18d3f9855614e2dc5, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:38.490169 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5b564-30ec-4be4-99aa-124d2956d667 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:38.502918 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1213/2450] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:38 2022] PUT /identity/v3/projects/2344c82d9ca54a5faf81a3c0cca07526/users/5b17baf21beb41c18d3f9855614e2dc5/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:38.512981 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8840574-3d94-4ae6-b2fe-cb1704bd9d0d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:38.513507 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8840574-3d94-4ae6-b2fe-cb1704bd9d0d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:38.513623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8840574-3d94-4ae6-b2fe-cb1704bd9d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:38.550921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e8840574-3d94-4ae6-b2fe-cb1704bd9d0d None None] MFA Rules not processed for user `5b17baf21beb41c18d3f9855614e2dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:38.552164 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e8840574-3d94-4ae6-b2fe-cb1704bd9d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:38.605665 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:38.642092 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1238/2451] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:38.652970 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5b564-30ec-4be4-99aa-124d2956d667 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:38.654650 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a0c5b564-30ec-4be4-99aa-124d2956d667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:38.705846 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:38.728774 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5b564-30ec-4be4-99aa-124d2956d667 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:38.732515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00695d9b-b70c-42fb-b8e8-5d880e0c70ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:38.733189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00695d9b-b70c-42fb-b8e8-5d880e0c70ce service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:38.733466 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00695d9b-b70c-42fb-b8e8-5d880e0c70ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:38.733764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00695d9b-b70c-42fb-b8e8-5d880e0c70ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:38.802609 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00695d9b-b70c-42fb-b8e8-5d880e0c70ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:38.804077 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00695d9b-b70c-42fb-b8e8-5d880e0c70ce service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:38.813928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1214/2452] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:43.420814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8840574-3d94-4ae6-b2fe-cb1704bd9d0d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:43.422663 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e8840574-3d94-4ae6-b2fe-cb1704bd9d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:43.436728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8840574-3d94-4ae6-b2fe-cb1704bd9d0d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:43.440779 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde99710-d5c4-49b3-837f-d41b705a4661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:43.441486 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde99710-d5c4-49b3-837f-d41b705a4661 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:43.441768 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde99710-d5c4-49b3-837f-d41b705a4661 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:43.442040 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde99710-d5c4-49b3-837f-d41b705a4661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:43.454749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde99710-d5c4-49b3-837f-d41b705a4661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:43.456514 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde99710-d5c4-49b3-837f-d41b705a4661 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:43.468437 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1239/2453] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:48.502666 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00695d9b-b70c-42fb-b8e8-5d880e0c70ce service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:48.625642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00695d9b-b70c-42fb-b8e8-5d880e0c70ce service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:48.630780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59975bb7-fe51-4a82-9eec-548903c44094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:48.631731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59975bb7-fe51-4a82-9eec-548903c44094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:48.631964 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59975bb7-fe51-4a82-9eec-548903c44094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:48.632238 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59975bb7-fe51-4a82-9eec-548903c44094 admin admin] PATH_INFO: `/v3/users/473585ba4c9f40c88a290c9f3bb56b08` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:48.633486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59975bb7-fe51-4a82-9eec-548903c44094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=473585ba4c9f40c88a290c9f3bb56b08)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:48.635549 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59975bb7-fe51-4a82-9eec-548903c44094 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:48.715883 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-59975bb7-fe51-4a82-9eec-548903c44094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '473585ba4c9f40c88a290c9f3bb56b08'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:48.724718 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-59975bb7-fe51-4a82-9eec-548903c44094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '473585ba4c9f40c88a290c9f3bb56b08'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:48.740151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-59975bb7-fe51-4a82-9eec-548903c44094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '473585ba4c9f40c88a290c9f3bb56b08'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:48.757396 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-59975bb7-fe51-4a82-9eec-548903c44094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '473585ba4c9f40c88a290c9f3bb56b08'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:48.758462 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-59975bb7-fe51-4a82-9eec-548903c44094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '473585ba4c9f40c88a290c9f3bb56b08'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:48.769190 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1215/2454] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:33:48 2022] DELETE /identity/v3/users/473585ba4c9f40c88a290c9f3bb56b08 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:48.773458 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd378414-7d40-4ce5-a646-169c76442c2f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:48.773988 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd378414-7d40-4ce5-a646-169c76442c2f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:48.773988 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd378414-7d40-4ce5-a646-169c76442c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:48.798782 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-bd378414-7d40-4ce5-a646-169c76442c2f None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:48.800026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bd378414-7d40-4ce5-a646-169c76442c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:48.893778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1240/2455] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:48.900597 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59975bb7-fe51-4a82-9eec-548903c44094 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:48.902992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-59975bb7-fe51-4a82-9eec-548903c44094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:48.915936 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:48.971507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59975bb7-fe51-4a82-9eec-548903c44094 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:48.975578 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716f1b8-1590-4327-a379-9525615aef5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:48.976235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716f1b8-1590-4327-a379-9525615aef5b service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:48.976519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716f1b8-1590-4327-a379-9525615aef5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:48.976794 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716f1b8-1590-4327-a379-9525615aef5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:48.986628 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716f1b8-1590-4327-a379-9525615aef5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:48.988708 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716f1b8-1590-4327-a379-9525615aef5b service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:49.000033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1216/2456] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:49.392125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd378414-7d40-4ce5-a646-169c76442c2f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:49.393961 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bd378414-7d40-4ce5-a646-169c76442c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:49.411877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd378414-7d40-4ce5-a646-169c76442c2f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:49.419095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d94857-a13c-499c-aada-579f8ad36c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:49.420712 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d94857-a13c-499c-aada-579f8ad36c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:49.421042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d94857-a13c-499c-aada-579f8ad36c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:49.421639 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d94857-a13c-499c-aada-579f8ad36c39 admin admin] PATH_INFO: `/v3/projects/7a05a2db8a50463181ddd711a9ef1b33` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:49.423996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d94857-a13c-499c-aada-579f8ad36c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a05a2db8a50463181ddd711a9ef1b33)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:49.427522 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d94857-a13c-499c-aada-579f8ad36c39 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:49.492321 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-56d94857-a13c-499c-aada-579f8ad36c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a05a2db8a50463181ddd711a9ef1b33', 'request_id': 'req-56d94857-a13c-499c-aada-579f8ad36c39'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:49.500650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-56d94857-a13c-499c-aada-579f8ad36c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a05a2db8a50463181ddd711a9ef1b33', 'request_id': 'req-56d94857-a13c-499c-aada-579f8ad36c39'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:49.510678 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-56d94857-a13c-499c-aada-579f8ad36c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a05a2db8a50463181ddd711a9ef1b33', 'request_id': 'req-56d94857-a13c-499c-aada-579f8ad36c39'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:49.526489 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-56d94857-a13c-499c-aada-579f8ad36c39 admin admin] The token cache is being invalidate because project 7a05a2db8a50463181ddd711a9ef1b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:49.527110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-56d94857-a13c-499c-aada-579f8ad36c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:49.527868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-56d94857-a13c-499c-aada-579f8ad36c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:49.530028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1241/2457] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:49 2022] DELETE /identity/v3/projects/7a05a2db8a50463181ddd711a9ef1b33 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:49.534213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716f1b8-1590-4327-a379-9525615aef5b service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:49.543998 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716f1b8-1590-4327-a379-9525615aef5b service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:49.617595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8754241-99f2-423b-a4a5-a90c59c07af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:49.618483 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8754241-99f2-423b-a4a5-a90c59c07af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:49.618787 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8754241-99f2-423b-a4a5-a90c59c07af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:49.619069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8754241-99f2-423b-a4a5-a90c59c07af3 admin admin] PATH_INFO: `/v3/users/5b17baf21beb41c18d3f9855614e2dc5` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:49.620269 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8754241-99f2-423b-a4a5-a90c59c07af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b17baf21beb41c18d3f9855614e2dc5)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:49.622162 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8754241-99f2-423b-a4a5-a90c59c07af3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:49.672993 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f8754241-99f2-423b-a4a5-a90c59c07af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b17baf21beb41c18d3f9855614e2dc5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:49.680475 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f8754241-99f2-423b-a4a5-a90c59c07af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b17baf21beb41c18d3f9855614e2dc5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:49.693400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f8754241-99f2-423b-a4a5-a90c59c07af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b17baf21beb41c18d3f9855614e2dc5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:49.704848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f8754241-99f2-423b-a4a5-a90c59c07af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b17baf21beb41c18d3f9855614e2dc5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:49.705514 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f8754241-99f2-423b-a4a5-a90c59c07af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b17baf21beb41c18d3f9855614e2dc5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:49.712072 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1217/2458] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:33:49 2022] DELETE /identity/v3/users/5b17baf21beb41c18d3f9855614e2dc5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:50.032149 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d94857-a13c-499c-aada-579f8ad36c39 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:50.033703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-56d94857-a13c-499c-aada-579f8ad36c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:50.048394 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d94857-a13c-499c-aada-579f8ad36c39 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:50.095026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:50.109828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a0677-0f1a-4841-80c5-0a3e48192d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:50.110713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a0677-0f1a-4841-80c5-0a3e48192d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:50.111027 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a0677-0f1a-4841-80c5-0a3e48192d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:50.111302 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a0677-0f1a-4841-80c5-0a3e48192d25 admin admin] PATH_INFO: `/v3/projects/2344c82d9ca54a5faf81a3c0cca07526` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:50.112495 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a0677-0f1a-4841-80c5-0a3e48192d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2344c82d9ca54a5faf81a3c0cca07526)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:50.114454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a0677-0f1a-4841-80c5-0a3e48192d25 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:50.161058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-128a0677-0f1a-4841-80c5-0a3e48192d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2344c82d9ca54a5faf81a3c0cca07526', 'request_id': 'req-128a0677-0f1a-4841-80c5-0a3e48192d25'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:50.166602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-128a0677-0f1a-4841-80c5-0a3e48192d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2344c82d9ca54a5faf81a3c0cca07526', 'request_id': 'req-128a0677-0f1a-4841-80c5-0a3e48192d25'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:50.174704 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-128a0677-0f1a-4841-80c5-0a3e48192d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2344c82d9ca54a5faf81a3c0cca07526', 'request_id': 'req-128a0677-0f1a-4841-80c5-0a3e48192d25'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:50.186040 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-128a0677-0f1a-4841-80c5-0a3e48192d25 admin admin] The token cache is being invalidate because project 2344c82d9ca54a5faf81a3c0cca07526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:33:50.186330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-128a0677-0f1a-4841-80c5-0a3e48192d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:50.187081 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-128a0677-0f1a-4841-80c5-0a3e48192d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:33:50.189188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1242/2459] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:33:50 2022] DELETE /identity/v3/projects/2344c82d9ca54a5faf81a3c0cca07526 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:33:50.195255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ec622-30b8-4923-9ab8-42f4de7df9d8 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:50.195548 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ec622-30b8-4923-9ab8-42f4de7df9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:50.195828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ec622-30b8-4923-9ab8-42f4de7df9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:50.213472 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-051ec622-30b8-4923-9ab8-42f4de7df9d8 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:50.214679 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-051ec622-30b8-4923-9ab8-42f4de7df9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:50.241771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:50.279397 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1218/2460] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:50.289597 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fecb5-3481-487f-ae38-65716e9cc5d7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:50.289885 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fecb5-3481-487f-ae38-65716e9cc5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:50.290167 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fecb5-3481-487f-ae38-65716e9cc5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:50.310631 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-696fecb5-3481-487f-ae38-65716e9cc5d7 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:50.311950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-696fecb5-3481-487f-ae38-65716e9cc5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:50.321134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1243/2461] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:50.328906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ec622-30b8-4923-9ab8-42f4de7df9d8 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:50.341604 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ec622-30b8-4923-9ab8-42f4de7df9d8 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:50.347440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8a683-041c-4128-897b-56ca6d4febf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:50.348120 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8a683-041c-4128-897b-56ca6d4febf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:50.348381 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8a683-041c-4128-897b-56ca6d4febf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:50.348656 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8a683-041c-4128-897b-56ca6d4febf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:50.349378 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8a683-041c-4128-897b-56ca6d4febf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:33:50.349679 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8a683-041c-4128-897b-56ca6d4febf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:50.351464 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8a683-041c-4128-897b-56ca6d4febf1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:50.364853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1219/2462] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:33:50.369135 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fecb5-3481-487f-ae38-65716e9cc5d7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:50.379137 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fecb5-3481-487f-ae38-65716e9cc5d7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:50.384142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85582e3c-4ef7-4493-b003-3f4a0a3e27c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:50.384802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85582e3c-4ef7-4493-b003-3f4a0a3e27c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:50.385078 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85582e3c-4ef7-4493-b003-3f4a0a3e27c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:50.385348 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85582e3c-4ef7-4493-b003-3f4a0a3e27c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:50.386038 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85582e3c-4ef7-4493-b003-3f4a0a3e27c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:50.388205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85582e3c-4ef7-4493-b003-3f4a0a3e27c4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:50.417417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1244/2463] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:33:50 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:33:50.421180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8a683-041c-4128-897b-56ca6d4febf1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:50.432946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8a683-041c-4128-897b-56ca6d4febf1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:50.497902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aceaca-ff9b-4594-bc87-4906d4c495b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:50.498592 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aceaca-ff9b-4594-bc87-4906d4c495b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:50.498963 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aceaca-ff9b-4594-bc87-4906d4c495b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:50.499248 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aceaca-ff9b-4594-bc87-4906d4c495b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:50.500034 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aceaca-ff9b-4594-bc87-4906d4c495b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:50.502110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aceaca-ff9b-4594-bc87-4906d4c495b8 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:50.522383 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1220/2464] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:33:50 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:33:50.526982 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85582e3c-4ef7-4493-b003-3f4a0a3e27c4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:50.538973 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85582e3c-4ef7-4493-b003-3f4a0a3e27c4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:50.543921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b862f-ee79-4f7f-a94c-6de6802f19d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:50.544684 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b862f-ee79-4f7f-a94c-6de6802f19d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:50.544964 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b862f-ee79-4f7f-a94c-6de6802f19d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:50.545270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b862f-ee79-4f7f-a94c-6de6802f19d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:50.546074 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b862f-ee79-4f7f-a94c-6de6802f19d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:50.548631 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b862f-ee79-4f7f-a94c-6de6802f19d7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:50.560169 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1245/2465] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:33:50.565059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aceaca-ff9b-4594-bc87-4906d4c495b8 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:50.575750 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aceaca-ff9b-4594-bc87-4906d4c495b8 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:50.580826 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce2c6d-6913-4793-a541-97899f408119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:50.581514 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce2c6d-6913-4793-a541-97899f408119 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:50.581792 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce2c6d-6913-4793-a541-97899f408119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:50.582063 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce2c6d-6913-4793-a541-97899f408119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:50.582827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce2c6d-6913-4793-a541-97899f408119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:50.584444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce2c6d-6913-4793-a541-97899f408119 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:50.596746 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1221/2466] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:33:50.600924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b862f-ee79-4f7f-a94c-6de6802f19d7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:50.613009 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b862f-ee79-4f7f-a94c-6de6802f19d7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:50.617765 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a79fe5-ec19-4300-9e37-7e4cfdf99d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:50.618659 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a79fe5-ec19-4300-9e37-7e4cfdf99d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:50.618976 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a79fe5-ec19-4300-9e37-7e4cfdf99d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:50.619248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a79fe5-ec19-4300-9e37-7e4cfdf99d2d admin admin] PATH_INFO: `/v3/projects/d385187e6b6f4e26b7db8ea232eafec8/users/d6bbccea1ea840d691cdd989e81dfeaa/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:50.635359 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a79fe5-ec19-4300-9e37-7e4cfdf99d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d385187e6b6f4e26b7db8ea232eafec8, user_id=d6bbccea1ea840d691cdd989e81dfeaa, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:50.638064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a79fe5-ec19-4300-9e37-7e4cfdf99d2d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:50.652875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1246/2467] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:33:50 2022] PUT /identity/v3/projects/d385187e6b6f4e26b7db8ea232eafec8/users/d6bbccea1ea840d691cdd989e81dfeaa/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:33:50.665578 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5371e-b475-4564-b2a5-b87ba5ca5c83 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:50.665932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5371e-b475-4564-b2a5-b87ba5ca5c83 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:50.666233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5371e-b475-4564-b2a5-b87ba5ca5c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:50.695681 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-81e5371e-b475-4564-b2a5-b87ba5ca5c83 None None] MFA Rules not processed for user `d6bbccea1ea840d691cdd989e81dfeaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:50.696815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-81e5371e-b475-4564-b2a5-b87ba5ca5c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:50.769741 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1222/2468] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:33:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:33:50.782197 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a79fe5-ec19-4300-9e37-7e4cfdf99d2d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:50.783946 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b4a79fe5-ec19-4300-9e37-7e4cfdf99d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:50.843968 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a79fe5-ec19-4300-9e37-7e4cfdf99d2d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:50.848398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11966b-b00b-41f1-a665-f9f7dbe6488a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:50.849171 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11966b-b00b-41f1-a665-f9f7dbe6488a service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:50.849468 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11966b-b00b-41f1-a665-f9f7dbe6488a service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:50.849836 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11966b-b00b-41f1-a665-f9f7dbe6488a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:50.859725 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11966b-b00b-41f1-a665-f9f7dbe6488a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:50.861277 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11966b-b00b-41f1-a665-f9f7dbe6488a service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:50.870951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1247/2469] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:53.503141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfa870-cd7c-4ff7-aeea-025391d80412 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:53.503871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfa870-cd7c-4ff7-aeea-025391d80412 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:53.503871 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfa870-cd7c-4ff7-aeea-025391d80412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:53.526163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-47dfa870-cd7c-4ff7-aeea-025391d80412 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:53.527650 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-47dfa870-cd7c-4ff7-aeea-025391d80412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:53.550179 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:53.594148 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1223/2470] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 19 12:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:53.612333 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11966b-b00b-41f1-a665-f9f7dbe6488a service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:53.614686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5f11966b-b00b-41f1-a665-f9f7dbe6488a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:53.638770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:53.703568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11966b-b00b-41f1-a665-f9f7dbe6488a service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:53.709304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87745e85-8015-4be1-82b5-ee443373596c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:53.710009 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87745e85-8015-4be1-82b5-ee443373596c service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:53.710269 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87745e85-8015-4be1-82b5-ee443373596c service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:53.710548 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87745e85-8015-4be1-82b5-ee443373596c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:53.720083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87745e85-8015-4be1-82b5-ee443373596c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:53.721688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87745e85-8015-4be1-82b5-ee443373596c service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:53.738975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1248/2471] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:33:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:33:57.555437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0ba58-2d5e-4e8c-8158-9a65cc36d760 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:57.556047 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0ba58-2d5e-4e8c-8158-9a65cc36d760 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:57.556303 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0ba58-2d5e-4e8c-8158-9a65cc36d760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:57.612991 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-bca0ba58-2d5e-4e8c-8158-9a65cc36d760 None None] MFA Rules not processed for user `18030043de1942779baf3ad94aec4071`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:57.614340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bca0ba58-2d5e-4e8c-8158-9a65cc36d760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:57.720926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1224/2472] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 19 12:33:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:57.738916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87745e85-8015-4be1-82b5-ee443373596c service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:57.741726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-87745e85-8015-4be1-82b5-ee443373596c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:57.897912 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87745e85-8015-4be1-82b5-ee443373596c service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:57.909458 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d46fc7-e5d8-4262-8246-e48831fb8ed6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc2e1079d34745a279588028945c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:57.910940 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d46fc7-e5d8-4262-8246-e48831fb8ed6 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:57.911435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d46fc7-e5d8-4262-8246-e48831fb8ed6 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:57.911901 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d46fc7-e5d8-4262-8246-e48831fb8ed6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:57.924824 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d46fc7-e5d8-4262-8246-e48831fb8ed6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:57.926690 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d46fc7-e5d8-4262-8246-e48831fb8ed6 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:57.941525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1249/2473] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 19 12:33:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 12:33:58.575212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5ecf6-c144-4e2d-b0f9-92e168e4f356 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:58.575698 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5ecf6-c144-4e2d-b0f9-92e168e4f356 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:58.575810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5ecf6-c144-4e2d-b0f9-92e168e4f356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:58.598413 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-1ee5ecf6-c144-4e2d-b0f9-92e168e4f356 None None] MFA Rules not processed for user `18030043de1942779baf3ad94aec4071`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:58.599857 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1ee5ecf6-c144-4e2d-b0f9-92e168e4f356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:58.608463 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1225/2474] 10.222.0.25 () {58 vars in 967 bytes} [Tue Jul 19 12:33:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:58.622047 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d46fc7-e5d8-4262-8246-e48831fb8ed6 service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:58.633479 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d46fc7-e5d8-4262-8246-e48831fb8ed6 service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:58.639063 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937dc02-48a2-4058-ad20-4e956730db91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc2e1079d34745a279588028945c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:58.639963 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937dc02-48a2-4058-ad20-4e956730db91 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:58.640174 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937dc02-48a2-4058-ad20-4e956730db91 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:58.640462 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937dc02-48a2-4058-ad20-4e956730db91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:58.650576 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937dc02-48a2-4058-ad20-4e956730db91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:58.652219 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937dc02-48a2-4058-ad20-4e956730db91 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:58.661240 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1250/2475] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 19 12:33:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:33:58.891205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd3987-16ed-4d3a-ac4d-b73045e87e66 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:58.891504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd3987-16ed-4d3a-ac4d-b73045e87e66 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:58.891777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd3987-16ed-4d3a-ac4d-b73045e87e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:58.910391 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-91cd3987-16ed-4d3a-ac4d-b73045e87e66 None None] MFA Rules not processed for user `18030043de1942779baf3ad94aec4071`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:58.911644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-91cd3987-16ed-4d3a-ac4d-b73045e87e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:58.919034 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1226/2476] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 19 12:33:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:58.931966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937dc02-48a2-4058-ad20-4e956730db91 service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:58.942821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937dc02-48a2-4058-ad20-4e956730db91 service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:58.947927 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84644c-c954-4775-b579-b473d719fedb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc2e1079d34745a279588028945c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:58.948564 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84644c-c954-4775-b579-b473d719fedb service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:58.948845 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84644c-c954-4775-b579-b473d719fedb service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:58.949122 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84644c-c954-4775-b579-b473d719fedb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:58.958353 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84644c-c954-4775-b579-b473d719fedb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:58.960022 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84644c-c954-4775-b579-b473d719fedb service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:58.968596 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1251/2477] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 19 12:33:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:33:59.324043 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a31713-9e1a-493f-9518-e06f8f737e87 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:59.324430 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a31713-9e1a-493f-9518-e06f8f737e87 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:59.324802 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a31713-9e1a-493f-9518-e06f8f737e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:59.344532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c4a31713-9e1a-493f-9518-e06f8f737e87 None None] MFA Rules not processed for user `18030043de1942779baf3ad94aec4071`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:59.345333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c4a31713-9e1a-493f-9518-e06f8f737e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:59.355755 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1227/2478] 10.222.0.25 () {58 vars in 967 bytes} [Tue Jul 19 12:33:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:59.368792 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84644c-c954-4775-b579-b473d719fedb service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:59.381079 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84644c-c954-4775-b579-b473d719fedb service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:59.386719 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca07c07-ecf0-4bc1-8444-3efe4eb2bc0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc2e1079d34745a279588028945c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:59.387630 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca07c07-ecf0-4bc1-8444-3efe4eb2bc0d service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:59.388031 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca07c07-ecf0-4bc1-8444-3efe4eb2bc0d service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:59.388402 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca07c07-ecf0-4bc1-8444-3efe4eb2bc0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:59.398335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca07c07-ecf0-4bc1-8444-3efe4eb2bc0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:59.400290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca07c07-ecf0-4bc1-8444-3efe4eb2bc0d service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:59.419180 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1252/2479] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 19 12:33:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 12:34:01.215729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96099960-56b1-4140-b38b-cdd8509d4eb2 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:01.216259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96099960-56b1-4140-b38b-cdd8509d4eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:01.216259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96099960-56b1-4140-b38b-cdd8509d4eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:01.234719 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-96099960-56b1-4140-b38b-cdd8509d4eb2 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:34:01.235946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-96099960-56b1-4140-b38b-cdd8509d4eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:01.243752 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1228/2480] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 19 12:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:34:01.271262 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca07c07-ecf0-4bc1-8444-3efe4eb2bc0d service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:01.284477 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca07c07-ecf0-4bc1-8444-3efe4eb2bc0d service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:01.291052 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578add2-9a41-4b9e-a350-dd6bb0f57728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:01.291776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578add2-9a41-4b9e-a350-dd6bb0f57728 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:01.292046 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578add2-9a41-4b9e-a350-dd6bb0f57728 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:01.292366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578add2-9a41-4b9e-a350-dd6bb0f57728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:01.301875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578add2-9a41-4b9e-a350-dd6bb0f57728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:01.303485 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578add2-9a41-4b9e-a350-dd6bb0f57728 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:01.314630 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1253/2481] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:34:01.717295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96099960-56b1-4140-b38b-cdd8509d4eb2 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:01.720297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-96099960-56b1-4140-b38b-cdd8509d4eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:01.734091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96099960-56b1-4140-b38b-cdd8509d4eb2 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:01.741108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc522176-a28c-44f4-87f9-b77b7aaac7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:01.741980 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc522176-a28c-44f4-87f9-b77b7aaac7f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:01.742256 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc522176-a28c-44f4-87f9-b77b7aaac7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:01.742523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc522176-a28c-44f4-87f9-b77b7aaac7f0 admin admin] PATH_INFO: `/v3/users/86b5138c0584453facfc07310f79dc2b` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:01.743759 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc522176-a28c-44f4-87f9-b77b7aaac7f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86b5138c0584453facfc07310f79dc2b)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:01.745725 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc522176-a28c-44f4-87f9-b77b7aaac7f0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:01.808250 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bc522176-a28c-44f4-87f9-b77b7aaac7f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86b5138c0584453facfc07310f79dc2b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:01.815699 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bc522176-a28c-44f4-87f9-b77b7aaac7f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86b5138c0584453facfc07310f79dc2b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:01.827962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bc522176-a28c-44f4-87f9-b77b7aaac7f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86b5138c0584453facfc07310f79dc2b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:01.835440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bc522176-a28c-44f4-87f9-b77b7aaac7f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86b5138c0584453facfc07310f79dc2b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:01.836126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bc522176-a28c-44f4-87f9-b77b7aaac7f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86b5138c0584453facfc07310f79dc2b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:01.842946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1229/2482] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:34:01 2022] DELETE /identity/v3/users/86b5138c0584453facfc07310f79dc2b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:34:01.848330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f862dab-c565-422f-8fcb-2f3d936e3349 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:01.848716 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f862dab-c565-422f-8fcb-2f3d936e3349 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:01.848996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f862dab-c565-422f-8fcb-2f3d936e3349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:01.868386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5f862dab-c565-422f-8fcb-2f3d936e3349 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:34:01.869611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5f862dab-c565-422f-8fcb-2f3d936e3349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:01.908482 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:01.938573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1254/2483] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:34:01.948310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc522176-a28c-44f4-87f9-b77b7aaac7f0 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:01.950310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bc522176-a28c-44f4-87f9-b77b7aaac7f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:01.973491 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:02.017690 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc522176-a28c-44f4-87f9-b77b7aaac7f0 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:02.021733 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865c6d5-46fd-422d-8d4b-db73efc9f3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:02.022401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865c6d5-46fd-422d-8d4b-db73efc9f3ef service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:02.022718 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865c6d5-46fd-422d-8d4b-db73efc9f3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:02.023021 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865c6d5-46fd-422d-8d4b-db73efc9f3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:02.034393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865c6d5-46fd-422d-8d4b-db73efc9f3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:02.035868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865c6d5-46fd-422d-8d4b-db73efc9f3ef service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:02.046989 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1230/2484] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:34:02.241195 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f862dab-c565-422f-8fcb-2f3d936e3349 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:02.242843 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5f862dab-c565-422f-8fcb-2f3d936e3349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:02.257226 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f862dab-c565-422f-8fcb-2f3d936e3349 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:02.262632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ac71a-d9ce-4489-9bbd-6817de902150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:02.263725 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ac71a-d9ce-4489-9bbd-6817de902150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:02.264162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ac71a-d9ce-4489-9bbd-6817de902150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:02.264585 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ac71a-d9ce-4489-9bbd-6817de902150 admin admin] PATH_INFO: `/v3/projects/8d0aae5945f64164857f554b913263a1` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:02.266593 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ac71a-d9ce-4489-9bbd-6817de902150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d0aae5945f64164857f554b913263a1)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:02.268834 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ac71a-d9ce-4489-9bbd-6817de902150 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:02.334610 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1d6ac71a-d9ce-4489-9bbd-6817de902150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d0aae5945f64164857f554b913263a1', 'request_id': 'req-1d6ac71a-d9ce-4489-9bbd-6817de902150'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:02.342875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1d6ac71a-d9ce-4489-9bbd-6817de902150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d0aae5945f64164857f554b913263a1', 'request_id': 'req-1d6ac71a-d9ce-4489-9bbd-6817de902150'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:02.354257 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1d6ac71a-d9ce-4489-9bbd-6817de902150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d0aae5945f64164857f554b913263a1', 'request_id': 'req-1d6ac71a-d9ce-4489-9bbd-6817de902150'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:02.369294 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1d6ac71a-d9ce-4489-9bbd-6817de902150 admin admin] The token cache is being invalidate because project 8d0aae5945f64164857f554b913263a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:34:02.369586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1d6ac71a-d9ce-4489-9bbd-6817de902150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:02.371499 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1d6ac71a-d9ce-4489-9bbd-6817de902150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:02.373272 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1255/2485] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:34:02 2022] DELETE /identity/v3/projects/8d0aae5945f64164857f554b913263a1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:34:03.474983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865c6d5-46fd-422d-8d4b-db73efc9f3ef service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:03.476404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a865c6d5-46fd-422d-8d4b-db73efc9f3ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:03.489428 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865c6d5-46fd-422d-8d4b-db73efc9f3ef service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:03.555573 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda54f47-dfd5-4a94-be97-f0c1f1b0c6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:03.556463 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda54f47-dfd5-4a94-be97-f0c1f1b0c6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:03.556746 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda54f47-dfd5-4a94-be97-f0c1f1b0c6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:03.557017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda54f47-dfd5-4a94-be97-f0c1f1b0c6f7 admin admin] PATH_INFO: `/v3/users/d6bbccea1ea840d691cdd989e81dfeaa` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:03.558253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda54f47-dfd5-4a94-be97-f0c1f1b0c6f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6bbccea1ea840d691cdd989e81dfeaa)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:03.560182 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda54f47-dfd5-4a94-be97-f0c1f1b0c6f7 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:03.614265 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fda54f47-dfd5-4a94-be97-f0c1f1b0c6f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6bbccea1ea840d691cdd989e81dfeaa'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:03.625456 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fda54f47-dfd5-4a94-be97-f0c1f1b0c6f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6bbccea1ea840d691cdd989e81dfeaa'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:03.649487 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fda54f47-dfd5-4a94-be97-f0c1f1b0c6f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6bbccea1ea840d691cdd989e81dfeaa'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:03.659284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fda54f47-dfd5-4a94-be97-f0c1f1b0c6f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6bbccea1ea840d691cdd989e81dfeaa'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:03.660483 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fda54f47-dfd5-4a94-be97-f0c1f1b0c6f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6bbccea1ea840d691cdd989e81dfeaa'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:03.669331 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1231/2486] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:34:03 2022] DELETE /identity/v3/users/d6bbccea1ea840d691cdd989e81dfeaa => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:34:03.674352 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32d723-e34f-45ca-b931-316b062797fa None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:03.675053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32d723-e34f-45ca-b931-316b062797fa None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:03.675342 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32d723-e34f-45ca-b931-316b062797fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:03.705954 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ee32d723-e34f-45ca-b931-316b062797fa None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:34:03.707205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ee32d723-e34f-45ca-b931-316b062797fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:03.778312 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1256/2487] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:34:03.789801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda54f47-dfd5-4a94-be97-f0c1f1b0c6f7 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:03.791278 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fda54f47-dfd5-4a94-be97-f0c1f1b0c6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:03.841946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:03.861828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda54f47-dfd5-4a94-be97-f0c1f1b0c6f7 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:03.865736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36024d1c-8d52-4066-b33c-066ea181793c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:03.866414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36024d1c-8d52-4066-b33c-066ea181793c service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:03.866677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36024d1c-8d52-4066-b33c-066ea181793c service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:03.866992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36024d1c-8d52-4066-b33c-066ea181793c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:03.878590 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36024d1c-8d52-4066-b33c-066ea181793c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:03.880477 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36024d1c-8d52-4066-b33c-066ea181793c service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:03.892423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1232/2488] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:34:04.308205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32d723-e34f-45ca-b931-316b062797fa None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:04.311089 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ee32d723-e34f-45ca-b931-316b062797fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:04.334365 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32d723-e34f-45ca-b931-316b062797fa None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:04.340307 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda8ad8-5e53-4398-94ee-1e5ab30a50a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:04.342759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda8ad8-5e53-4398-94ee-1e5ab30a50a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:04.343365 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda8ad8-5e53-4398-94ee-1e5ab30a50a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:04.344391 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda8ad8-5e53-4398-94ee-1e5ab30a50a6 admin admin] PATH_INFO: `/v3/projects/d385187e6b6f4e26b7db8ea232eafec8` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:04.346001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda8ad8-5e53-4398-94ee-1e5ab30a50a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d385187e6b6f4e26b7db8ea232eafec8)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:04.348248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda8ad8-5e53-4398-94ee-1e5ab30a50a6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:04.427422 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cdda8ad8-5e53-4398-94ee-1e5ab30a50a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd385187e6b6f4e26b7db8ea232eafec8', 'request_id': 'req-cdda8ad8-5e53-4398-94ee-1e5ab30a50a6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:04.435776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:04.437770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cdda8ad8-5e53-4398-94ee-1e5ab30a50a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd385187e6b6f4e26b7db8ea232eafec8', 'request_id': 'req-cdda8ad8-5e53-4398-94ee-1e5ab30a50a6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:04.450565 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cdda8ad8-5e53-4398-94ee-1e5ab30a50a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd385187e6b6f4e26b7db8ea232eafec8', 'request_id': 'req-cdda8ad8-5e53-4398-94ee-1e5ab30a50a6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:04.467802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cdda8ad8-5e53-4398-94ee-1e5ab30a50a6 admin admin] The token cache is being invalidate because project d385187e6b6f4e26b7db8ea232eafec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:34:04.469126 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cdda8ad8-5e53-4398-94ee-1e5ab30a50a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:04.470156 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cdda8ad8-5e53-4398-94ee-1e5ab30a50a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:04.482877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1257/2489] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:34:04 2022] DELETE /identity/v3/projects/d385187e6b6f4e26b7db8ea232eafec8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:34:08.128080 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36024d1c-8d52-4066-b33c-066ea181793c service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:08.129491 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-36024d1c-8d52-4066-b33c-066ea181793c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:08.148339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36024d1c-8d52-4066-b33c-066ea181793c service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:08.169899 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6716ee9-bd82-409e-9669-735644115aa3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:08.170447 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6716ee9-bd82-409e-9669-735644115aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:08.170447 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6716ee9-bd82-409e-9669-735644115aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:08.191856 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a6716ee9-bd82-409e-9669-735644115aa3 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:34:08.193237 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a6716ee9-bd82-409e-9669-735644115aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:08.223597 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d0423-8fc8-4e03-ba43-25dff6391c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:08.224783 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d0423-8fc8-4e03-ba43-25dff6391c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:08.225051 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d0423-8fc8-4e03-ba43-25dff6391c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:08.225325 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d0423-8fc8-4e03-ba43-25dff6391c09 admin admin] PATH_INFO: `/v3/users/470987def68645d7834bafeace3588c4` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:08.226558 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d0423-8fc8-4e03-ba43-25dff6391c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=470987def68645d7834bafeace3588c4)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:08.228623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d0423-8fc8-4e03-ba43-25dff6391c09 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:08.263689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1258/2490] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 19 12:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:34:08.279095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6716ee9-bd82-409e-9669-735644115aa3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:08.280501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a6716ee9-bd82-409e-9669-735644115aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:08.286559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-575d0423-8fc8-4e03-ba43-25dff6391c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '470987def68645d7834bafeace3588c4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:08.295668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-575d0423-8fc8-4e03-ba43-25dff6391c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '470987def68645d7834bafeace3588c4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:08.321403 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-575d0423-8fc8-4e03-ba43-25dff6391c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '470987def68645d7834bafeace3588c4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:08.332586 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-575d0423-8fc8-4e03-ba43-25dff6391c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '470987def68645d7834bafeace3588c4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:08.333236 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-575d0423-8fc8-4e03-ba43-25dff6391c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '470987def68645d7834bafeace3588c4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:08.340321 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1233/2491] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:34:08 2022] DELETE /identity/v3/users/470987def68645d7834bafeace3588c4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:34:08.344809 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42f671-9825-4504-b489-cfc14ab209fd None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:08.345118 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42f671-9825-4504-b489-cfc14ab209fd None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:08.345405 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42f671-9825-4504-b489-cfc14ab209fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:08.362973 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2f42f671-9825-4504-b489-cfc14ab209fd None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:34:08.364373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2f42f671-9825-4504-b489-cfc14ab209fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:08.367570 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6716ee9-bd82-409e-9669-735644115aa3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:08.456390 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd78f8a-4eb9-4445-bb06-a2ebe64ea366 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:08.457214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd78f8a-4eb9-4445-bb06-a2ebe64ea366 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:08.457589 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd78f8a-4eb9-4445-bb06-a2ebe64ea366 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:08.457981 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd78f8a-4eb9-4445-bb06-a2ebe64ea366 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:08.459677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1234/2492] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:34:08.460333 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dfd78f8a-4eb9-4445-bb06-a2ebe64ea366 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:08.473236 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42f671-9825-4504-b489-cfc14ab209fd None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:08.475813 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd78f8a-4eb9-4445-bb06-a2ebe64ea366 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:08.476174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2f42f671-9825-4504-b489-cfc14ab209fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:08.477621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd78f8a-4eb9-4445-bb06-a2ebe64ea366 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:08.482249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:08.489057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1259/2493] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:34:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:34:08.556371 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42f671-9825-4504-b489-cfc14ab209fd None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:08.561403 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c72e56-af53-4a01-96f8-0c56f61437a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:08.562712 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c72e56-af53-4a01-96f8-0c56f61437a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:08.563083 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c72e56-af53-4a01-96f8-0c56f61437a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:08.563371 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c72e56-af53-4a01-96f8-0c56f61437a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:08.581088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c72e56-af53-4a01-96f8-0c56f61437a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:08.582684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c72e56-af53-4a01-96f8-0c56f61437a1 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:08.596724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1235/2494] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:34:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:34:09.153302 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd78f8a-4eb9-4445-bb06-a2ebe64ea366 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:09.154869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dfd78f8a-4eb9-4445-bb06-a2ebe64ea366 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:09.179071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd78f8a-4eb9-4445-bb06-a2ebe64ea366 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:09.193787 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59675bfd-7d1f-4263-bfd6-9f5c67dc2e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:09.194767 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59675bfd-7d1f-4263-bfd6-9f5c67dc2e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:09.195767 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59675bfd-7d1f-4263-bfd6-9f5c67dc2e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:09.196052 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59675bfd-7d1f-4263-bfd6-9f5c67dc2e39 admin admin] PATH_INFO: `/v3/projects/9e9358361aef457c8029d2ac74b6a1fc` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:09.200923 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59675bfd-7d1f-4263-bfd6-9f5c67dc2e39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9358361aef457c8029d2ac74b6a1fc)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:09.203490 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59675bfd-7d1f-4263-bfd6-9f5c67dc2e39 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:09.206342 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:09.283093 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-59675bfd-7d1f-4263-bfd6-9f5c67dc2e39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9358361aef457c8029d2ac74b6a1fc', 'request_id': 'req-59675bfd-7d1f-4263-bfd6-9f5c67dc2e39'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:09.290719 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-59675bfd-7d1f-4263-bfd6-9f5c67dc2e39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9358361aef457c8029d2ac74b6a1fc', 'request_id': 'req-59675bfd-7d1f-4263-bfd6-9f5c67dc2e39'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:09.303798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-59675bfd-7d1f-4263-bfd6-9f5c67dc2e39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9358361aef457c8029d2ac74b6a1fc', 'request_id': 'req-59675bfd-7d1f-4263-bfd6-9f5c67dc2e39'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:09.319604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-59675bfd-7d1f-4263-bfd6-9f5c67dc2e39 admin admin] The token cache is being invalidate because project 9e9358361aef457c8029d2ac74b6a1fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:34:09.320209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-59675bfd-7d1f-4263-bfd6-9f5c67dc2e39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:09.320981 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-59675bfd-7d1f-4263-bfd6-9f5c67dc2e39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:09.325857 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1260/2495] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:34:09 2022] DELETE /identity/v3/projects/9e9358361aef457c8029d2ac74b6a1fc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:34:09.328369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60068a-f4f1-48eb-a502-d8da89b38998 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:09.328946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60068a-f4f1-48eb-a502-d8da89b38998 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:09.329088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60068a-f4f1-48eb-a502-d8da89b38998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:09.349039 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ce60068a-f4f1-48eb-a502-d8da89b38998 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:34:09.350441 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ce60068a-f4f1-48eb-a502-d8da89b38998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:09.427279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1236/2496] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:34:09.435430 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50536208-c51f-45f6-87e0-d333c617c16c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:09.435720 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50536208-c51f-45f6-87e0-d333c617c16c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:09.435997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50536208-c51f-45f6-87e0-d333c617c16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:09.455399 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-50536208-c51f-45f6-87e0-d333c617c16c None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:34:09.456693 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-50536208-c51f-45f6-87e0-d333c617c16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:09.465848 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1261/2497] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:34:09.470258 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60068a-f4f1-48eb-a502-d8da89b38998 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:09.480954 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60068a-f4f1-48eb-a502-d8da89b38998 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:09.486594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30b54c-1c7a-4d38-95e4-d012b7956e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:09.487309 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30b54c-1c7a-4d38-95e4-d012b7956e45 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:09.487591 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30b54c-1c7a-4d38-95e4-d012b7956e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:09.487864 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30b54c-1c7a-4d38-95e4-d012b7956e45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:09.488593 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30b54c-1c7a-4d38-95e4-d012b7956e45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:34:09.488911 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30b54c-1c7a-4d38-95e4-d012b7956e45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:09.490600 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30b54c-1c7a-4d38-95e4-d012b7956e45 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:09.502969 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1237/2498] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:34:09.507570 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50536208-c51f-45f6-87e0-d333c617c16c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:09.518781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50536208-c51f-45f6-87e0-d333c617c16c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:09.524248 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea25eb-9597-43c5-b372-caf62843e914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:09.525013 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea25eb-9597-43c5-b372-caf62843e914 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:09.525395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea25eb-9597-43c5-b372-caf62843e914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:09.525784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea25eb-9597-43c5-b372-caf62843e914 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:09.526541 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea25eb-9597-43c5-b372-caf62843e914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:09.528525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea25eb-9597-43c5-b372-caf62843e914 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:09.557609 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1262/2499] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:34:09 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:34:09.562195 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30b54c-1c7a-4d38-95e4-d012b7956e45 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:09.572746 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30b54c-1c7a-4d38-95e4-d012b7956e45 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:09.632218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003354e7-a646-43cd-82bb-168a5be2e389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:09.632896 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003354e7-a646-43cd-82bb-168a5be2e389 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:09.633183 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003354e7-a646-43cd-82bb-168a5be2e389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:09.633458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003354e7-a646-43cd-82bb-168a5be2e389 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:09.634144 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003354e7-a646-43cd-82bb-168a5be2e389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:09.636267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003354e7-a646-43cd-82bb-168a5be2e389 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:09.658529 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1238/2500] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:34:09 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:34:09.662334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea25eb-9597-43c5-b372-caf62843e914 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:09.673149 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea25eb-9597-43c5-b372-caf62843e914 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:09.677896 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d3411-34fb-4592-bb64-765647c189f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:09.678568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d3411-34fb-4592-bb64-765647c189f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:09.678879 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d3411-34fb-4592-bb64-765647c189f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:09.679159 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d3411-34fb-4592-bb64-765647c189f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:09.679890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d3411-34fb-4592-bb64-765647c189f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:09.681482 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d3411-34fb-4592-bb64-765647c189f2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:09.693366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1263/2501] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:34:09.697587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003354e7-a646-43cd-82bb-168a5be2e389 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:09.708495 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003354e7-a646-43cd-82bb-168a5be2e389 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:09.713282 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19d7e4-ed0d-4c42-ba19-35cf2b0c08f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:09.713946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19d7e4-ed0d-4c42-ba19-35cf2b0c08f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:09.714231 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19d7e4-ed0d-4c42-ba19-35cf2b0c08f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:09.714598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19d7e4-ed0d-4c42-ba19-35cf2b0c08f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:09.715524 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19d7e4-ed0d-4c42-ba19-35cf2b0c08f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:09.717003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19d7e4-ed0d-4c42-ba19-35cf2b0c08f0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:09.728534 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1239/2502] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:34:09.732518 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d3411-34fb-4592-bb64-765647c189f2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:09.745541 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d3411-34fb-4592-bb64-765647c189f2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:09.757097 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde09b4-c0c8-4fc8-9ffd-5e6cfabbfe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:09.759019 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde09b4-c0c8-4fc8-9ffd-5e6cfabbfe72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:09.759306 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde09b4-c0c8-4fc8-9ffd-5e6cfabbfe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:09.759582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde09b4-c0c8-4fc8-9ffd-5e6cfabbfe72 admin admin] PATH_INFO: `/v3/projects/c9b163920ec14ac98048b5ec1731b322/users/a5d22bbf9e3c4b48a9305b17c22b79d1/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:09.776755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde09b4-c0c8-4fc8-9ffd-5e6cfabbfe72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b163920ec14ac98048b5ec1731b322, user_id=a5d22bbf9e3c4b48a9305b17c22b79d1, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:09.779437 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde09b4-c0c8-4fc8-9ffd-5e6cfabbfe72 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:09.793556 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1264/2503] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:34:09 2022] PUT /identity/v3/projects/c9b163920ec14ac98048b5ec1731b322/users/a5d22bbf9e3c4b48a9305b17c22b79d1/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:34:09.805031 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e7e46-564b-4dc8-880e-f81ffcb3e0b2 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:09.805394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e7e46-564b-4dc8-880e-f81ffcb3e0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:09.805747 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e7e46-564b-4dc8-880e-f81ffcb3e0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:09.825904 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:09.835600 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-736e7e46-564b-4dc8-880e-f81ffcb3e0b2 None None] MFA Rules not processed for user `a5d22bbf9e3c4b48a9305b17c22b79d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:34:09.837318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-736e7e46-564b-4dc8-880e-f81ffcb3e0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:09.909223 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1240/2504] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:34:09.922163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde09b4-c0c8-4fc8-9ffd-5e6cfabbfe72 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:09.924157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1bde09b4-c0c8-4fc8-9ffd-5e6cfabbfe72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:09.983686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde09b4-c0c8-4fc8-9ffd-5e6cfabbfe72 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:09.987545 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97234a-c6f8-4ab1-84dc-17c2aef9035b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:09.988219 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97234a-c6f8-4ab1-84dc-17c2aef9035b service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:09.988496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97234a-c6f8-4ab1-84dc-17c2aef9035b service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:09.988767 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97234a-c6f8-4ab1-84dc-17c2aef9035b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:09.997592 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97234a-c6f8-4ab1-84dc-17c2aef9035b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:09.999066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97234a-c6f8-4ab1-84dc-17c2aef9035b service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:10.010361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1265/2505] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:34:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:34:10.299653 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518217de-d089-46eb-99d9-037500512705 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:10.300464 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518217de-d089-46eb-99d9-037500512705 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:10.300956 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518217de-d089-46eb-99d9-037500512705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:10.351826 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-518217de-d089-46eb-99d9-037500512705 None None] MFA Rules not processed for user `7713fb28e4884d4e903a40b867347b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:34:10.353057 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-518217de-d089-46eb-99d9-037500512705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:10.438765 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1241/2506] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:34:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:34:14.482007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97234a-c6f8-4ab1-84dc-17c2aef9035b service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:14.484077 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5d97234a-c6f8-4ab1-84dc-17c2aef9035b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:14.487685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de2326-cfce-4ce5-bf75-c6e0d0fe8a73 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:14.488156 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de2326-cfce-4ce5-bf75-c6e0d0fe8a73 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:14.488248 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de2326-cfce-4ce5-bf75-c6e0d0fe8a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:14.530618 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-47de2326-cfce-4ce5-bf75-c6e0d0fe8a73 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:34:14.532174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-47de2326-cfce-4ce5-bf75-c6e0d0fe8a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:14.538584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:14.595685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97234a-c6f8-4ab1-84dc-17c2aef9035b service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:14.600037 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841f23-da71-49c2-add6-6881cec5288c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:14.600786 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841f23-da71-49c2-add6-6881cec5288c service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:14.601213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841f23-da71-49c2-add6-6881cec5288c service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:14.601836 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841f23-da71-49c2-add6-6881cec5288c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:14.605077 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0f841f23-da71-49c2-add6-6881cec5288c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:14.609968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1242/2507] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 19 12:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:34:14.623854 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de2326-cfce-4ce5-bf75-c6e0d0fe8a73 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:14.626004 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-47de2326-cfce-4ce5-bf75-c6e0d0fe8a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:14.682860 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f841f23-da71-49c2-add6-6881cec5288c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:14.683965 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:14.689700 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f841f23-da71-49c2-add6-6881cec5288c service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:14.703807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1266/2508] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:34:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:34:14.722861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de2326-cfce-4ce5-bf75-c6e0d0fe8a73 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:14.729763 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da8cc4-0302-4275-9f45-5f58e006fb01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:14.730485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da8cc4-0302-4275-9f45-5f58e006fb01 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:14.730902 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da8cc4-0302-4275-9f45-5f58e006fb01 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:14.731423 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da8cc4-0302-4275-9f45-5f58e006fb01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:14.741856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da8cc4-0302-4275-9f45-5f58e006fb01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:14.743638 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da8cc4-0302-4275-9f45-5f58e006fb01 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:14.758357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1243/2509] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:34:18.239019 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841f23-da71-49c2-add6-6881cec5288c service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:18.240492 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0f841f23-da71-49c2-add6-6881cec5288c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:18.349973 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841f23-da71-49c2-add6-6881cec5288c service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:18.355837 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f751ed-3e1a-4f51-a74c-f31e09c4b74a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:18.356762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f751ed-3e1a-4f51-a74c-f31e09c4b74a service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:18.357249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f751ed-3e1a-4f51-a74c-f31e09c4b74a service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:18.357728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f751ed-3e1a-4f51-a74c-f31e09c4b74a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:18.360617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-44f751ed-3e1a-4f51-a74c-f31e09c4b74a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:18.375008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f751ed-3e1a-4f51-a74c-f31e09c4b74a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:18.382916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f751ed-3e1a-4f51-a74c-f31e09c4b74a service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:18.397893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1267/2510] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:34:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:34:18.803308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d5677-c74a-4529-b79e-18102b83a4d9 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:18.803810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d5677-c74a-4529-b79e-18102b83a4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:18.804026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d5677-c74a-4529-b79e-18102b83a4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:18.831893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-443d5677-c74a-4529-b79e-18102b83a4d9 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:34:18.833192 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-443d5677-c74a-4529-b79e-18102b83a4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:18.842130 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1244/2511] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 19 12:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:34:18.864519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f751ed-3e1a-4f51-a74c-f31e09c4b74a service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:18.886296 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f751ed-3e1a-4f51-a74c-f31e09c4b74a service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:18.900219 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd8c68-c47a-4afd-8cf4-06bba10bbeca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:18.901145 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd8c68-c47a-4afd-8cf4-06bba10bbeca service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:18.901824 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd8c68-c47a-4afd-8cf4-06bba10bbeca service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:18.902397 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd8c68-c47a-4afd-8cf4-06bba10bbeca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:18.917602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd8c68-c47a-4afd-8cf4-06bba10bbeca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:18.920268 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd8c68-c47a-4afd-8cf4-06bba10bbeca service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:18.937319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1268/2512] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:34:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:34:28.822348 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=16 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:28.929858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=74 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:38.444408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c514ba-38ec-4910-8764-9993af25f8ee None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:38.444985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c514ba-38ec-4910-8764-9993af25f8ee None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:38.444985 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c514ba-38ec-4910-8764-9993af25f8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:38.463281 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c8c514ba-38ec-4910-8764-9993af25f8ee None None] MFA Rules not processed for user `57a9728196524510927fb531fdbef19b`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:34:38.464860 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c8c514ba-38ec-4910-8764-9993af25f8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:38.525539 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1245/2513] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:34:48.518883 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=25 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:48.708114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd8c68-c47a-4afd-8cf4-06bba10bbeca service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:48.718018 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd8c68-c47a-4afd-8cf4-06bba10bbeca service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:48.723222 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9e725-a376-4c35-948f-a683d56c473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:48.724110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9e725-a376-4c35-948f-a683d56c473c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:48.724386 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9e725-a376-4c35-948f-a683d56c473c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:48.724654 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9e725-a376-4c35-948f-a683d56c473c admin admin] PATH_INFO: `/v3/users/a5d22bbf9e3c4b48a9305b17c22b79d1` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:48.725884 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9e725-a376-4c35-948f-a683d56c473c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d22bbf9e3c4b48a9305b17c22b79d1)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:48.727821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9e725-a376-4c35-948f-a683d56c473c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:48.777381 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5bc9e725-a376-4c35-948f-a683d56c473c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d22bbf9e3c4b48a9305b17c22b79d1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:48.784353 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5bc9e725-a376-4c35-948f-a683d56c473c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d22bbf9e3c4b48a9305b17c22b79d1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:48.795871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5bc9e725-a376-4c35-948f-a683d56c473c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d22bbf9e3c4b48a9305b17c22b79d1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:48.803410 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5bc9e725-a376-4c35-948f-a683d56c473c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d22bbf9e3c4b48a9305b17c22b79d1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:48.804021 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5bc9e725-a376-4c35-948f-a683d56c473c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d22bbf9e3c4b48a9305b17c22b79d1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:48.809950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1269/2514] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:34:48 2022] DELETE /identity/v3/users/a5d22bbf9e3c4b48a9305b17c22b79d1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:34:48.815645 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3126e-14f8-43ff-b706-36511f5503b6 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:48.815938 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3126e-14f8-43ff-b706-36511f5503b6 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:48.816214 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3126e-14f8-43ff-b706-36511f5503b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:48.834269 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-1ac3126e-14f8-43ff-b706-36511f5503b6 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:34:48.835497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1ac3126e-14f8-43ff-b706-36511f5503b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:48.895875 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1246/2515] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:34:48.905663 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9e725-a376-4c35-948f-a683d56c473c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:48.907232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5bc9e725-a376-4c35-948f-a683d56c473c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:48.966578 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9e725-a376-4c35-948f-a683d56c473c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:48.970112 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae806cbd-c4cd-4a40-8d31-b62c363c26c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:48.970803 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae806cbd-c4cd-4a40-8d31-b62c363c26c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:48.971090 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae806cbd-c4cd-4a40-8d31-b62c363c26c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:48.971359 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae806cbd-c4cd-4a40-8d31-b62c363c26c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:48.980315 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae806cbd-c4cd-4a40-8d31-b62c363c26c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:48.981721 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae806cbd-c4cd-4a40-8d31-b62c363c26c1 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:48.991419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1270/2516] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:34:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:34:49.261940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3126e-14f8-43ff-b706-36511f5503b6 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:49.263379 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1ac3126e-14f8-43ff-b706-36511f5503b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:49.275687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3126e-14f8-43ff-b706-36511f5503b6 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:49.280401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18143989-54bb-4ea8-adaf-fe2d2bfb6d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:49.281267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18143989-54bb-4ea8-adaf-fe2d2bfb6d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:49.281548 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18143989-54bb-4ea8-adaf-fe2d2bfb6d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:49.281819 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18143989-54bb-4ea8-adaf-fe2d2bfb6d2b admin admin] PATH_INFO: `/v3/projects/c9b163920ec14ac98048b5ec1731b322` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:49.283047 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18143989-54bb-4ea8-adaf-fe2d2bfb6d2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b163920ec14ac98048b5ec1731b322)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:49.285158 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18143989-54bb-4ea8-adaf-fe2d2bfb6d2b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:49.334043 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-18143989-54bb-4ea8-adaf-fe2d2bfb6d2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b163920ec14ac98048b5ec1731b322', 'request_id': 'req-18143989-54bb-4ea8-adaf-fe2d2bfb6d2b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:49.339591 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-18143989-54bb-4ea8-adaf-fe2d2bfb6d2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b163920ec14ac98048b5ec1731b322', 'request_id': 'req-18143989-54bb-4ea8-adaf-fe2d2bfb6d2b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:49.346967 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-18143989-54bb-4ea8-adaf-fe2d2bfb6d2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b163920ec14ac98048b5ec1731b322', 'request_id': 'req-18143989-54bb-4ea8-adaf-fe2d2bfb6d2b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:49.358224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-18143989-54bb-4ea8-adaf-fe2d2bfb6d2b admin admin] The token cache is being invalidate because project c9b163920ec14ac98048b5ec1731b322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:34:49.358513 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-18143989-54bb-4ea8-adaf-fe2d2bfb6d2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:49.359166 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-18143989-54bb-4ea8-adaf-fe2d2bfb6d2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:34:49.372648 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1247/2517] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:34:49 2022] DELETE /identity/v3/projects/c9b163920ec14ac98048b5ec1731b322 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:34:53.399519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0b157-0c63-4cbd-82b9-424cb2238d03 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:53.400028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0b157-0c63-4cbd-82b9-424cb2238d03 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:53.400142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0b157-0c63-4cbd-82b9-424cb2238d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:53.417455 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cec0b157-0c63-4cbd-82b9-424cb2238d03 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:34:53.418638 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cec0b157-0c63-4cbd-82b9-424cb2238d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:53.478714 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1271/2518] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 19 12:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:34:53.495717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18143989-54bb-4ea8-adaf-fe2d2bfb6d2b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:53.497169 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-18143989-54bb-4ea8-adaf-fe2d2bfb6d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:53.570729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18143989-54bb-4ea8-adaf-fe2d2bfb6d2b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:53.576169 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bca37-c247-4d3e-b021-f2d1f192d425 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:53.576807 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bca37-c247-4d3e-b021-f2d1f192d425 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:53.577087 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bca37-c247-4d3e-b021-f2d1f192d425 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:53.577357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bca37-c247-4d3e-b021-f2d1f192d425 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:53.585481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bca37-c247-4d3e-b021-f2d1f192d425 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:53.587182 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bca37-c247-4d3e-b021-f2d1f192d425 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:53.596485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1248/2519] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:34:57.675120 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca7196-1707-4784-8c5b-6e4df5c4ba58 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:57.675634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca7196-1707-4784-8c5b-6e4df5c4ba58 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:57.675760 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca7196-1707-4784-8c5b-6e4df5c4ba58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:57.693781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-97ca7196-1707-4784-8c5b-6e4df5c4ba58 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:34:57.695039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-97ca7196-1707-4784-8c5b-6e4df5c4ba58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:57.702986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1272/2520] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 19 12:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:34:57.722971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bca37-c247-4d3e-b021-f2d1f192d425 service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:57.724346 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-700bca37-c247-4d3e-b021-f2d1f192d425 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:57.740063 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bca37-c247-4d3e-b021-f2d1f192d425 service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:57.745644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eda66f-7ef8-426e-a7f1-92ac183efb10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:57.746281 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda66f-7ef8-426e-a7f1-92ac183efb10 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:57.746562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda66f-7ef8-426e-a7f1-92ac183efb10 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:57.746866 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda66f-7ef8-426e-a7f1-92ac183efb10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:57.753209 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:57.755798 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eda66f-7ef8-426e-a7f1-92ac183efb10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:57.758463 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eda66f-7ef8-426e-a7f1-92ac183efb10 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:57.770159 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1249/2521] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:34:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:35:01.776184 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7fc32-15af-4521-a017-f9c2f5b17000 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:35:01.776700 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7fc32-15af-4521-a017-f9c2f5b17000 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:35:01.776800 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7fc32-15af-4521-a017-f9c2f5b17000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:35:01.794420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c5d7fc32-15af-4521-a017-f9c2f5b17000 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:35:01.795626 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c5d7fc32-15af-4521-a017-f9c2f5b17000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:35:01.804088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1273/2522] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 19 12:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:35:01.820824 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eda66f-7ef8-426e-a7f1-92ac183efb10 service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:35:01.832148 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eda66f-7ef8-426e-a7f1-92ac183efb10 service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:35:01.837505 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ced4d-e0db-4212-bd1b-89d7c267d7ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:35:01.838159 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ced4d-e0db-4212-bd1b-89d7c267d7ce service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:35:01.838438 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ced4d-e0db-4212-bd1b-89d7c267d7ce service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:35:01.838709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ced4d-e0db-4212-bd1b-89d7c267d7ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:35:01.846922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ced4d-e0db-4212-bd1b-89d7c267d7ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:35:01.848474 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ced4d-e0db-4212-bd1b-89d7c267d7ce service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:35:01.857715 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1250/2523] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:35:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:35:05.942555 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a413069-991a-468e-8f15-0feaac514bb6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:35:05.943086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a413069-991a-468e-8f15-0feaac514bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:35:05.943183 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a413069-991a-468e-8f15-0feaac514bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:35:05.949403 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:35:05.964603 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5a413069-991a-468e-8f15-0feaac514bb6 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:35:05.965740 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5a413069-991a-468e-8f15-0feaac514bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:35:05.974175 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1274/2524] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 19 12:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:35:05.990945 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ced4d-e0db-4212-bd1b-89d7c267d7ce service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:35:06.002933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ced4d-e0db-4212-bd1b-89d7c267d7ce service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:35:06.008372 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0be7ff-85ce-426a-a7c9-9be9f408e249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:35:06.009018 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0be7ff-85ce-426a-a7c9-9be9f408e249 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:35:06.009287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0be7ff-85ce-426a-a7c9-9be9f408e249 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:35:06.009553 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0be7ff-85ce-426a-a7c9-9be9f408e249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:35:06.017541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0be7ff-85ce-426a-a7c9-9be9f408e249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:35:06.020042 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0be7ff-85ce-426a-a7c9-9be9f408e249 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:35:06.029465 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1251/2525] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:35:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:35:10.143418 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f748d-5a62-477b-b4d6-d7654b471a21 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:35:10.144182 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f748d-5a62-477b-b4d6-d7654b471a21 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:35:10.144299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f748d-5a62-477b-b4d6-d7654b471a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:35:10.161801 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d84f748d-5a62-477b-b4d6-d7654b471a21 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:35:10.163029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d84f748d-5a62-477b-b4d6-d7654b471a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:35:10.170822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1275/2526] 10.222.0.27 () {58 vars in 1016 bytes} [Tue Jul 19 12:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:35:10.185151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0be7ff-85ce-426a-a7c9-9be9f408e249 service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:35:10.196761 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0be7ff-85ce-426a-a7c9-9be9f408e249 service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:35:10.202264 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ba3cc-1e89-4219-adf2-1f6c41e6d9f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:35:10.202935 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ba3cc-1e89-4219-adf2-1f6c41e6d9f7 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:35:10.203219 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ba3cc-1e89-4219-adf2-1f6c41e6d9f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:35:10.203494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ba3cc-1e89-4219-adf2-1f6c41e6d9f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:35:10.211933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ba3cc-1e89-4219-adf2-1f6c41e6d9f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:35:10.213493 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ba3cc-1e89-4219-adf2-1f6c41e6d9f7 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:35:10.223505 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1252/2527] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:35:20.156730 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:35:20.218801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=20 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:35:41.518047 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f748d-5a62-477b-b4d6-d7654b471a21 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:35:41.520019 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d84f748d-5a62-477b-b4d6-d7654b471a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:35:41.534270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f748d-5a62-477b-b4d6-d7654b471a21 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:35:41.539528 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c40c5-60f5-489c-9fd2-a84d683f4e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:35:41.540427 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c40c5-60f5-489c-9fd2-a84d683f4e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:35:41.540710 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c40c5-60f5-489c-9fd2-a84d683f4e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:35:41.540976 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c40c5-60f5-489c-9fd2-a84d683f4e31 admin admin] PATH_INFO: `/v3/users/57a9728196524510927fb531fdbef19b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:35:41.542243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c40c5-60f5-489c-9fd2-a84d683f4e31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a9728196524510927fb531fdbef19b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:35:41.544231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c40c5-60f5-489c-9fd2-a84d683f4e31 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:35:41.591714 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-743c40c5-60f5-489c-9fd2-a84d683f4e31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a9728196524510927fb531fdbef19b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:35:41.598748 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-743c40c5-60f5-489c-9fd2-a84d683f4e31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a9728196524510927fb531fdbef19b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:35:41.610379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-743c40c5-60f5-489c-9fd2-a84d683f4e31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a9728196524510927fb531fdbef19b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:35:41.617932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-743c40c5-60f5-489c-9fd2-a84d683f4e31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a9728196524510927fb531fdbef19b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:35:41.618546 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-743c40c5-60f5-489c-9fd2-a84d683f4e31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a9728196524510927fb531fdbef19b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:35:41.624677 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1276/2528] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:35:41 2022] DELETE /identity/v3/users/57a9728196524510927fb531fdbef19b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:35:41.802928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ba3cc-1e89-4219-adf2-1f6c41e6d9f7 service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:35:41.814036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ba3cc-1e89-4219-adf2-1f6c41e6d9f7 service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:35:41.872909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b0329-b761-4c3b-8b62-acea5758b045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:35:41.873768 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b0329-b761-4c3b-8b62-acea5758b045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:35:41.874049 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b0329-b761-4c3b-8b62-acea5758b045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:35:41.874322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b0329-b761-4c3b-8b62-acea5758b045 admin admin] PATH_INFO: `/v3/projects/e839334d43534fe78bbad9ee78f8a10b` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:35:41.875575 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b0329-b761-4c3b-8b62-acea5758b045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e839334d43534fe78bbad9ee78f8a10b)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:35:41.877491 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b0329-b761-4c3b-8b62-acea5758b045 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:35:41.925003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-269b0329-b761-4c3b-8b62-acea5758b045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e839334d43534fe78bbad9ee78f8a10b', 'request_id': 'req-269b0329-b761-4c3b-8b62-acea5758b045'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:35:41.930431 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-269b0329-b761-4c3b-8b62-acea5758b045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e839334d43534fe78bbad9ee78f8a10b', 'request_id': 'req-269b0329-b761-4c3b-8b62-acea5758b045'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:35:41.937771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-269b0329-b761-4c3b-8b62-acea5758b045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e839334d43534fe78bbad9ee78f8a10b', 'request_id': 'req-269b0329-b761-4c3b-8b62-acea5758b045'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:35:41.949189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-269b0329-b761-4c3b-8b62-acea5758b045 admin admin] The token cache is being invalidate because project e839334d43534fe78bbad9ee78f8a10b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:35:41.949471 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-269b0329-b761-4c3b-8b62-acea5758b045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:35:41.950103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-269b0329-b761-4c3b-8b62-acea5758b045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:35:41.951691 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1253/2529] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:35:41 2022] DELETE /identity/v3/projects/e839334d43534fe78bbad9ee78f8a10b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:35:51.620914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:35:51.946206 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:36:00.566476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f37b1-0448-469f-a84a-a263ffcf9363 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:36:00.566983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f37b1-0448-469f-a84a-a263ffcf9363 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:36:00.567094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f37b1-0448-469f-a84a-a263ffcf9363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:36:00.584329 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0b4f37b1-0448-469f-a84a-a263ffcf9363 None None] MFA Rules not processed for user `2410dc00847f42eb853780b399950899`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:36:00.585551 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0b4f37b1-0448-469f-a84a-a263ffcf9363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:36:00.640626 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1277/2530] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:36:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:36:10.634017 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=25 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:36:16.935845 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea063e5-a8bc-4abc-9256-070bb08128a7 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:36:16.936373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea063e5-a8bc-4abc-9256-070bb08128a7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:36:16.936489 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea063e5-a8bc-4abc-9256-070bb08128a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:36:16.954495 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6ea063e5-a8bc-4abc-9256-070bb08128a7 None None] MFA Rules not processed for user `7713fb28e4884d4e903a40b867347b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:36:16.955733 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6ea063e5-a8bc-4abc-9256-070bb08128a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:36:17.010144 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1254/2531] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:36:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:36:18.737034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f37b1-0448-469f-a84a-a263ffcf9363 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:36:18.738644 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0b4f37b1-0448-469f-a84a-a263ffcf9363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:36:18.806191 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f37b1-0448-469f-a84a-a263ffcf9363 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:36:18.811798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f067271-4ef5-4fce-84cc-99decf185139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:36:18.812683 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f067271-4ef5-4fce-84cc-99decf185139 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:36:18.813102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f067271-4ef5-4fce-84cc-99decf185139 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:36:18.814265 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f067271-4ef5-4fce-84cc-99decf185139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:36:18.816922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9f067271-4ef5-4fce-84cc-99decf185139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:36:18.901940 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f067271-4ef5-4fce-84cc-99decf185139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:36:18.904034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f067271-4ef5-4fce-84cc-99decf185139 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:36:18.917348 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1278/2532] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:36:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:36:20.052617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea063e5-a8bc-4abc-9256-070bb08128a7 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:36:20.054424 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6ea063e5-a8bc-4abc-9256-070bb08128a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:36:20.066587 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea063e5-a8bc-4abc-9256-070bb08128a7 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:36:20.071154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc813c3-8a6e-4cb3-8eab-ab4d639a098b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:36:20.071810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc813c3-8a6e-4cb3-8eab-ab4d639a098b service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:36:20.072096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc813c3-8a6e-4cb3-8eab-ab4d639a098b service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:36:20.072364 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc813c3-8a6e-4cb3-8eab-ab4d639a098b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:36:20.074156 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-afc813c3-8a6e-4cb3-8eab-ab4d639a098b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:36:20.090061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc813c3-8a6e-4cb3-8eab-ab4d639a098b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:36:20.091555 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc813c3-8a6e-4cb3-8eab-ab4d639a098b service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:36:20.103298 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1255/2533] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:36:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:36:28.911365 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=54 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:36:30.097974 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=31 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:01.790602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f067271-4ef5-4fce-84cc-99decf185139 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:01.792064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9f067271-4ef5-4fce-84cc-99decf185139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:01.850314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f067271-4ef5-4fce-84cc-99decf185139 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:01.854122 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469afd3-f1ef-438b-a63c-40f0e4f474e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:01.854790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469afd3-f1ef-438b-a63c-40f0e4f474e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:01.855072 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469afd3-f1ef-438b-a63c-40f0e4f474e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:01.855347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469afd3-f1ef-438b-a63c-40f0e4f474e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:01.857115 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5469afd3-f1ef-438b-a63c-40f0e4f474e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:01.868424 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469afd3-f1ef-438b-a63c-40f0e4f474e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:01.869829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469afd3-f1ef-438b-a63c-40f0e4f474e2 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:01.878854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1279/2534] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:37:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:37:08.039562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc813c3-8a6e-4cb3-8eab-ab4d639a098b service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:08.041048 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-afc813c3-8a6e-4cb3-8eab-ab4d639a098b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:08.066510 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc813c3-8a6e-4cb3-8eab-ab4d639a098b service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:08.080527 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7618eb-5ce2-461d-9534-0f0b23120be0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:08.081347 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7618eb-5ce2-461d-9534-0f0b23120be0 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:08.081630 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7618eb-5ce2-461d-9534-0f0b23120be0 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:08.081934 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7618eb-5ce2-461d-9534-0f0b23120be0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:08.084203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9a7618eb-5ce2-461d-9534-0f0b23120be0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:08.099172 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7618eb-5ce2-461d-9534-0f0b23120be0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:08.101154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7618eb-5ce2-461d-9534-0f0b23120be0 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:08.114661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1256/2535] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:37:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:37:10.285928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469afd3-f1ef-438b-a63c-40f0e4f474e2 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:10.296399 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469afd3-f1ef-438b-a63c-40f0e4f474e2 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:10.301074 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47457278-7c48-4b7b-8124-6e01cf249193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:10.301739 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47457278-7c48-4b7b-8124-6e01cf249193 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:10.302027 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47457278-7c48-4b7b-8124-6e01cf249193 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:10.302586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47457278-7c48-4b7b-8124-6e01cf249193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:10.306160 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-47457278-7c48-4b7b-8124-6e01cf249193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:10.320331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47457278-7c48-4b7b-8124-6e01cf249193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:10.322204 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47457278-7c48-4b7b-8124-6e01cf249193 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:10.334579 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1280/2536] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:37:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:37:17.791162 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed34d88-6b16-4445-85f3-da00e2c7bf59 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:17.791634 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed34d88-6b16-4445-85f3-da00e2c7bf59 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:17.791728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed34d88-6b16-4445-85f3-da00e2c7bf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:17.810474 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4ed34d88-6b16-4445-85f3-da00e2c7bf59 None None] MFA Rules not processed for user `18030043de1942779baf3ad94aec4071`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:37:17.811700 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4ed34d88-6b16-4445-85f3-da00e2c7bf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:17.867993 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1257/2537] 10.222.0.25 () {58 vars in 967 bytes} [Tue Jul 19 12:37:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:37:17.913494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47457278-7c48-4b7b-8124-6e01cf249193 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:17.914945 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-47457278-7c48-4b7b-8124-6e01cf249193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:17.984055 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47457278-7c48-4b7b-8124-6e01cf249193 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:17.988913 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0136f-51c2-49c7-af4f-f477a83d9409 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc2e1079d34745a279588028945c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:17.989548 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0136f-51c2-49c7-af4f-f477a83d9409 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:17.989824 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0136f-51c2-49c7-af4f-f477a83d9409 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:17.990098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0136f-51c2-49c7-af4f-f477a83d9409 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:17.998890 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0136f-51c2-49c7-af4f-f477a83d9409 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:18.000488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0136f-51c2-49c7-af4f-f477a83d9409 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:18.009336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1281/2538] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 19 12:37:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:37:21.330243 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed34d88-6b16-4445-85f3-da00e2c7bf59 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:21.347523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed34d88-6b16-4445-85f3-da00e2c7bf59 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:21.358331 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee4b66-7121-4d6f-9aa9-e993aac06a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:21.359046 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee4b66-7121-4d6f-9aa9-e993aac06a4f service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:21.359333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee4b66-7121-4d6f-9aa9-e993aac06a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:21.359610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee4b66-7121-4d6f-9aa9-e993aac06a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:21.367408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-edee4b66-7121-4d6f-9aa9-e993aac06a4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:21.489358 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0136f-51c2-49c7-af4f-f477a83d9409 service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:21.489862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee4b66-7121-4d6f-9aa9-e993aac06a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:21.490933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-90d0136f-51c2-49c7-af4f-f477a83d9409 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:21.492125 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee4b66-7121-4d6f-9aa9-e993aac06a4f service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:21.505735 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1258/2539] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:37:21.612578 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0136f-51c2-49c7-af4f-f477a83d9409 service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:21.617802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6628713-fd8e-4693-a2b3-964ac9df7be5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:21.618453 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6628713-fd8e-4693-a2b3-964ac9df7be5 service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:21.618726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6628713-fd8e-4693-a2b3-964ac9df7be5 service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:21.619034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6628713-fd8e-4693-a2b3-964ac9df7be5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:21.620974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b6628713-fd8e-4693-a2b3-964ac9df7be5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:21.634978 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6628713-fd8e-4693-a2b3-964ac9df7be5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:21.636052 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6628713-fd8e-4693-a2b3-964ac9df7be5 service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:21.648062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1282/2540] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:37:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:37:25.010614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee4b66-7121-4d6f-9aa9-e993aac06a4f service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:25.012390 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-edee4b66-7121-4d6f-9aa9-e993aac06a4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:25.029026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee4b66-7121-4d6f-9aa9-e993aac06a4f service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:25.037479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd8496-04a7-4381-9dcf-057550ce7537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:25.039161 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd8496-04a7-4381-9dcf-057550ce7537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:25.039438 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd8496-04a7-4381-9dcf-057550ce7537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:25.039725 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd8496-04a7-4381-9dcf-057550ce7537 admin admin] PATH_INFO: `/v3/users/074d31f2932545538ba05289aa4efd56` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:25.040919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd8496-04a7-4381-9dcf-057550ce7537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=074d31f2932545538ba05289aa4efd56)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:25.042950 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd8496-04a7-4381-9dcf-057550ce7537 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:25.056289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6628713-fd8e-4693-a2b3-964ac9df7be5 service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:25.068291 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6628713-fd8e-4693-a2b3-964ac9df7be5 service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:25.075288 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc640a-9649-4e20-8989-973a63e0a19e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:25.076003 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc640a-9649-4e20-8989-973a63e0a19e service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:25.076333 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc640a-9649-4e20-8989-973a63e0a19e service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:25.076599 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc640a-9649-4e20-8989-973a63e0a19e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:25.078576 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2adc640a-9649-4e20-8989-973a63e0a19e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:25.088873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:25.093332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc640a-9649-4e20-8989-973a63e0a19e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:25.094999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc640a-9649-4e20-8989-973a63e0a19e service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:25.101265 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b0fd8496-04a7-4381-9dcf-057550ce7537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074d31f2932545538ba05289aa4efd56'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.108263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1283/2541] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:37:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:37:25.111113 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b0fd8496-04a7-4381-9dcf-057550ce7537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074d31f2932545538ba05289aa4efd56'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.133502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b0fd8496-04a7-4381-9dcf-057550ce7537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074d31f2932545538ba05289aa4efd56'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.139701 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc640a-9649-4e20-8989-973a63e0a19e service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:25.141392 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2adc640a-9649-4e20-8989-973a63e0a19e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:25.144052 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b0fd8496-04a7-4381-9dcf-057550ce7537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074d31f2932545538ba05289aa4efd56'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.145303 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b0fd8496-04a7-4381-9dcf-057550ce7537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074d31f2932545538ba05289aa4efd56'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.148390 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:25.156781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1259/2542] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:37:25 2022] DELETE /identity/v3/users/074d31f2932545538ba05289aa4efd56 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:37:25.161445 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc640a-9649-4e20-8989-973a63e0a19e service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:25.225275 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a91e49-e7d0-4a90-abcf-0e2977bf782d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:25.226920 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a91e49-e7d0-4a90-abcf-0e2977bf782d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:25.227197 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a91e49-e7d0-4a90-abcf-0e2977bf782d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:25.227467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a91e49-e7d0-4a90-abcf-0e2977bf782d admin admin] PATH_INFO: `/v3/users/2410dc00847f42eb853780b399950899` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:25.228866 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a91e49-e7d0-4a90-abcf-0e2977bf782d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2410dc00847f42eb853780b399950899)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:25.230661 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a91e49-e7d0-4a90-abcf-0e2977bf782d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:25.298302 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b1a91e49-e7d0-4a90-abcf-0e2977bf782d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2410dc00847f42eb853780b399950899'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.319823 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b1a91e49-e7d0-4a90-abcf-0e2977bf782d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2410dc00847f42eb853780b399950899'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.382759 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b1a91e49-e7d0-4a90-abcf-0e2977bf782d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2410dc00847f42eb853780b399950899'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.384050 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd8496-04a7-4381-9dcf-057550ce7537 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:25.387146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b0fd8496-04a7-4381-9dcf-057550ce7537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:25.403562 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b1a91e49-e7d0-4a90-abcf-0e2977bf782d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2410dc00847f42eb853780b399950899'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.404550 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b1a91e49-e7d0-4a90-abcf-0e2977bf782d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2410dc00847f42eb853780b399950899'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.410758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd8496-04a7-4381-9dcf-057550ce7537 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:25.421445 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1284/2543] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:37:25 2022] DELETE /identity/v3/users/2410dc00847f42eb853780b399950899 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:37:25.421800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23c464-6198-434e-8950-72e3a3c411e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:25.421800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23c464-6198-434e-8950-72e3a3c411e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:25.421800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23c464-6198-434e-8950-72e3a3c411e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:25.421800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23c464-6198-434e-8950-72e3a3c411e6 admin admin] PATH_INFO: `/v3/projects/8f34f3d671e84e7d82b43027aaa54d2b` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:25.423687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23c464-6198-434e-8950-72e3a3c411e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f34f3d671e84e7d82b43027aaa54d2b)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:25.425593 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23c464-6198-434e-8950-72e3a3c411e6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:25.499023 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6f23c464-6198-434e-8950-72e3a3c411e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f34f3d671e84e7d82b43027aaa54d2b', 'request_id': 'req-6f23c464-6198-434e-8950-72e3a3c411e6'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.510278 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6f23c464-6198-434e-8950-72e3a3c411e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f34f3d671e84e7d82b43027aaa54d2b', 'request_id': 'req-6f23c464-6198-434e-8950-72e3a3c411e6'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.519279 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6f23c464-6198-434e-8950-72e3a3c411e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f34f3d671e84e7d82b43027aaa54d2b', 'request_id': 'req-6f23c464-6198-434e-8950-72e3a3c411e6'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.534396 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6f23c464-6198-434e-8950-72e3a3c411e6 admin admin] The token cache is being invalidate because project 8f34f3d671e84e7d82b43027aaa54d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:37:25.535281 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6f23c464-6198-434e-8950-72e3a3c411e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.536042 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6f23c464-6198-434e-8950-72e3a3c411e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.539783 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1260/2544] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:37:25 2022] DELETE /identity/v3/projects/8f34f3d671e84e7d82b43027aaa54d2b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:37:25.545123 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a91e49-e7d0-4a90-abcf-0e2977bf782d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:25.547239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b1a91e49-e7d0-4a90-abcf-0e2977bf782d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:25.628508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23c464-6198-434e-8950-72e3a3c411e6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:25.630012 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6f23c464-6198-434e-8950-72e3a3c411e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:25.643346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a91e49-e7d0-4a90-abcf-0e2977bf782d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:25.675809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:25.731329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23c464-6198-434e-8950-72e3a3c411e6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:25.734062 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c22848-4946-4c53-839d-3012c56d800f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:25.737400 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c22848-4946-4c53-839d-3012c56d800f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:25.737400 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c22848-4946-4c53-839d-3012c56d800f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:25.737400 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c22848-4946-4c53-839d-3012c56d800f admin admin] PATH_INFO: `/v3/users/a8e59595697d46c2b27ef1a5a9518e05` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:25.737752 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ad8bd-06aa-404f-a5fb-1b02b9216b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:25.737881 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c22848-4946-4c53-839d-3012c56d800f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e59595697d46c2b27ef1a5a9518e05)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:25.738169 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ad8bd-06aa-404f-a5fb-1b02b9216b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:25.738531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ad8bd-06aa-404f-a5fb-1b02b9216b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:25.738922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ad8bd-06aa-404f-a5fb-1b02b9216b0d admin admin] PATH_INFO: `/v3/projects/ad9849b5e9d44b21841e55000dc1cd23` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:25.739191 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c22848-4946-4c53-839d-3012c56d800f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:25.740281 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ad8bd-06aa-404f-a5fb-1b02b9216b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9849b5e9d44b21841e55000dc1cd23)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:25.742276 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ad8bd-06aa-404f-a5fb-1b02b9216b0d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:25.791072 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-27c22848-4946-4c53-839d-3012c56d800f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e59595697d46c2b27ef1a5a9518e05'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.794485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-686ad8bd-06aa-404f-a5fb-1b02b9216b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9849b5e9d44b21841e55000dc1cd23', 'request_id': 'req-686ad8bd-06aa-404f-a5fb-1b02b9216b0d'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.798008 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-27c22848-4946-4c53-839d-3012c56d800f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e59595697d46c2b27ef1a5a9518e05'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.800103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-686ad8bd-06aa-404f-a5fb-1b02b9216b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9849b5e9d44b21841e55000dc1cd23', 'request_id': 'req-686ad8bd-06aa-404f-a5fb-1b02b9216b0d'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.808577 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-686ad8bd-06aa-404f-a5fb-1b02b9216b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9849b5e9d44b21841e55000dc1cd23', 'request_id': 'req-686ad8bd-06aa-404f-a5fb-1b02b9216b0d'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.812674 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-27c22848-4946-4c53-839d-3012c56d800f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e59595697d46c2b27ef1a5a9518e05'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.821555 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-27c22848-4946-4c53-839d-3012c56d800f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e59595697d46c2b27ef1a5a9518e05'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.825198 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-686ad8bd-06aa-404f-a5fb-1b02b9216b0d admin admin] The token cache is being invalidate because project ad9849b5e9d44b21841e55000dc1cd23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:37:25.825487 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-686ad8bd-06aa-404f-a5fb-1b02b9216b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.826175 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-686ad8bd-06aa-404f-a5fb-1b02b9216b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.826459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-27c22848-4946-4c53-839d-3012c56d800f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e59595697d46c2b27ef1a5a9518e05'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:25.827983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1261/2545] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:37:25 2022] DELETE /identity/v3/projects/ad9849b5e9d44b21841e55000dc1cd23 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:37:25.832784 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1201b-519b-44c3-b573-ab277a97acb8 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:25.833068 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1201b-519b-44c3-b573-ab277a97acb8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:25.833235 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1285/2546] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:37:25 2022] DELETE /identity/v3/users/a8e59595697d46c2b27ef1a5a9518e05 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:37:25.833344 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1201b-519b-44c3-b573-ab277a97acb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:25.852969 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-5cb1201b-519b-44c3-b573-ab277a97acb8 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:37:25.854179 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5cb1201b-519b-44c3-b573-ab277a97acb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:25.859662 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:25.917722 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1262/2547] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:37:25.924924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11898b-0d51-4302-a929-21a7199d3d17 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:25.925235 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11898b-0d51-4302-a929-21a7199d3d17 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:25.925502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11898b-0d51-4302-a929-21a7199d3d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:25.943786 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0b11898b-0d51-4302-a929-21a7199d3d17 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:37:25.945626 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0b11898b-0d51-4302-a929-21a7199d3d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:25.953956 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1286/2548] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:37:25.958053 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1201b-519b-44c3-b573-ab277a97acb8 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:25.968299 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1201b-519b-44c3-b573-ab277a97acb8 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:25.973245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedb0a9-894f-4116-b015-8accccaeed6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:25.973908 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedb0a9-894f-4116-b015-8accccaeed6d admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:25.974310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedb0a9-894f-4116-b015-8accccaeed6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:25.974594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedb0a9-894f-4116-b015-8accccaeed6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:25.975383 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eedb0a9-894f-4116-b015-8accccaeed6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:37:25.975766 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eedb0a9-894f-4116-b015-8accccaeed6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:25.977528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eedb0a9-894f-4116-b015-8accccaeed6d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:25.989843 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1263/2549] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:37:25.994979 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11898b-0d51-4302-a929-21a7199d3d17 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:26.004370 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11898b-0d51-4302-a929-21a7199d3d17 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:26.010114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03700f5-6b64-44b8-bf7e-56e604c5c905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:26.011011 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03700f5-6b64-44b8-bf7e-56e604c5c905 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:26.011296 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03700f5-6b64-44b8-bf7e-56e604c5c905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:26.011645 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03700f5-6b64-44b8-bf7e-56e604c5c905 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:26.012331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03700f5-6b64-44b8-bf7e-56e604c5c905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:26.014206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03700f5-6b64-44b8-bf7e-56e604c5c905 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:26.019486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedb0a9-894f-4116-b015-8accccaeed6d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:26.021882 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3eedb0a9-894f-4116-b015-8accccaeed6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:26.038995 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedb0a9-894f-4116-b015-8accccaeed6d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:26.044225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021d800-16fc-4d41-887e-97da15bf1ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:26.045311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021d800-16fc-4d41-887e-97da15bf1ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:26.045513 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021d800-16fc-4d41-887e-97da15bf1ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:26.046097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021d800-16fc-4d41-887e-97da15bf1ac0 admin admin] PATH_INFO: `/v3/projects/65c7b4eb647146ca9d61e2f2aa142e20` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:26.047509 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021d800-16fc-4d41-887e-97da15bf1ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c7b4eb647146ca9d61e2f2aa142e20)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:26.047618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1287/2550] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:37:25 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:37:26.048293 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03700f5-6b64-44b8-bf7e-56e604c5c905 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:26.049448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021d800-16fc-4d41-887e-97da15bf1ac0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:26.098186 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e021d800-16fc-4d41-887e-97da15bf1ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c7b4eb647146ca9d61e2f2aa142e20', 'request_id': 'req-e021d800-16fc-4d41-887e-97da15bf1ac0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:26.103837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e021d800-16fc-4d41-887e-97da15bf1ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c7b4eb647146ca9d61e2f2aa142e20', 'request_id': 'req-e021d800-16fc-4d41-887e-97da15bf1ac0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:26.111686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03700f5-6b64-44b8-bf7e-56e604c5c905 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:26.112202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e021d800-16fc-4d41-887e-97da15bf1ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c7b4eb647146ca9d61e2f2aa142e20', 'request_id': 'req-e021d800-16fc-4d41-887e-97da15bf1ac0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:26.124685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e021d800-16fc-4d41-887e-97da15bf1ac0 admin admin] The token cache is being invalidate because project 65c7b4eb647146ca9d61e2f2aa142e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:37:26.124964 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e021d800-16fc-4d41-887e-97da15bf1ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:26.125612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e021d800-16fc-4d41-887e-97da15bf1ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:37:26.127191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1264/2551] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:37:26 2022] DELETE /identity/v3/projects/65c7b4eb647146ca9d61e2f2aa142e20 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:37:26.128986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:26.178828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec9d7d-3a00-41d7-a862-de508984fcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:26.179623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec9d7d-3a00-41d7-a862-de508984fcee admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:26.179905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec9d7d-3a00-41d7-a862-de508984fcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:26.180180 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec9d7d-3a00-41d7-a862-de508984fcee admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:26.180879 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec9d7d-3a00-41d7-a862-de508984fcee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:26.182850 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec9d7d-3a00-41d7-a862-de508984fcee admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:26.205761 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1288/2552] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:37:26 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:37:26.211014 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021d800-16fc-4d41-887e-97da15bf1ac0 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:26.212546 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e021d800-16fc-4d41-887e-97da15bf1ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:26.227745 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021d800-16fc-4d41-887e-97da15bf1ac0 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:26.232934 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c59fd-673b-4a26-8433-84a2498996fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:26.233632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c59fd-673b-4a26-8433-84a2498996fa admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:26.233909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c59fd-673b-4a26-8433-84a2498996fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:26.234178 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c59fd-673b-4a26-8433-84a2498996fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:26.234974 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c59fd-673b-4a26-8433-84a2498996fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:26.236585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c59fd-673b-4a26-8433-84a2498996fa admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:26.247986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1265/2553] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:37:26.252054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec9d7d-3a00-41d7-a862-de508984fcee admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:26.262681 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec9d7d-3a00-41d7-a862-de508984fcee admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:26.267441 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b8245-5e99-4aeb-b5b2-20c7c1e4c102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:26.268111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b8245-5e99-4aeb-b5b2-20c7c1e4c102 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:26.268387 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b8245-5e99-4aeb-b5b2-20c7c1e4c102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:26.268653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b8245-5e99-4aeb-b5b2-20c7c1e4c102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:26.269404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b8245-5e99-4aeb-b5b2-20c7c1e4c102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:26.271361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b8245-5e99-4aeb-b5b2-20c7c1e4c102 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:26.286633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1289/2554] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:37:26.287922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c59fd-673b-4a26-8433-84a2498996fa admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:26.299304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c59fd-673b-4a26-8433-84a2498996fa admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:26.304641 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6bfd6-d9ee-4acd-a49e-804456a93580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:26.305565 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6bfd6-d9ee-4acd-a49e-804456a93580 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:26.306000 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6bfd6-d9ee-4acd-a49e-804456a93580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:26.306313 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6bfd6-d9ee-4acd-a49e-804456a93580 admin admin] PATH_INFO: `/v3/projects/61ee663117a7415d8da674ca2a07b910/users/82d0c6bdb1054960b40faa9cb82d4092/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:26.324054 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6bfd6-d9ee-4acd-a49e-804456a93580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ee663117a7415d8da674ca2a07b910, user_id=82d0c6bdb1054960b40faa9cb82d4092, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:26.326845 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6bfd6-d9ee-4acd-a49e-804456a93580 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:26.342167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1266/2555] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:37:26 2022] PUT /identity/v3/projects/61ee663117a7415d8da674ca2a07b910/users/82d0c6bdb1054960b40faa9cb82d4092/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:37:26.347492 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9a50f-eea4-4b72-8dd6-741e2a73a39d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:26.347782 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9a50f-eea4-4b72-8dd6-741e2a73a39d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:26.348081 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9a50f-eea4-4b72-8dd6-741e2a73a39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:26.368348 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4da9a50f-eea4-4b72-8dd6-741e2a73a39d None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:37:26.369601 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4da9a50f-eea4-4b72-8dd6-741e2a73a39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:26.431508 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1290/2556] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:37:26.441374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6bfd6-d9ee-4acd-a49e-804456a93580 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:26.443166 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-42a6bfd6-d9ee-4acd-a49e-804456a93580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:26.495546 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:26.501852 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6bfd6-d9ee-4acd-a49e-804456a93580 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:26.506324 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fb360-890f-4b77-9640-1a3fe0061898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:26.507028 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fb360-890f-4b77-9640-1a3fe0061898 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:26.507317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fb360-890f-4b77-9640-1a3fe0061898 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:26.507592 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fb360-890f-4b77-9640-1a3fe0061898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:26.516843 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fb360-890f-4b77-9640-1a3fe0061898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:26.518267 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fb360-890f-4b77-9640-1a3fe0061898 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:26.532907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1267/2557] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:37:30.469739 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ef5d2-bcf7-465f-9524-bf5d1ef2c218 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:30.470276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ef5d2-bcf7-465f-9524-bf5d1ef2c218 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:30.470501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ef5d2-bcf7-465f-9524-bf5d1ef2c218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:30.498304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c91ef5d2-bcf7-465f-9524-bf5d1ef2c218 None None] MFA Rules not processed for user `82d0c6bdb1054960b40faa9cb82d4092`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:37:30.499516 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c91ef5d2-bcf7-465f-9524-bf5d1ef2c218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:30.565585 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1291/2558] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:37:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:37:30.580469 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fb360-890f-4b77-9640-1a3fe0061898 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:30.581890 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-313fb360-890f-4b77-9640-1a3fe0061898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:30.659972 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fb360-890f-4b77-9640-1a3fe0061898 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:30.666627 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745db60-33d9-4920-9825-1861aa730b41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:30.667312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745db60-33d9-4920-9825-1861aa730b41 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:30.667589 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745db60-33d9-4920-9825-1861aa730b41 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:30.667859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745db60-33d9-4920-9825-1861aa730b41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:30.676357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745db60-33d9-4920-9825-1861aa730b41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:30.677937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745db60-33d9-4920-9825-1861aa730b41 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:30.689272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1268/2559] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:37:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:37:32.062051 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148538ea-4641-4c9e-a780-cb097c39a1fb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:32.062523 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148538ea-4641-4c9e-a780-cb097c39a1fb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:32.062631 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148538ea-4641-4c9e-a780-cb097c39a1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:32.080039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-148538ea-4641-4c9e-a780-cb097c39a1fb None None] MFA Rules not processed for user `82d0c6bdb1054960b40faa9cb82d4092`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:37:32.081244 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-148538ea-4641-4c9e-a780-cb097c39a1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:32.088796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1292/2560] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:37:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:37:32.407083 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745db60-33d9-4920-9825-1861aa730b41 service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:32.408501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e745db60-33d9-4920-9825-1861aa730b41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:32.421036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745db60-33d9-4920-9825-1861aa730b41 service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:32.424864 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1477433-30cf-451f-b6ae-a2d8c98fdcfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:32.425548 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1477433-30cf-451f-b6ae-a2d8c98fdcfa service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:32.425884 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1477433-30cf-451f-b6ae-a2d8c98fdcfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:32.426152 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1477433-30cf-451f-b6ae-a2d8c98fdcfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:32.427941 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c1477433-30cf-451f-b6ae-a2d8c98fdcfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:32.438242 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1477433-30cf-451f-b6ae-a2d8c98fdcfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:32.439696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1477433-30cf-451f-b6ae-a2d8c98fdcfa service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:32.448551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1269/2561] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:37:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:37:32.767303 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148538ea-4641-4c9e-a780-cb097c39a1fb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:32.768966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-148538ea-4641-4c9e-a780-cb097c39a1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:32.801376 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:32.861714 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148538ea-4641-4c9e-a780-cb097c39a1fb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:32.869984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d781ef6-42f0-4f17-9e6d-b43d3daa3065 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:32.870965 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d781ef6-42f0-4f17-9e6d-b43d3daa3065 service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:32.871166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d781ef6-42f0-4f17-9e6d-b43d3daa3065 service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:32.871507 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d781ef6-42f0-4f17-9e6d-b43d3daa3065 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:32.873460 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7d781ef6-42f0-4f17-9e6d-b43d3daa3065 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:32.886381 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d781ef6-42f0-4f17-9e6d-b43d3daa3065 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:32.888169 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d781ef6-42f0-4f17-9e6d-b43d3daa3065 service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:32.900336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1293/2562] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:37:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:37:42.444214 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=45 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:42.727233 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1477433-30cf-451f-b6ae-a2d8c98fdcfa service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:42.743841 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1477433-30cf-451f-b6ae-a2d8c98fdcfa service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:42.749539 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4a798-862e-4603-935b-f033d1da63d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:42.750193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4a798-862e-4603-935b-f033d1da63d4 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:42.750475 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4a798-862e-4603-935b-f033d1da63d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:42.750779 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4a798-862e-4603-935b-f033d1da63d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:42.752714 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5ee4a798-862e-4603-935b-f033d1da63d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:42.765439 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4a798-862e-4603-935b-f033d1da63d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:42.767177 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4a798-862e-4603-935b-f033d1da63d4 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:42.778610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1270/2563] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:37:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:37:42.895511 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=22 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:43.760860 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d781ef6-42f0-4f17-9e6d-b43d3daa3065 service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:43.773405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d781ef6-42f0-4f17-9e6d-b43d3daa3065 service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:43.778695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5df40-6e60-4726-8eda-b2e911a372b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:43.779349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5df40-6e60-4726-8eda-b2e911a372b4 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:43.779623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5df40-6e60-4726-8eda-b2e911a372b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:43.779892 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5df40-6e60-4726-8eda-b2e911a372b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:43.781625 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e8d5df40-6e60-4726-8eda-b2e911a372b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:43.841885 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5df40-6e60-4726-8eda-b2e911a372b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:43.843535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5df40-6e60-4726-8eda-b2e911a372b4 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:43.853590 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1294/2564] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:37:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:37:52.774061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=6 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:53.848406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=28 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:54.847962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd32981-ae42-4f48-94a6-9c20a5f815c2 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:54.848460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd32981-ae42-4f48-94a6-9c20a5f815c2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:54.848586 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd32981-ae42-4f48-94a6-9c20a5f815c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:54.866694 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-efd32981-ae42-4f48-94a6-9c20a5f815c2 None None] MFA Rules not processed for user `7713fb28e4884d4e903a40b867347b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:37:54.867940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-efd32981-ae42-4f48-94a6-9c20a5f815c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:37:54.874717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1271/2565] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:37:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:38:04.861070 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:19.938577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5df40-6e60-4726-8eda-b2e911a372b4 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:20.002049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5df40-6e60-4726-8eda-b2e911a372b4 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:20.007291 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4bdbc-48ea-41ce-9f6c-5bb50d3184cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:20.007938 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4bdbc-48ea-41ce-9f6c-5bb50d3184cb service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:20.008216 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4bdbc-48ea-41ce-9f6c-5bb50d3184cb service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:20.008485 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4bdbc-48ea-41ce-9f6c-5bb50d3184cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:20.010234 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e2d4bdbc-48ea-41ce-9f6c-5bb50d3184cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:20.045587 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4bdbc-48ea-41ce-9f6c-5bb50d3184cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:20.047214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4bdbc-48ea-41ce-9f6c-5bb50d3184cb service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:20.057166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1295/2566] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:26.329410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710685ee-035a-4588-928d-229f03361449 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:26.329916 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710685ee-035a-4588-928d-229f03361449 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:26.330048 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710685ee-035a-4588-928d-229f03361449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:26.358715 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-710685ee-035a-4588-928d-229f03361449 None None] MFA Rules not processed for user `18030043de1942779baf3ad94aec4071`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:26.359955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-710685ee-035a-4588-928d-229f03361449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:26.423455 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1272/2567] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 19 12:39:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:26.470633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4bdbc-48ea-41ce-9f6c-5bb50d3184cb service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:26.472082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e2d4bdbc-48ea-41ce-9f6c-5bb50d3184cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:26.541415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4bdbc-48ea-41ce-9f6c-5bb50d3184cb service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:26.547127 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30105a2-e9a1-4946-b35c-3de173e9f292 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc2e1079d34745a279588028945c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:26.547801 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30105a2-e9a1-4946-b35c-3de173e9f292 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:26.548077 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30105a2-e9a1-4946-b35c-3de173e9f292 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:26.548344 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30105a2-e9a1-4946-b35c-3de173e9f292 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:26.556467 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30105a2-e9a1-4946-b35c-3de173e9f292 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:26.558050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30105a2-e9a1-4946-b35c-3de173e9f292 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:26.566131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1296/2568] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 19 12:39:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:39:36.416524 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=32 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:36.562918 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=68 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:37.074044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710685ee-035a-4588-928d-229f03361449 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:37.093724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710685ee-035a-4588-928d-229f03361449 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:37.097388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44029cca-409a-49d0-a3c1-55f0e8e0ddf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:37.098034 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44029cca-409a-49d0-a3c1-55f0e8e0ddf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:37.098318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44029cca-409a-49d0-a3c1-55f0e8e0ddf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:37.098594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44029cca-409a-49d0-a3c1-55f0e8e0ddf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:37.100527 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-44029cca-409a-49d0-a3c1-55f0e8e0ddf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:37.136351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44029cca-409a-49d0-a3c1-55f0e8e0ddf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:37.138107 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44029cca-409a-49d0-a3c1-55f0e8e0ddf2 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:37.158049 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1273/2569] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:40.454120 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30105a2-e9a1-4946-b35c-3de173e9f292 service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:40.455686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c30105a2-e9a1-4946-b35c-3de173e9f292 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:40.471620 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30105a2-e9a1-4946-b35c-3de173e9f292 service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:40.476577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8882d61-ffee-4b58-b2b0-e16e6c960bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:40.477443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8882d61-ffee-4b58-b2b0-e16e6c960bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:40.477745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8882d61-ffee-4b58-b2b0-e16e6c960bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:40.478022 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8882d61-ffee-4b58-b2b0-e16e6c960bb5 admin admin] PATH_INFO: `/v3/users/7713fb28e4884d4e903a40b867347b8d` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:40.479249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8882d61-ffee-4b58-b2b0-e16e6c960bb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7713fb28e4884d4e903a40b867347b8d)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:40.482121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8882d61-ffee-4b58-b2b0-e16e6c960bb5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:40.539390 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f8882d61-ffee-4b58-b2b0-e16e6c960bb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7713fb28e4884d4e903a40b867347b8d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:40.550649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f8882d61-ffee-4b58-b2b0-e16e6c960bb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7713fb28e4884d4e903a40b867347b8d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:40.564656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f8882d61-ffee-4b58-b2b0-e16e6c960bb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7713fb28e4884d4e903a40b867347b8d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:40.572581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f8882d61-ffee-4b58-b2b0-e16e6c960bb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7713fb28e4884d4e903a40b867347b8d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:40.573284 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f8882d61-ffee-4b58-b2b0-e16e6c960bb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7713fb28e4884d4e903a40b867347b8d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:40.580558 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1297/2570] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:39:40 2022] DELETE /identity/v3/users/7713fb28e4884d4e903a40b867347b8d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:40.646527 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478fb2c-7ef3-4924-ae4f-7e5dedf197c9 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:40.647145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478fb2c-7ef3-4924-ae4f-7e5dedf197c9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:40.647145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478fb2c-7ef3-4924-ae4f-7e5dedf197c9 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:40.648475 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1274/2571] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 19 12:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:39:40.655723 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e673ba1-7b19-4111-8682-ccc0baae2035 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:40.656555 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e673ba1-7b19-4111-8682-ccc0baae2035 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:40.656960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e673ba1-7b19-4111-8682-ccc0baae2035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:40.707589 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9e673ba1-7b19-4111-8682-ccc0baae2035 None None] MFA Rules not processed for user `5d9543657e1e4a6d85632bf57f6ba6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:40.708939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9e673ba1-7b19-4111-8682-ccc0baae2035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:40.795972 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478fb2c-7ef3-4924-ae4f-7e5dedf197c9 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:40.797830 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a478fb2c-7ef3-4924-ae4f-7e5dedf197c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:40.819159 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1298/2572] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 19 12:39:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:40.831634 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e673ba1-7b19-4111-8682-ccc0baae2035 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:40.833105 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9e673ba1-7b19-4111-8682-ccc0baae2035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:40.874251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:40.879633 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478fb2c-7ef3-4924-ae4f-7e5dedf197c9 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:40.884545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dabeac-b7de-42d7-b220-5633110fd0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:40.885492 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dabeac-b7de-42d7-b220-5633110fd0f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:40.885837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dabeac-b7de-42d7-b220-5633110fd0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:40.886173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dabeac-b7de-42d7-b220-5633110fd0f8 admin admin] PATH_INFO: `/v3/projects/84fa2500a4cc487784590005d8600664` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:40.888232 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dabeac-b7de-42d7-b220-5633110fd0f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84fa2500a4cc487784590005d8600664)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:40.890201 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dabeac-b7de-42d7-b220-5633110fd0f8 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:40.893750 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e673ba1-7b19-4111-8682-ccc0baae2035 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:40.898728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e074d-d200-4fbd-bf2a-780010d36bb9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1af8b237e2df41668bc5409d8fdd3f67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:40.899529 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e074d-d200-4fbd-bf2a-780010d36bb9 service glance] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:40.899818 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e074d-d200-4fbd-bf2a-780010d36bb9 service glance] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:40.900184 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e074d-d200-4fbd-bf2a-780010d36bb9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:40.911129 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e074d-d200-4fbd-bf2a-780010d36bb9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:40.912551 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e074d-d200-4fbd-bf2a-780010d36bb9 service glance] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:40.926362 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1299/2573] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:40.948357 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b6dabeac-b7de-42d7-b220-5633110fd0f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84fa2500a4cc487784590005d8600664', 'request_id': 'req-b6dabeac-b7de-42d7-b220-5633110fd0f8'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:40.954537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b6dabeac-b7de-42d7-b220-5633110fd0f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84fa2500a4cc487784590005d8600664', 'request_id': 'req-b6dabeac-b7de-42d7-b220-5633110fd0f8'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:40.964444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b6dabeac-b7de-42d7-b220-5633110fd0f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84fa2500a4cc487784590005d8600664', 'request_id': 'req-b6dabeac-b7de-42d7-b220-5633110fd0f8'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:40.978977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b6dabeac-b7de-42d7-b220-5633110fd0f8 admin admin] The token cache is being invalidate because project 84fa2500a4cc487784590005d8600664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:39:40.978977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b6dabeac-b7de-42d7-b220-5633110fd0f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:40.979598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b6dabeac-b7de-42d7-b220-5633110fd0f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:40.982849 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1275/2574] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:39:40 2022] DELETE /identity/v3/projects/84fa2500a4cc487784590005d8600664 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:40.986512 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4081b-920f-440c-84ba-37ac60f28d2e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:40.986946 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4081b-920f-440c-84ba-37ac60f28d2e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:40.987324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4081b-920f-440c-84ba-37ac60f28d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:41.018166 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c588e-98b9-45c2-917a-520acbf1b4c8 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:41.018488 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c588e-98b9-45c2-917a-520acbf1b4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:41.018823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c588e-98b9-45c2-917a-520acbf1b4c8 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:41.020824 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1276/2575] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 19 12:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:39:41.026044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c580a-60f5-41ac-b03c-ba839922735c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:41.027132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c580a-60f5-41ac-b03c-ba839922735c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:41.027676 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c580a-60f5-41ac-b03c-ba839922735c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:41.041949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a1a4081b-920f-440c-84ba-37ac60f28d2e None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:41.043336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a1a4081b-920f-440c-84ba-37ac60f28d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:41.062762 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-dc1c580a-60f5-41ac-b03c-ba839922735c None None] MFA Rules not processed for user `977392666b5a4076884416489b935ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:41.063997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-dc1c580a-60f5-41ac-b03c-ba839922735c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:41.095311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:41.118757 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1300/2576] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:41.126659 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb20163-06a0-45ac-8cdc-32eafcf11432 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:41.126982 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb20163-06a0-45ac-8cdc-32eafcf11432 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:41.127259 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb20163-06a0-45ac-8cdc-32eafcf11432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:41.134329 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1277/2577] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 19 12:39:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:41.147017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c580a-60f5-41ac-b03c-ba839922735c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:41.148018 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5fb20163-06a0-45ac-8cdc-32eafcf11432 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:41.149404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5fb20163-06a0-45ac-8cdc-32eafcf11432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:41.150154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-dc1c580a-60f5-41ac-b03c-ba839922735c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:41.158431 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1301/2578] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:41.162881 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb20163-06a0-45ac-8cdc-32eafcf11432 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:41.163890 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c580a-60f5-41ac-b03c-ba839922735c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:41.167913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4c52d-c208-4fde-90f1-8990083eff0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:41.169249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4c52d-c208-4fde-90f1-8990083eff0d service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:41.169606 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4c52d-c208-4fde-90f1-8990083eff0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:41.169955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4c52d-c208-4fde-90f1-8990083eff0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:41.174681 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb20163-06a0-45ac-8cdc-32eafcf11432 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:41.178661 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4c52d-c208-4fde-90f1-8990083eff0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:41.179546 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947a7b2-b204-4405-a1b2-e2312f7b86ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:41.180388 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4c52d-c208-4fde-90f1-8990083eff0d service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:41.180484 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947a7b2-b204-4405-a1b2-e2312f7b86ae admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:41.180573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947a7b2-b204-4405-a1b2-e2312f7b86ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:41.180842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947a7b2-b204-4405-a1b2-e2312f7b86ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:41.181564 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947a7b2-b204-4405-a1b2-e2312f7b86ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:39:41.181861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947a7b2-b204-4405-a1b2-e2312f7b86ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:41.183485 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947a7b2-b204-4405-a1b2-e2312f7b86ae admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:41.190837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1278/2579] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:39:41.197989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1302/2580] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 12:39:41.202682 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4c52d-c208-4fde-90f1-8990083eff0d service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:41.218460 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4c52d-c208-4fde-90f1-8990083eff0d service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:41.225036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889c758-0126-453d-a133-032a2f178f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:41.225943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c758-0126-453d-a133-032a2f178f77 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:41.226297 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c758-0126-453d-a133-032a2f178f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:41.226638 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c758-0126-453d-a133-032a2f178f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:41.227616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889c758-0126-453d-a133-032a2f178f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:41.229625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889c758-0126-453d-a133-032a2f178f77 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:41.260775 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1279/2581] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:39:41 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:39:41.264822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947a7b2-b204-4405-a1b2-e2312f7b86ae admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:41.283067 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947a7b2-b204-4405-a1b2-e2312f7b86ae admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:41.289565 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cf2f0-2764-4ad2-9ed5-f0f8e070c175 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:41.289961 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cf2f0-2764-4ad2-9ed5-f0f8e070c175 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:41.290333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cf2f0-2764-4ad2-9ed5-f0f8e070c175 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:41.292018 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1280/2582] 10.222.0.25 () {54 vars in 921 bytes} [Tue Jul 19 12:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:39:41.297995 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9607cb-7a0e-415b-a607-54b76733b139 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:41.298386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9607cb-7a0e-415b-a607-54b76733b139 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:41.298788 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9607cb-7a0e-415b-a607-54b76733b139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:41.317974 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3c9607cb-7a0e-415b-a607-54b76733b139 None None] MFA Rules not processed for user `5d9543657e1e4a6d85632bf57f6ba6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:41.319212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3c9607cb-7a0e-415b-a607-54b76733b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:41.342347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d8a16-f7e8-4c4f-b26d-eaf783e3e07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:41.343051 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d8a16-f7e8-4c4f-b26d-eaf783e3e07f admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:41.343336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d8a16-f7e8-4c4f-b26d-eaf783e3e07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:41.343614 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d8a16-f7e8-4c4f-b26d-eaf783e3e07f admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:41.344310 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d8a16-f7e8-4c4f-b26d-eaf783e3e07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:41.346194 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d8a16-f7e8-4c4f-b26d-eaf783e3e07f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:41.366666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1303/2583] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:39:41 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:39:41.370696 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d8a16-f7e8-4c4f-b26d-eaf783e3e07f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:41.381507 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d8a16-f7e8-4c4f-b26d-eaf783e3e07f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:41.386193 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56047e83-e459-4049-b1ea-917b2cbffd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:41.386908 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56047e83-e459-4049-b1ea-917b2cbffd55 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:41.387205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56047e83-e459-4049-b1ea-917b2cbffd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:41.387481 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56047e83-e459-4049-b1ea-917b2cbffd55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:41.388203 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56047e83-e459-4049-b1ea-917b2cbffd55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:41.390028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56047e83-e459-4049-b1ea-917b2cbffd55 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:41.395459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1281/2584] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Jul 19 12:39:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:39:41.400659 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1304/2585] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:39:41.404529 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9607cb-7a0e-415b-a607-54b76733b139 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:41.407266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56047e83-e459-4049-b1ea-917b2cbffd55 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:41.408941 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-56047e83-e459-4049-b1ea-917b2cbffd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:41.415125 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9607cb-7a0e-415b-a607-54b76733b139 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:41.420392 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14a85d-053b-494e-8a41-3d5c302ff2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:41.421048 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14a85d-053b-494e-8a41-3d5c302ff2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:41.421330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14a85d-053b-494e-8a41-3d5c302ff2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:41.421601 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14a85d-053b-494e-8a41-3d5c302ff2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:41.422321 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14a85d-053b-494e-8a41-3d5c302ff2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:41.423926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14a85d-053b-494e-8a41-3d5c302ff2ee admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:41.428373 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:41.435282 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1282/2586] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:41.439171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14a85d-053b-494e-8a41-3d5c302ff2ee admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:41.448540 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14a85d-053b-494e-8a41-3d5c302ff2ee admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:41.453392 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dbe03-b16c-488f-9153-44213b16d0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:41.454354 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dbe03-b16c-488f-9153-44213b16d0fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:41.454719 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dbe03-b16c-488f-9153-44213b16d0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:41.455041 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dbe03-b16c-488f-9153-44213b16d0fb admin admin] PATH_INFO: `/v3/projects/acfacdfbb5b745fdbbd142f068a559a2/users/3fa7024dfae54599a13c8a138b744003/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:41.470831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2dbe03-b16c-488f-9153-44213b16d0fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=acfacdfbb5b745fdbbd142f068a559a2, user_id=3fa7024dfae54599a13c8a138b744003, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:41.473494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2dbe03-b16c-488f-9153-44213b16d0fb admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:41.474721 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56047e83-e459-4049-b1ea-917b2cbffd55 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:41.478842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2850e93-4780-4792-a1a8-c75b420309e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:41.479524 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2850e93-4780-4792-a1a8-c75b420309e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:41.479846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2850e93-4780-4792-a1a8-c75b420309e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:41.480110 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2850e93-4780-4792-a1a8-c75b420309e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:41.488198 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1283/2587] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:39:41 2022] PUT /identity/v3/projects/acfacdfbb5b745fdbbd142f068a559a2/users/3fa7024dfae54599a13c8a138b744003/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:39:41.494466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2850e93-4780-4792-a1a8-c75b420309e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:41.496000 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2850e93-4780-4792-a1a8-c75b420309e2 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:41.499575 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938f37a-9907-48b7-acf0-3f89b099ce42 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:41.499862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938f37a-9907-48b7-acf0-3f89b099ce42 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:41.500133 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938f37a-9907-48b7-acf0-3f89b099ce42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:41.508949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1305/2588] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:39:41.527464 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d938f37a-9907-48b7-acf0-3f89b099ce42 None None] MFA Rules not processed for user `3fa7024dfae54599a13c8a138b744003`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:41.529321 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d938f37a-9907-48b7-acf0-3f89b099ce42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:41.583288 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:41.603102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1284/2589] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:39:41.614679 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2850e93-4780-4792-a1a8-c75b420309e2 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:41.616246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e2850e93-4780-4792-a1a8-c75b420309e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:41.631989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2850e93-4780-4792-a1a8-c75b420309e2 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:41.707691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841ce89-130e-406e-8a66-31e5c9a8f942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:41.708352 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841ce89-130e-406e-8a66-31e5c9a8f942 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:41.708626 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841ce89-130e-406e-8a66-31e5c9a8f942 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:41.708909 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841ce89-130e-406e-8a66-31e5c9a8f942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:41.719178 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841ce89-130e-406e-8a66-31e5c9a8f942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:41.720926 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841ce89-130e-406e-8a66-31e5c9a8f942 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:41.730138 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1306/2590] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:43.556654 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee112d-afef-4c26-bc6e-ad10025d8c93 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:43.557123 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee112d-afef-4c26-bc6e-ad10025d8c93 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:43.557324 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee112d-afef-4c26-bc6e-ad10025d8c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:43.575997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7eee112d-afef-4c26-bc6e-ad10025d8c93 None None] MFA Rules not processed for user `18030043de1942779baf3ad94aec4071`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:43.577220 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7eee112d-afef-4c26-bc6e-ad10025d8c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:43.631214 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1285/2591] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 19 12:39:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:43.644162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841ce89-130e-406e-8a66-31e5c9a8f942 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:43.645531 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7841ce89-130e-406e-8a66-31e5c9a8f942 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:43.716470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841ce89-130e-406e-8a66-31e5c9a8f942 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:43.721515 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac38aeb-6b2e-4d04-b8c9-ad917a59b594 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc2e1079d34745a279588028945c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:43.722155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac38aeb-6b2e-4d04-b8c9-ad917a59b594 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:43.722433 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac38aeb-6b2e-4d04-b8c9-ad917a59b594 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:43.722705 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac38aeb-6b2e-4d04-b8c9-ad917a59b594 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:43.730828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac38aeb-6b2e-4d04-b8c9-ad917a59b594 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:43.732616 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac38aeb-6b2e-4d04-b8c9-ad917a59b594 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:43.740641 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1307/2592] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 19 12:39:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:39:44.457949 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee112d-afef-4c26-bc6e-ad10025d8c93 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:44.549724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee112d-afef-4c26-bc6e-ad10025d8c93 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:44.555138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f28571-5dfc-4dcb-8095-116eaef25fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:44.556922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f28571-5dfc-4dcb-8095-116eaef25fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:44.556922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f28571-5dfc-4dcb-8095-116eaef25fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:44.556922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f28571-5dfc-4dcb-8095-116eaef25fe4 admin admin] PATH_INFO: `/v3/users/3fa7024dfae54599a13c8a138b744003` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:44.559749 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f28571-5dfc-4dcb-8095-116eaef25fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa7024dfae54599a13c8a138b744003)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:44.561955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f28571-5dfc-4dcb-8095-116eaef25fe4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:44.625459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-13f28571-5dfc-4dcb-8095-116eaef25fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa7024dfae54599a13c8a138b744003'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:44.638687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-13f28571-5dfc-4dcb-8095-116eaef25fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa7024dfae54599a13c8a138b744003'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:44.655364 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-13f28571-5dfc-4dcb-8095-116eaef25fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa7024dfae54599a13c8a138b744003'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:44.671035 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-13f28571-5dfc-4dcb-8095-116eaef25fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa7024dfae54599a13c8a138b744003'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:44.671689 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-13f28571-5dfc-4dcb-8095-116eaef25fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa7024dfae54599a13c8a138b744003'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:44.682580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1286/2593] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:39:44 2022] DELETE /identity/v3/users/3fa7024dfae54599a13c8a138b744003 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:44.685405 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3fbb3-9505-4c09-b693-fbb073ebbc67 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:44.686016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3fbb3-9505-4c09-b693-fbb073ebbc67 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:44.686016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3fbb3-9505-4c09-b693-fbb073ebbc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:44.707599 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e4b3fbb3-9505-4c09-b693-fbb073ebbc67 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:44.708836 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e4b3fbb3-9505-4c09-b693-fbb073ebbc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:44.749146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:44.785054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1308/2594] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:39:44.795044 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f28571-5dfc-4dcb-8095-116eaef25fe4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:44.796495 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-13f28571-5dfc-4dcb-8095-116eaef25fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:44.813445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:44.864614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f28571-5dfc-4dcb-8095-116eaef25fe4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:44.869178 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843e08c-fa5a-4869-a8bb-b509def91d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:44.869831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843e08c-fa5a-4869-a8bb-b509def91d33 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:44.870225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843e08c-fa5a-4869-a8bb-b509def91d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:44.870502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843e08c-fa5a-4869-a8bb-b509def91d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:44.881706 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843e08c-fa5a-4869-a8bb-b509def91d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:44.883188 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843e08c-fa5a-4869-a8bb-b509def91d33 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:44.895571 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1287/2595] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:45.204964 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3fbb3-9505-4c09-b693-fbb073ebbc67 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:45.211864 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e4b3fbb3-9505-4c09-b693-fbb073ebbc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:45.230072 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3fbb3-9505-4c09-b693-fbb073ebbc67 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:45.236479 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcbeb8-1c0d-4f8e-98f5-54a06b6d7560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:45.237391 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcbeb8-1c0d-4f8e-98f5-54a06b6d7560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:45.237677 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcbeb8-1c0d-4f8e-98f5-54a06b6d7560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:45.237953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcbeb8-1c0d-4f8e-98f5-54a06b6d7560 admin admin] PATH_INFO: `/v3/projects/acfacdfbb5b745fdbbd142f068a559a2` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:45.239247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcbeb8-1c0d-4f8e-98f5-54a06b6d7560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acfacdfbb5b745fdbbd142f068a559a2)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:45.241224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcbeb8-1c0d-4f8e-98f5-54a06b6d7560 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:45.298590 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e2bcbeb8-1c0d-4f8e-98f5-54a06b6d7560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acfacdfbb5b745fdbbd142f068a559a2', 'request_id': 'req-e2bcbeb8-1c0d-4f8e-98f5-54a06b6d7560'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:45.307131 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e2bcbeb8-1c0d-4f8e-98f5-54a06b6d7560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acfacdfbb5b745fdbbd142f068a559a2', 'request_id': 'req-e2bcbeb8-1c0d-4f8e-98f5-54a06b6d7560'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:45.318491 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e2bcbeb8-1c0d-4f8e-98f5-54a06b6d7560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acfacdfbb5b745fdbbd142f068a559a2', 'request_id': 'req-e2bcbeb8-1c0d-4f8e-98f5-54a06b6d7560'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:45.332489 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e2bcbeb8-1c0d-4f8e-98f5-54a06b6d7560 admin admin] The token cache is being invalidate because project acfacdfbb5b745fdbbd142f068a559a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:39:45.332876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e2bcbeb8-1c0d-4f8e-98f5-54a06b6d7560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:45.333588 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e2bcbeb8-1c0d-4f8e-98f5-54a06b6d7560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:45.335236 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1309/2596] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:39:45 2022] DELETE /identity/v3/projects/acfacdfbb5b745fdbbd142f068a559a2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:39:45.340997 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84850aa2-a644-42ee-945e-66a08d6254d5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:45.341284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84850aa2-a644-42ee-945e-66a08d6254d5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:45.341563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84850aa2-a644-42ee-945e-66a08d6254d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:45.382541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-84850aa2-a644-42ee-945e-66a08d6254d5 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:45.383829 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-84850aa2-a644-42ee-945e-66a08d6254d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:45.482307 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1288/2597] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:45.490050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95cd23-e5ea-4503-b118-b5e0969eb271 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:45.490493 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95cd23-e5ea-4503-b118-b5e0969eb271 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:45.490927 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95cd23-e5ea-4503-b118-b5e0969eb271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:45.522931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9c95cd23-e5ea-4503-b118-b5e0969eb271 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:45.524335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9c95cd23-e5ea-4503-b118-b5e0969eb271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:45.533618 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1310/2598] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:39:45.538454 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84850aa2-a644-42ee-945e-66a08d6254d5 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:45.554964 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84850aa2-a644-42ee-945e-66a08d6254d5 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:45.563570 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9224a6-e2f3-47d1-841d-1587d5552b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:45.564294 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9224a6-e2f3-47d1-841d-1587d5552b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:45.564691 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9224a6-e2f3-47d1-841d-1587d5552b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:45.565062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9224a6-e2f3-47d1-841d-1587d5552b46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:45.565909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9224a6-e2f3-47d1-841d-1587d5552b46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:39:45.566287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9224a6-e2f3-47d1-841d-1587d5552b46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:45.568043 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9224a6-e2f3-47d1-841d-1587d5552b46 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:45.581315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1289/2599] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:39:45.586335 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95cd23-e5ea-4503-b118-b5e0969eb271 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:45.596747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95cd23-e5ea-4503-b118-b5e0969eb271 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:45.601446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ca02b-67e0-4ab6-8455-069355bc4e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:45.602117 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ca02b-67e0-4ab6-8455-069355bc4e59 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:45.602400 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ca02b-67e0-4ab6-8455-069355bc4e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:45.602771 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ca02b-67e0-4ab6-8455-069355bc4e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:45.603455 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ca02b-67e0-4ab6-8455-069355bc4e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:45.605376 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ca02b-67e0-4ab6-8455-069355bc4e59 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:45.643167 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1311/2600] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:39:45 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:39:45.647918 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9224a6-e2f3-47d1-841d-1587d5552b46 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:45.665032 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9224a6-e2f3-47d1-841d-1587d5552b46 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:45.735612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4657e3-190e-47ba-b2ff-39c0378ca1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:45.736391 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4657e3-190e-47ba-b2ff-39c0378ca1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:45.736678 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4657e3-190e-47ba-b2ff-39c0378ca1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:45.736952 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4657e3-190e-47ba-b2ff-39c0378ca1f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:45.737667 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4657e3-190e-47ba-b2ff-39c0378ca1f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:45.739731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4657e3-190e-47ba-b2ff-39c0378ca1f9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:45.764999 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1290/2601] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:39:45 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:39:45.766380 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ca02b-67e0-4ab6-8455-069355bc4e59 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:45.777223 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ca02b-67e0-4ab6-8455-069355bc4e59 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:45.781946 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19168da-7d04-4296-baf3-52bf784daee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:45.782577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19168da-7d04-4296-baf3-52bf784daee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:45.782905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19168da-7d04-4296-baf3-52bf784daee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:45.783158 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19168da-7d04-4296-baf3-52bf784daee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:45.783867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19168da-7d04-4296-baf3-52bf784daee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:45.785534 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19168da-7d04-4296-baf3-52bf784daee3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:45.799096 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1312/2602] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:39:45.803070 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4657e3-190e-47ba-b2ff-39c0378ca1f9 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:45.814835 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4657e3-190e-47ba-b2ff-39c0378ca1f9 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:45.819604 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299e8de-a045-4c5b-8df6-d5ba1931174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:45.820345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299e8de-a045-4c5b-8df6-d5ba1931174d admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:45.820809 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299e8de-a045-4c5b-8df6-d5ba1931174d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:45.821230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299e8de-a045-4c5b-8df6-d5ba1931174d admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:45.822034 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299e8de-a045-4c5b-8df6-d5ba1931174d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:45.824197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299e8de-a045-4c5b-8df6-d5ba1931174d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:45.838764 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1291/2603] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:45.842377 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19168da-7d04-4296-baf3-52bf784daee3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:45.853613 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19168da-7d04-4296-baf3-52bf784daee3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:45.859947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d135c-c1f5-4a18-82d2-ce78149afc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:45.860923 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d135c-c1f5-4a18-82d2-ce78149afc6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:45.861230 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d135c-c1f5-4a18-82d2-ce78149afc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:45.861500 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d135c-c1f5-4a18-82d2-ce78149afc6c admin admin] PATH_INFO: `/v3/projects/3d592aed59584b049f5a9705fd999a79/users/d423520e1bc848efa750e24d3f964284/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:45.877588 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d135c-c1f5-4a18-82d2-ce78149afc6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d592aed59584b049f5a9705fd999a79, user_id=d423520e1bc848efa750e24d3f964284, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:45.880289 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d135c-c1f5-4a18-82d2-ce78149afc6c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:45.895548 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1313/2604] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:39:45 2022] PUT /identity/v3/projects/3d592aed59584b049f5a9705fd999a79/users/d423520e1bc848efa750e24d3f964284/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:39:45.907706 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd134ce2-37a8-4d16-aef5-374a025b3106 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:45.908338 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd134ce2-37a8-4d16-aef5-374a025b3106 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:45.908831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd134ce2-37a8-4d16-aef5-374a025b3106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:45.944738 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-cd134ce2-37a8-4d16-aef5-374a025b3106 None None] MFA Rules not processed for user `d423520e1bc848efa750e24d3f964284`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:45.946426 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cd134ce2-37a8-4d16-aef5-374a025b3106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:45.960123 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:46.031126 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1292/2605] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:46.035299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d135c-c1f5-4a18-82d2-ce78149afc6c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:46.093016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:46.106927 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d135c-c1f5-4a18-82d2-ce78149afc6c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:46.112203 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2852f65-5c4d-43f0-abe2-c7c89e03c80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:46.112864 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2852f65-5c4d-43f0-abe2-c7c89e03c80a admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:46.113139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2852f65-5c4d-43f0-abe2-c7c89e03c80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:46.113406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2852f65-5c4d-43f0-abe2-c7c89e03c80a admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:46.114077 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2852f65-5c4d-43f0-abe2-c7c89e03c80a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:46.115987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2852f65-5c4d-43f0-abe2-c7c89e03c80a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:46.144211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1314/2606] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:39:46 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:39:46.149771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd134ce2-37a8-4d16-aef5-374a025b3106 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:46.162060 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd134ce2-37a8-4d16-aef5-374a025b3106 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:46.227184 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4469e7-8ac6-47a1-ba5e-cc1eea843c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:46.227881 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4469e7-8ac6-47a1-ba5e-cc1eea843c70 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:46.228165 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4469e7-8ac6-47a1-ba5e-cc1eea843c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:46.228442 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4469e7-8ac6-47a1-ba5e-cc1eea843c70 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:46.229149 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4469e7-8ac6-47a1-ba5e-cc1eea843c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:46.231320 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4469e7-8ac6-47a1-ba5e-cc1eea843c70 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:46.254156 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1293/2607] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:39:46 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:39:46.258363 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2852f65-5c4d-43f0-abe2-c7c89e03c80a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:46.270204 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2852f65-5c4d-43f0-abe2-c7c89e03c80a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:46.281652 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653cb62-c8f5-4ad6-a2ba-eeb11e917dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:46.282345 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653cb62-c8f5-4ad6-a2ba-eeb11e917dde admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:46.282627 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653cb62-c8f5-4ad6-a2ba-eeb11e917dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:46.282941 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653cb62-c8f5-4ad6-a2ba-eeb11e917dde admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:46.284076 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653cb62-c8f5-4ad6-a2ba-eeb11e917dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:46.285586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653cb62-c8f5-4ad6-a2ba-eeb11e917dde admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:46.297116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1315/2608] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:46.301422 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4469e7-8ac6-47a1-ba5e-cc1eea843c70 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:46.316263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4469e7-8ac6-47a1-ba5e-cc1eea843c70 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:46.323080 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747059c-2bbf-4f9e-b24d-01603bd0b37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:46.324000 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747059c-2bbf-4f9e-b24d-01603bd0b37c admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:46.324953 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747059c-2bbf-4f9e-b24d-01603bd0b37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:46.325513 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747059c-2bbf-4f9e-b24d-01603bd0b37c admin admin] PATH_INFO: `/v3/projects/66c30bdd535140789c044f864654bbf3/users/105d482f43fe46cfae7ad8fd9f269425/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:46.343303 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747059c-2bbf-4f9e-b24d-01603bd0b37c admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c30bdd535140789c044f864654bbf3, user_id=105d482f43fe46cfae7ad8fd9f269425, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:46.346766 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747059c-2bbf-4f9e-b24d-01603bd0b37c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:46.365768 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1294/2609] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:39:46 2022] PUT /identity/v3/projects/66c30bdd535140789c044f864654bbf3/users/105d482f43fe46cfae7ad8fd9f269425/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:46.367258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653cb62-c8f5-4ad6-a2ba-eeb11e917dde admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:46.379238 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653cb62-c8f5-4ad6-a2ba-eeb11e917dde admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:46.441796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5430cc8-0450-48ee-84ce-c1673ffd3d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:46.442468 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5430cc8-0450-48ee-84ce-c1673ffd3d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:46.442774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5430cc8-0450-48ee-84ce-c1673ffd3d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:46.443053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5430cc8-0450-48ee-84ce-c1673ffd3d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:46.443780 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5430cc8-0450-48ee-84ce-c1673ffd3d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:46.445374 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5430cc8-0450-48ee-84ce-c1673ffd3d4d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:46.456852 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1316/2610] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:46.461129 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747059c-2bbf-4f9e-b24d-01603bd0b37c admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:46.473527 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747059c-2bbf-4f9e-b24d-01603bd0b37c admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:46.478359 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04cd35-296b-4385-b3c6-b8f9681e5852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:46.479299 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04cd35-296b-4385-b3c6-b8f9681e5852 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:46.479581 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04cd35-296b-4385-b3c6-b8f9681e5852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:46.479859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04cd35-296b-4385-b3c6-b8f9681e5852 admin admin] PATH_INFO: `/v3/projects/66c30bdd535140789c044f864654bbf3/users/105d482f43fe46cfae7ad8fd9f269425/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:46.482350 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04cd35-296b-4385-b3c6-b8f9681e5852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c30bdd535140789c044f864654bbf3, user_id=105d482f43fe46cfae7ad8fd9f269425, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:46.484962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04cd35-296b-4385-b3c6-b8f9681e5852 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:46.497972 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1295/2611] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:39:46 2022] PUT /identity/v3/projects/66c30bdd535140789c044f864654bbf3/users/105d482f43fe46cfae7ad8fd9f269425/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:46.510149 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c61951-b1a3-42c6-8b0e-ba26a458aeda None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:46.510436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c61951-b1a3-42c6-8b0e-ba26a458aeda None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:46.510719 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c61951-b1a3-42c6-8b0e-ba26a458aeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:46.543151 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-55c61951-b1a3-42c6-8b0e-ba26a458aeda None None] MFA Rules not processed for user `105d482f43fe46cfae7ad8fd9f269425`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:46.544436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-55c61951-b1a3-42c6-8b0e-ba26a458aeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:46.653586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1317/2612] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:46.669272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04cd35-296b-4385-b3c6-b8f9681e5852 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:46.671061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5c04cd35-296b-4385-b3c6-b8f9681e5852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:46.783850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:46.795867 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04cd35-296b-4385-b3c6-b8f9681e5852 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:46.799644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b7ff1-2285-47ac-83be-6dd57e3a505b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:46.800292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b7ff1-2285-47ac-83be-6dd57e3a505b service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:46.800577 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b7ff1-2285-47ac-83be-6dd57e3a505b service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:46.800848 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b7ff1-2285-47ac-83be-6dd57e3a505b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:46.811579 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b7ff1-2285-47ac-83be-6dd57e3a505b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:46.813026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b7ff1-2285-47ac-83be-6dd57e3a505b service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:46.830773 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1296/2613] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:46.897022 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c61951-b1a3-42c6-8b0e-ba26a458aeda None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:46.955895 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:46.974720 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c61951-b1a3-42c6-8b0e-ba26a458aeda None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:46.979669 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a475515-8ede-4449-b088-e3d1ef03a60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:46.980591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a475515-8ede-4449-b088-e3d1ef03a60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:46.980872 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a475515-8ede-4449-b088-e3d1ef03a60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:46.981147 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a475515-8ede-4449-b088-e3d1ef03a60e admin admin] PATH_INFO: `/v3/users/d423520e1bc848efa750e24d3f964284` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:46.982352 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a475515-8ede-4449-b088-e3d1ef03a60e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d423520e1bc848efa750e24d3f964284)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:46.984314 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a475515-8ede-4449-b088-e3d1ef03a60e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:47.040583 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9a475515-8ede-4449-b088-e3d1ef03a60e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd423520e1bc848efa750e24d3f964284'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:47.054048 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9a475515-8ede-4449-b088-e3d1ef03a60e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd423520e1bc848efa750e24d3f964284'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:47.068581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9a475515-8ede-4449-b088-e3d1ef03a60e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd423520e1bc848efa750e24d3f964284'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:47.077897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9a475515-8ede-4449-b088-e3d1ef03a60e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd423520e1bc848efa750e24d3f964284'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:47.078531 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9a475515-8ede-4449-b088-e3d1ef03a60e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd423520e1bc848efa750e24d3f964284'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:47.089974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1318/2614] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:39:46 2022] DELETE /identity/v3/users/d423520e1bc848efa750e24d3f964284 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:47.094512 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d316ad0-3dbd-4c4d-8111-3cca42257b63 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:47.094830 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d316ad0-3dbd-4c4d-8111-3cca42257b63 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:47.095108 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d316ad0-3dbd-4c4d-8111-3cca42257b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:47.114134 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4d316ad0-3dbd-4c4d-8111-3cca42257b63 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:47.115402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4d316ad0-3dbd-4c4d-8111-3cca42257b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:47.180964 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1297/2615] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:47.190707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a475515-8ede-4449-b088-e3d1ef03a60e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:47.192181 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9a475515-8ede-4449-b088-e3d1ef03a60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:47.258317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a475515-8ede-4449-b088-e3d1ef03a60e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:47.262838 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd34c0-43af-4c25-ad3c-311715dddd56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:47.263491 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd34c0-43af-4c25-ad3c-311715dddd56 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:47.263778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd34c0-43af-4c25-ad3c-311715dddd56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:47.264029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd34c0-43af-4c25-ad3c-311715dddd56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:47.275353 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd34c0-43af-4c25-ad3c-311715dddd56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:47.276825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd34c0-43af-4c25-ad3c-311715dddd56 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:47.289279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1319/2616] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:47.602018 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d316ad0-3dbd-4c4d-8111-3cca42257b63 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:47.603537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4d316ad0-3dbd-4c4d-8111-3cca42257b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:47.617857 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d316ad0-3dbd-4c4d-8111-3cca42257b63 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:47.622574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67232b-f985-4329-9343-8eecc587e144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:47.623568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67232b-f985-4329-9343-8eecc587e144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:47.623925 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67232b-f985-4329-9343-8eecc587e144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:47.624264 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67232b-f985-4329-9343-8eecc587e144 admin admin] PATH_INFO: `/v3/projects/3d592aed59584b049f5a9705fd999a79` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:47.625551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67232b-f985-4329-9343-8eecc587e144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d592aed59584b049f5a9705fd999a79)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:47.627566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67232b-f985-4329-9343-8eecc587e144 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:47.698672 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6d67232b-f985-4329-9343-8eecc587e144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d592aed59584b049f5a9705fd999a79', 'request_id': 'req-6d67232b-f985-4329-9343-8eecc587e144'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:47.704952 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6d67232b-f985-4329-9343-8eecc587e144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d592aed59584b049f5a9705fd999a79', 'request_id': 'req-6d67232b-f985-4329-9343-8eecc587e144'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:47.715340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6d67232b-f985-4329-9343-8eecc587e144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d592aed59584b049f5a9705fd999a79', 'request_id': 'req-6d67232b-f985-4329-9343-8eecc587e144'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:47.733429 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6d67232b-f985-4329-9343-8eecc587e144 admin admin] The token cache is being invalidate because project 3d592aed59584b049f5a9705fd999a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:39:47.733885 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6d67232b-f985-4329-9343-8eecc587e144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:47.734606 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6d67232b-f985-4329-9343-8eecc587e144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:47.736173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1298/2617] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:39:47 2022] DELETE /identity/v3/projects/3d592aed59584b049f5a9705fd999a79 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:39:47.740292 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd34c0-43af-4c25-ad3c-311715dddd56 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:47.751436 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd34c0-43af-4c25-ad3c-311715dddd56 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:47.843185 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fbead-1e00-4215-808f-5d4742aa99a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:47.844085 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fbead-1e00-4215-808f-5d4742aa99a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:47.844363 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fbead-1e00-4215-808f-5d4742aa99a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:47.844638 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fbead-1e00-4215-808f-5d4742aa99a4 admin admin] PATH_INFO: `/v3/users/105d482f43fe46cfae7ad8fd9f269425` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:47.845896 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fbead-1e00-4215-808f-5d4742aa99a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=105d482f43fe46cfae7ad8fd9f269425)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:47.847891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fbead-1e00-4215-808f-5d4742aa99a4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:47.865355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:47.913708 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-019fbead-1e00-4215-808f-5d4742aa99a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '105d482f43fe46cfae7ad8fd9f269425'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:47.942821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-019fbead-1e00-4215-808f-5d4742aa99a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '105d482f43fe46cfae7ad8fd9f269425'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:47.959514 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-019fbead-1e00-4215-808f-5d4742aa99a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '105d482f43fe46cfae7ad8fd9f269425'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:47.969518 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-019fbead-1e00-4215-808f-5d4742aa99a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '105d482f43fe46cfae7ad8fd9f269425'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:47.970398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-019fbead-1e00-4215-808f-5d4742aa99a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '105d482f43fe46cfae7ad8fd9f269425'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:47.985786 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1320/2618] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:39:47 2022] DELETE /identity/v3/users/105d482f43fe46cfae7ad8fd9f269425 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:48.304836 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67232b-f985-4329-9343-8eecc587e144 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:48.306757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6d67232b-f985-4329-9343-8eecc587e144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:48.327203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67232b-f985-4329-9343-8eecc587e144 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:48.414964 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c552b-229e-4fea-ae99-5f0658f84c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:48.415846 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c552b-229e-4fea-ae99-5f0658f84c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:48.416121 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c552b-229e-4fea-ae99-5f0658f84c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:48.416389 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c552b-229e-4fea-ae99-5f0658f84c7b admin admin] PATH_INFO: `/v3/projects/66c30bdd535140789c044f864654bbf3` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:48.417721 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c552b-229e-4fea-ae99-5f0658f84c7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c30bdd535140789c044f864654bbf3)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:48.420521 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c552b-229e-4fea-ae99-5f0658f84c7b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:48.439872 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:48.473188 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ee8c552b-229e-4fea-ae99-5f0658f84c7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c30bdd535140789c044f864654bbf3', 'request_id': 'req-ee8c552b-229e-4fea-ae99-5f0658f84c7b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:48.479187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ee8c552b-229e-4fea-ae99-5f0658f84c7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c30bdd535140789c044f864654bbf3', 'request_id': 'req-ee8c552b-229e-4fea-ae99-5f0658f84c7b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:48.489064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ee8c552b-229e-4fea-ae99-5f0658f84c7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c30bdd535140789c044f864654bbf3', 'request_id': 'req-ee8c552b-229e-4fea-ae99-5f0658f84c7b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:48.506371 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ee8c552b-229e-4fea-ae99-5f0658f84c7b admin admin] The token cache is being invalidate because project 66c30bdd535140789c044f864654bbf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:39:48.506766 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ee8c552b-229e-4fea-ae99-5f0658f84c7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:48.507594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ee8c552b-229e-4fea-ae99-5f0658f84c7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:48.512816 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1299/2619] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:39:48 2022] DELETE /identity/v3/projects/66c30bdd535140789c044f864654bbf3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:48.514595 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c2abe-fad7-4fd8-ad27-720cabe4e53b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:48.514915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c2abe-fad7-4fd8-ad27-720cabe4e53b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:48.515198 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c2abe-fad7-4fd8-ad27-720cabe4e53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:48.539695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-918c2abe-fad7-4fd8-ad27-720cabe4e53b None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:48.541014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-918c2abe-fad7-4fd8-ad27-720cabe4e53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:48.616702 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1321/2620] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:48.625358 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25ee37-d112-4a11-84f7-585f334cc227 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:48.625657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25ee37-d112-4a11-84f7-585f334cc227 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:48.625937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25ee37-d112-4a11-84f7-585f334cc227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:48.646332 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7c25ee37-d112-4a11-84f7-585f334cc227 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:48.647593 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7c25ee37-d112-4a11-84f7-585f334cc227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:48.657005 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1300/2621] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:48.661622 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c2abe-fad7-4fd8-ad27-720cabe4e53b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:48.676138 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c2abe-fad7-4fd8-ad27-720cabe4e53b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:48.680922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18e38a-42fa-4188-9d42-23b132e7594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:48.681584 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18e38a-42fa-4188-9d42-23b132e7594a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:48.681866 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18e38a-42fa-4188-9d42-23b132e7594a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:48.682168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18e38a-42fa-4188-9d42-23b132e7594a admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:48.682912 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18e38a-42fa-4188-9d42-23b132e7594a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:39:48.683214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18e38a-42fa-4188-9d42-23b132e7594a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:48.688142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18e38a-42fa-4188-9d42-23b132e7594a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:48.714155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1322/2622] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:39:48.716603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25ee37-d112-4a11-84f7-585f334cc227 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:48.726484 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25ee37-d112-4a11-84f7-585f334cc227 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:48.731720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129f82b-62bf-4b9f-862f-05f569eb5827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:48.732321 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129f82b-62bf-4b9f-862f-05f569eb5827 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:48.732605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129f82b-62bf-4b9f-862f-05f569eb5827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:48.732887 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129f82b-62bf-4b9f-862f-05f569eb5827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:48.733574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129f82b-62bf-4b9f-862f-05f569eb5827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:48.735562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129f82b-62bf-4b9f-862f-05f569eb5827 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:48.769094 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1301/2623] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:39:48 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:39:48.773226 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18e38a-42fa-4188-9d42-23b132e7594a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:48.784845 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18e38a-42fa-4188-9d42-23b132e7594a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:48.844971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0af074-bb9b-42e8-97f2-6240c063cc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:48.845653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0af074-bb9b-42e8-97f2-6240c063cc47 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:48.845934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0af074-bb9b-42e8-97f2-6240c063cc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:48.846211 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0af074-bb9b-42e8-97f2-6240c063cc47 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:48.846953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0af074-bb9b-42e8-97f2-6240c063cc47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:48.848856 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0af074-bb9b-42e8-97f2-6240c063cc47 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:48.873614 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1323/2624] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:39:48 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:39:48.877909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129f82b-62bf-4b9f-862f-05f569eb5827 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:48.900462 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129f82b-62bf-4b9f-862f-05f569eb5827 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:48.908725 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe818d5-c018-4f33-9554-5656cc420a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:48.909422 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe818d5-c018-4f33-9554-5656cc420a39 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:48.909705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe818d5-c018-4f33-9554-5656cc420a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:48.909980 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe818d5-c018-4f33-9554-5656cc420a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:48.910715 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe818d5-c018-4f33-9554-5656cc420a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:48.912360 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe818d5-c018-4f33-9554-5656cc420a39 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:48.925146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1302/2625] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:39:48.929027 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0af074-bb9b-42e8-97f2-6240c063cc47 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:48.940695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0af074-bb9b-42e8-97f2-6240c063cc47 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:48.946434 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf7646-086a-43b8-b68e-2a21701d8ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:48.947237 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf7646-086a-43b8-b68e-2a21701d8ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:48.947629 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf7646-086a-43b8-b68e-2a21701d8ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:48.947975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf7646-086a-43b8-b68e-2a21701d8ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:48.948971 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf7646-086a-43b8-b68e-2a21701d8ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:48.952113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf7646-086a-43b8-b68e-2a21701d8ad4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:48.953788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:48.969986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1324/2626] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:48.971175 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe818d5-c018-4f33-9554-5656cc420a39 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:48.989145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe818d5-c018-4f33-9554-5656cc420a39 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:49.003714 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1aef3-7a46-4b33-a9cb-0f6169a8432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:49.004852 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1aef3-7a46-4b33-a9cb-0f6169a8432f admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:49.005206 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1aef3-7a46-4b33-a9cb-0f6169a8432f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:49.005550 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1aef3-7a46-4b33-a9cb-0f6169a8432f admin admin] PATH_INFO: `/v3/projects/f9435794158446b4b9a98131fad6ee2a/users/453858aa06a34b678ac811af863af311/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:49.028786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1aef3-7a46-4b33-a9cb-0f6169a8432f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9435794158446b4b9a98131fad6ee2a, user_id=453858aa06a34b678ac811af863af311, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:49.031492 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1aef3-7a46-4b33-a9cb-0f6169a8432f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:49.050139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1303/2627] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:39:48 2022] PUT /identity/v3/projects/f9435794158446b4b9a98131fad6ee2a/users/453858aa06a34b678ac811af863af311/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:39:49.061171 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed46b38-6fdf-4091-9567-0f1fead2904c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:49.061453 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed46b38-6fdf-4091-9567-0f1fead2904c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:49.061728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed46b38-6fdf-4091-9567-0f1fead2904c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:49.099811 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7ed46b38-6fdf-4091-9567-0f1fead2904c None None] MFA Rules not processed for user `453858aa06a34b678ac811af863af311`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:49.101777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7ed46b38-6fdf-4091-9567-0f1fead2904c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:49.189279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1325/2628] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:39:49.194623 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1aef3-7a46-4b33-a9cb-0f6169a8432f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:49.273398 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1aef3-7a46-4b33-a9cb-0f6169a8432f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:49.278814 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6671581-04f2-4f45-8188-02337a61c13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:49.279515 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6671581-04f2-4f45-8188-02337a61c13f admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:49.279792 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6671581-04f2-4f45-8188-02337a61c13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:49.280063 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6671581-04f2-4f45-8188-02337a61c13f admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:49.280784 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6671581-04f2-4f45-8188-02337a61c13f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:49.282691 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6671581-04f2-4f45-8188-02337a61c13f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:49.315928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1304/2629] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:39:49 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:39:49.317154 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed46b38-6fdf-4091-9567-0f1fead2904c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:49.329702 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed46b38-6fdf-4091-9567-0f1fead2904c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:49.397261 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb77fce-0c22-438b-a58c-99d31410ac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:49.398066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb77fce-0c22-438b-a58c-99d31410ac90 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:49.398426 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb77fce-0c22-438b-a58c-99d31410ac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:49.398798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb77fce-0c22-438b-a58c-99d31410ac90 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:49.399481 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb77fce-0c22-438b-a58c-99d31410ac90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:49.401696 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb77fce-0c22-438b-a58c-99d31410ac90 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:49.424530 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1326/2630] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:39:49 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:39:49.428866 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6671581-04f2-4f45-8188-02337a61c13f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:49.440758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6671581-04f2-4f45-8188-02337a61c13f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:49.445583 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09559c5f-bbbd-4816-954b-81cf7a23d1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:49.446252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09559c5f-bbbd-4816-954b-81cf7a23d1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:49.446547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09559c5f-bbbd-4816-954b-81cf7a23d1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:49.446838 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09559c5f-bbbd-4816-954b-81cf7a23d1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:49.447571 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09559c5f-bbbd-4816-954b-81cf7a23d1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:49.449751 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09559c5f-bbbd-4816-954b-81cf7a23d1c9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:49.462323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1305/2631] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:49.467596 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb77fce-0c22-438b-a58c-99d31410ac90 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:49.481608 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb77fce-0c22-438b-a58c-99d31410ac90 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:49.486476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b83529-35e5-459f-a48b-7dc76da902a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:49.487421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83529-35e5-459f-a48b-7dc76da902a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:49.487813 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83529-35e5-459f-a48b-7dc76da902a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:49.488105 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b83529-35e5-459f-a48b-7dc76da902a3 admin admin] PATH_INFO: `/v3/projects/22b76619829b4895b04e79262bfac584/users/c71154b331a84b4db483599e637c851f/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:49.506773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b83529-35e5-459f-a48b-7dc76da902a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b76619829b4895b04e79262bfac584, user_id=c71154b331a84b4db483599e637c851f, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:49.509616 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b83529-35e5-459f-a48b-7dc76da902a3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:49.525480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1327/2632] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:39:49 2022] PUT /identity/v3/projects/22b76619829b4895b04e79262bfac584/users/c71154b331a84b4db483599e637c851f/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:39:49.530063 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09559c5f-bbbd-4816-954b-81cf7a23d1c9 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:49.541250 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09559c5f-bbbd-4816-954b-81cf7a23d1c9 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:49.550205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:49.614957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea0dae-2197-4832-8e72-e83b1273b11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:49.615741 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea0dae-2197-4832-8e72-e83b1273b11c admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:49.616099 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea0dae-2197-4832-8e72-e83b1273b11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:49.616449 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea0dae-2197-4832-8e72-e83b1273b11c admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:49.617253 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea0dae-2197-4832-8e72-e83b1273b11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:49.618959 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea0dae-2197-4832-8e72-e83b1273b11c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:49.645261 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1306/2633] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:39:49.649619 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b83529-35e5-459f-a48b-7dc76da902a3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:49.665430 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b83529-35e5-459f-a48b-7dc76da902a3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:49.671088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e7c85-6567-4a00-896b-64da2e7c82fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:49.672111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e7c85-6567-4a00-896b-64da2e7c82fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:49.672489 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e7c85-6567-4a00-896b-64da2e7c82fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:49.672861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e7c85-6567-4a00-896b-64da2e7c82fd admin admin] PATH_INFO: `/v3/projects/22b76619829b4895b04e79262bfac584/users/c71154b331a84b4db483599e637c851f/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:49.675325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e7c85-6567-4a00-896b-64da2e7c82fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b76619829b4895b04e79262bfac584, user_id=c71154b331a84b4db483599e637c851f, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:49.679024 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e7c85-6567-4a00-896b-64da2e7c82fd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:49.708206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1328/2634] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:39:49 2022] PUT /identity/v3/projects/22b76619829b4895b04e79262bfac584/users/c71154b331a84b4db483599e637c851f/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:49.710461 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950b85f-d843-43a3-b255-92eed133b7de None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:49.710781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950b85f-d843-43a3-b255-92eed133b7de None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:49.711065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950b85f-d843-43a3-b255-92eed133b7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:49.743598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e950b85f-d843-43a3-b255-92eed133b7de None None] MFA Rules not processed for user `c71154b331a84b4db483599e637c851f`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:49.744831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e950b85f-d843-43a3-b255-92eed133b7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:49.832592 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1307/2635] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:49.869520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e7c85-6567-4a00-896b-64da2e7c82fd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:49.872099 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0a0e7c85-6567-4a00-896b-64da2e7c82fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:49.973237 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:49.997326 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e7c85-6567-4a00-896b-64da2e7c82fd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:50.008018 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b9740-31b0-4d04-94c6-3e9bba6ab81e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:50.009229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b9740-31b0-4d04-94c6-3e9bba6ab81e service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:50.009707 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b9740-31b0-4d04-94c6-3e9bba6ab81e service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:50.010059 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b9740-31b0-4d04-94c6-3e9bba6ab81e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:50.028956 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b9740-31b0-4d04-94c6-3e9bba6ab81e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:50.030994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b9740-31b0-4d04-94c6-3e9bba6ab81e service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:50.056917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1329/2636] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:50.460521 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950b85f-d843-43a3-b255-92eed133b7de None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:50.471448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950b85f-d843-43a3-b255-92eed133b7de None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:50.483601 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689cd1d-0f99-47c9-9265-56d2870829f8 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71154b331a84b4db483599e637c851f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b76619829b4895b04e79262bfac584', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:50.484322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689cd1d-0f99-47c9-9265-56d2870829f8 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:50.484610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689cd1d-0f99-47c9-9265-56d2870829f8 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:50.485205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689cd1d-0f99-47c9-9265-56d2870829f8 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:50.486074 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689cd1d-0f99-47c9-9265-56d2870829f8 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:39:50.486444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689cd1d-0f99-47c9-9265-56d2870829f8 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:50.488470 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689cd1d-0f99-47c9-9265-56d2870829f8 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:50.503788 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1308/2637] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:39:50.507918 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b9740-31b0-4d04-94c6-3e9bba6ab81e service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:50.518598 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b9740-31b0-4d04-94c6-3e9bba6ab81e service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:50.524214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aa8b6-f5e3-460c-ad4f-8f4227afd3cc tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71154b331a84b4db483599e637c851f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b76619829b4895b04e79262bfac584', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:50.524881 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aa8b6-f5e3-460c-ad4f-8f4227afd3cc tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:50.525164 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aa8b6-f5e3-460c-ad4f-8f4227afd3cc tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:50.525439 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aa8b6-f5e3-460c-ad4f-8f4227afd3cc tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:50.526139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54aa8b6-f5e3-460c-ad4f-8f4227afd3cc tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:50.528806 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54aa8b6-f5e3-460c-ad4f-8f4227afd3cc tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:50.561695 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1330/2638] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:39:50 2022] POST /identity/v3/projects => generated 354 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:39:50.567485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689cd1d-0f99-47c9-9265-56d2870829f8 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:50.580229 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689cd1d-0f99-47c9-9265-56d2870829f8 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:50.649170 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bf9eb-34e4-415f-899d-90e18905c80f tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71154b331a84b4db483599e637c851f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b76619829b4895b04e79262bfac584', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:50.650014 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bf9eb-34e4-415f-899d-90e18905c80f tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:50.650457 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bf9eb-34e4-415f-899d-90e18905c80f tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:50.650904 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bf9eb-34e4-415f-899d-90e18905c80f tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:50.652266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bf9eb-34e4-415f-899d-90e18905c80f tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:39:50.652266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bf9eb-34e4-415f-899d-90e18905c80f tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:50.654259 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bf9eb-34e4-415f-899d-90e18905c80f tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:50.667796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1309/2639] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:39:50.707421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aa8b6-f5e3-460c-ad4f-8f4227afd3cc tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:50.719724 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aa8b6-f5e3-460c-ad4f-8f4227afd3cc tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:50.724596 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62348a0c-e9e4-4e45-975e-1a2aa90b4743 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71154b331a84b4db483599e637c851f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22b76619829b4895b04e79262bfac584', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:50.725553 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62348a0c-e9e4-4e45-975e-1a2aa90b4743 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:50.725905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62348a0c-e9e4-4e45-975e-1a2aa90b4743 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:50.726246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62348a0c-e9e4-4e45-975e-1a2aa90b4743 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] PATH_INFO: `/v3/projects/975cf3e41d8d47959182a151f6ed2ad9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:50.727541 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62348a0c-e9e4-4e45-975e-1a2aa90b4743 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=975cf3e41d8d47959182a151f6ed2ad9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:50.729501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62348a0c-e9e4-4e45-975e-1a2aa90b4743 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:50.788173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-62348a0c-e9e4-4e45-975e-1a2aa90b4743 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '975cf3e41d8d47959182a151f6ed2ad9', 'request_id': 'req-62348a0c-e9e4-4e45-975e-1a2aa90b4743'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:50.800766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-62348a0c-e9e4-4e45-975e-1a2aa90b4743 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '975cf3e41d8d47959182a151f6ed2ad9', 'request_id': 'req-62348a0c-e9e4-4e45-975e-1a2aa90b4743'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:50.818538 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-62348a0c-e9e4-4e45-975e-1a2aa90b4743 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '975cf3e41d8d47959182a151f6ed2ad9', 'request_id': 'req-62348a0c-e9e4-4e45-975e-1a2aa90b4743'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:50.839217 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-62348a0c-e9e4-4e45-975e-1a2aa90b4743 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] The token cache is being invalidate because project 975cf3e41d8d47959182a151f6ed2ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:39:50.839603 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-62348a0c-e9e4-4e45-975e-1a2aa90b4743 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:50.841002 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-62348a0c-e9e4-4e45-975e-1a2aa90b4743 tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:50.846153 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1331/2640] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:39:50 2022] DELETE /identity/v3/projects/975cf3e41d8d47959182a151f6ed2ad9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:51.054644 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bf9eb-34e4-415f-899d-90e18905c80f tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:51.056767 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d61bf9eb-34e4-415f-899d-90e18905c80f tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:51.072067 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:51.131221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bf9eb-34e4-415f-899d-90e18905c80f tempest-VolumeQuotaClassesTest-1765713953 tempest-VolumeQuotaClassesTest-1765713953-project-admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:51.192876 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba2b89-da8b-4cb8-a6dc-1ce3d7379f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:51.193686 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba2b89-da8b-4cb8-a6dc-1ce3d7379f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:51.193963 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba2b89-da8b-4cb8-a6dc-1ce3d7379f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:51.194302 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba2b89-da8b-4cb8-a6dc-1ce3d7379f46 admin admin] PATH_INFO: `/v3/users/453858aa06a34b678ac811af863af311` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:51.195769 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba2b89-da8b-4cb8-a6dc-1ce3d7379f46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=453858aa06a34b678ac811af863af311)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:51.197697 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba2b89-da8b-4cb8-a6dc-1ce3d7379f46 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:51.253125 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5fba2b89-da8b-4cb8-a6dc-1ce3d7379f46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453858aa06a34b678ac811af863af311'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:51.261165 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5fba2b89-da8b-4cb8-a6dc-1ce3d7379f46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453858aa06a34b678ac811af863af311'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:51.274867 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5fba2b89-da8b-4cb8-a6dc-1ce3d7379f46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453858aa06a34b678ac811af863af311'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:51.282588 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5fba2b89-da8b-4cb8-a6dc-1ce3d7379f46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453858aa06a34b678ac811af863af311'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:51.283237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5fba2b89-da8b-4cb8-a6dc-1ce3d7379f46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453858aa06a34b678ac811af863af311'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:51.289724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1310/2641] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:39:51 2022] DELETE /identity/v3/users/453858aa06a34b678ac811af863af311 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:51.294622 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4230ee2-5c4b-4843-ad93-a8aa58cb3ce2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:51.295205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4230ee2-5c4b-4843-ad93-a8aa58cb3ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:51.295205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4230ee2-5c4b-4843-ad93-a8aa58cb3ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:51.313958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a4230ee2-5c4b-4843-ad93-a8aa58cb3ce2 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:51.315231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a4230ee2-5c4b-4843-ad93-a8aa58cb3ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:51.381352 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1332/2642] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:51.391493 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba2b89-da8b-4cb8-a6dc-1ce3d7379f46 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:51.393091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5fba2b89-da8b-4cb8-a6dc-1ce3d7379f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:51.440343 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:51.459831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba2b89-da8b-4cb8-a6dc-1ce3d7379f46 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:51.463662 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cdfb7-2d29-4e8c-8446-1762f73fa504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:51.464416 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cdfb7-2d29-4e8c-8446-1762f73fa504 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:51.465361 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cdfb7-2d29-4e8c-8446-1762f73fa504 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:51.465728 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cdfb7-2d29-4e8c-8446-1762f73fa504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:51.478404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cdfb7-2d29-4e8c-8446-1762f73fa504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:51.478404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cdfb7-2d29-4e8c-8446-1762f73fa504 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:51.489716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1311/2643] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:51.765030 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4230ee2-5c4b-4843-ad93-a8aa58cb3ce2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:51.766720 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a4230ee2-5c4b-4843-ad93-a8aa58cb3ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:51.780455 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4230ee2-5c4b-4843-ad93-a8aa58cb3ce2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:51.785319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f0c57-5de8-4944-87bf-7fa2b9ac95ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:51.786213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f0c57-5de8-4944-87bf-7fa2b9ac95ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:51.786491 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f0c57-5de8-4944-87bf-7fa2b9ac95ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:51.786795 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f0c57-5de8-4944-87bf-7fa2b9ac95ea admin admin] PATH_INFO: `/v3/projects/f9435794158446b4b9a98131fad6ee2a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:51.787993 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f0c57-5de8-4944-87bf-7fa2b9ac95ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9435794158446b4b9a98131fad6ee2a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:51.789969 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f0c57-5de8-4944-87bf-7fa2b9ac95ea admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:51.828943 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:51.839213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ba1f0c57-5de8-4944-87bf-7fa2b9ac95ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9435794158446b4b9a98131fad6ee2a', 'request_id': 'req-ba1f0c57-5de8-4944-87bf-7fa2b9ac95ea'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:51.846944 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ba1f0c57-5de8-4944-87bf-7fa2b9ac95ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9435794158446b4b9a98131fad6ee2a', 'request_id': 'req-ba1f0c57-5de8-4944-87bf-7fa2b9ac95ea'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:51.854188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ba1f0c57-5de8-4944-87bf-7fa2b9ac95ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9435794158446b4b9a98131fad6ee2a', 'request_id': 'req-ba1f0c57-5de8-4944-87bf-7fa2b9ac95ea'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:51.865521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ba1f0c57-5de8-4944-87bf-7fa2b9ac95ea admin admin] The token cache is being invalidate because project f9435794158446b4b9a98131fad6ee2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:39:51.865807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ba1f0c57-5de8-4944-87bf-7fa2b9ac95ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:51.866442 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ba1f0c57-5de8-4944-87bf-7fa2b9ac95ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:51.867968 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1333/2644] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:39:51 2022] DELETE /identity/v3/projects/f9435794158446b4b9a98131fad6ee2a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:51.872215 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cdfb7-2d29-4e8c-8446-1762f73fa504 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:51.881982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cdfb7-2d29-4e8c-8446-1762f73fa504 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:51.939473 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928d591-523f-41fc-a978-72650208a23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:51.940360 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928d591-523f-41fc-a978-72650208a23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:51.940647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928d591-523f-41fc-a978-72650208a23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:51.940925 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928d591-523f-41fc-a978-72650208a23d admin admin] PATH_INFO: `/v3/users/c71154b331a84b4db483599e637c851f` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:51.942141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928d591-523f-41fc-a978-72650208a23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71154b331a84b4db483599e637c851f)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:51.944098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928d591-523f-41fc-a978-72650208a23d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:51.992110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0928d591-523f-41fc-a978-72650208a23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71154b331a84b4db483599e637c851f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:51.999578 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0928d591-523f-41fc-a978-72650208a23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71154b331a84b4db483599e637c851f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:52.011404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0928d591-523f-41fc-a978-72650208a23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71154b331a84b4db483599e637c851f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:52.019949 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0928d591-523f-41fc-a978-72650208a23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71154b331a84b4db483599e637c851f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:52.020598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0928d591-523f-41fc-a978-72650208a23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71154b331a84b4db483599e637c851f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:52.026816 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1312/2645] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:39:51 2022] DELETE /identity/v3/users/c71154b331a84b4db483599e637c851f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:39:52.298182 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f0c57-5de8-4944-87bf-7fa2b9ac95ea admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:52.299770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ba1f0c57-5de8-4944-87bf-7fa2b9ac95ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:52.313859 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f0c57-5de8-4944-87bf-7fa2b9ac95ea admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:52.373818 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a1a74-05e3-428b-b478-bb12601384fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:52.374675 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a1a74-05e3-428b-b478-bb12601384fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:52.374987 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a1a74-05e3-428b-b478-bb12601384fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:52.375264 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a1a74-05e3-428b-b478-bb12601384fe admin admin] PATH_INFO: `/v3/projects/22b76619829b4895b04e79262bfac584` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:52.376451 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a1a74-05e3-428b-b478-bb12601384fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=22b76619829b4895b04e79262bfac584)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:52.378344 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a1a74-05e3-428b-b478-bb12601384fe admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:52.424694 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a61a1a74-05e3-428b-b478-bb12601384fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22b76619829b4895b04e79262bfac584', 'request_id': 'req-a61a1a74-05e3-428b-b478-bb12601384fe'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:52.430464 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a61a1a74-05e3-428b-b478-bb12601384fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22b76619829b4895b04e79262bfac584', 'request_id': 'req-a61a1a74-05e3-428b-b478-bb12601384fe'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:52.438098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a61a1a74-05e3-428b-b478-bb12601384fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22b76619829b4895b04e79262bfac584', 'request_id': 'req-a61a1a74-05e3-428b-b478-bb12601384fe'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:52.449872 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a61a1a74-05e3-428b-b478-bb12601384fe admin admin] The token cache is being invalidate because project 22b76619829b4895b04e79262bfac584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:39:52.450152 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a61a1a74-05e3-428b-b478-bb12601384fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:52.450812 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a61a1a74-05e3-428b-b478-bb12601384fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:52.452324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1334/2646] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:39:52 2022] DELETE /identity/v3/projects/22b76619829b4895b04e79262bfac584 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:52.457317 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f835d-35e2-4052-96fc-02b8de879f8e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:52.457915 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f835d-35e2-4052-96fc-02b8de879f8e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:52.458076 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f835d-35e2-4052-96fc-02b8de879f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:52.475353 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a18f835d-35e2-4052-96fc-02b8de879f8e None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:52.476535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a18f835d-35e2-4052-96fc-02b8de879f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:52.535928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1313/2647] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:52.544228 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f610dd-a7d2-4f03-b062-e1bc4421d2aa None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:52.544515 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f610dd-a7d2-4f03-b062-e1bc4421d2aa None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:52.544789 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f610dd-a7d2-4f03-b062-e1bc4421d2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:52.563703 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-17f610dd-a7d2-4f03-b062-e1bc4421d2aa None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:52.564912 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-17f610dd-a7d2-4f03-b062-e1bc4421d2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:52.572836 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1335/2648] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:52.577245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f835d-35e2-4052-96fc-02b8de879f8e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:52.582727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:52.589264 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f835d-35e2-4052-96fc-02b8de879f8e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:52.595091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687db20-4b5e-4db6-ac84-e4758c6487a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:52.595771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687db20-4b5e-4db6-ac84-e4758c6487a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:52.596051 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687db20-4b5e-4db6-ac84-e4758c6487a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:52.596320 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687db20-4b5e-4db6-ac84-e4758c6487a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:52.597034 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687db20-4b5e-4db6-ac84-e4758c6487a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:39:52.597334 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687db20-4b5e-4db6-ac84-e4758c6487a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:52.598952 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687db20-4b5e-4db6-ac84-e4758c6487a4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:52.611027 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1314/2649] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:39:52.615159 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f610dd-a7d2-4f03-b062-e1bc4421d2aa None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:52.625157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f610dd-a7d2-4f03-b062-e1bc4421d2aa None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:52.629834 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba719af1-b792-4fa4-933b-486652f7fe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:52.630488 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba719af1-b792-4fa4-933b-486652f7fe27 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:52.631031 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba719af1-b792-4fa4-933b-486652f7fe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:52.631156 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba719af1-b792-4fa4-933b-486652f7fe27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:52.631836 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba719af1-b792-4fa4-933b-486652f7fe27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:52.633702 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba719af1-b792-4fa4-933b-486652f7fe27 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:52.661369 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1336/2650] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:39:52 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:39:52.665649 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687db20-4b5e-4db6-ac84-e4758c6487a4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:52.676169 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687db20-4b5e-4db6-ac84-e4758c6487a4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:52.737239 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a35001-58b7-4c48-b270-00f69fd6ad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:52.738048 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a35001-58b7-4c48-b270-00f69fd6ad16 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:52.738338 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a35001-58b7-4c48-b270-00f69fd6ad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:52.738643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a35001-58b7-4c48-b270-00f69fd6ad16 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:52.739368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a35001-58b7-4c48-b270-00f69fd6ad16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:52.741288 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a35001-58b7-4c48-b270-00f69fd6ad16 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:52.766295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1315/2651] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:39:52 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:39:52.767620 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba719af1-b792-4fa4-933b-486652f7fe27 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:52.778419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba719af1-b792-4fa4-933b-486652f7fe27 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:52.783279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c0285-367a-4930-868e-09ae3a9050e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:52.784038 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c0285-367a-4930-868e-09ae3a9050e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:52.784378 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c0285-367a-4930-868e-09ae3a9050e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:52.784719 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c0285-367a-4930-868e-09ae3a9050e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:52.785438 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c0285-367a-4930-868e-09ae3a9050e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:52.787108 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c0285-367a-4930-868e-09ae3a9050e0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:52.797959 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1337/2652] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:52.801570 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a35001-58b7-4c48-b270-00f69fd6ad16 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:52.811935 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a35001-58b7-4c48-b270-00f69fd6ad16 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:52.816528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a17bbd-8e77-48d2-af59-647571245499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:52.817175 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a17bbd-8e77-48d2-af59-647571245499 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:52.817453 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a17bbd-8e77-48d2-af59-647571245499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:52.817725 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a17bbd-8e77-48d2-af59-647571245499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:52.818437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a17bbd-8e77-48d2-af59-647571245499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:52.820068 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a17bbd-8e77-48d2-af59-647571245499 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:52.831046 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1316/2653] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:52.835116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c0285-367a-4930-868e-09ae3a9050e0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:52.845296 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c0285-367a-4930-868e-09ae3a9050e0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:52.849925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b00338-451d-41b3-a812-951eaf4936b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:52.850819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b00338-451d-41b3-a812-951eaf4936b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:52.851103 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b00338-451d-41b3-a812-951eaf4936b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:52.851373 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b00338-451d-41b3-a812-951eaf4936b0 admin admin] PATH_INFO: `/v3/projects/be70c09d965a40f9a1cb0102a68c5548/users/233c91d8171f429999b7a2e92c341bbd/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:52.863220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:52.866624 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b00338-451d-41b3-a812-951eaf4936b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be70c09d965a40f9a1cb0102a68c5548, user_id=233c91d8171f429999b7a2e92c341bbd, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:52.870215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b00338-451d-41b3-a812-951eaf4936b0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:52.884601 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1338/2654] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:39:52 2022] PUT /identity/v3/projects/be70c09d965a40f9a1cb0102a68c5548/users/233c91d8171f429999b7a2e92c341bbd/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:52.896977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fc8bf-2d90-4cdb-a45c-fc03de29612b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:52.897265 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fc8bf-2d90-4cdb-a45c-fc03de29612b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:52.897541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fc8bf-2d90-4cdb-a45c-fc03de29612b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:52.925525 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-f51fc8bf-2d90-4cdb-a45c-fc03de29612b None None] MFA Rules not processed for user `233c91d8171f429999b7a2e92c341bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:52.926798 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f51fc8bf-2d90-4cdb-a45c-fc03de29612b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:52.991308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1317/2655] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:52.995792 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b00338-451d-41b3-a812-951eaf4936b0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:53.057851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b00338-451d-41b3-a812-951eaf4936b0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:53.063282 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956863e4-41e4-495e-aff2-fc62883f6927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:53.063928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956863e4-41e4-495e-aff2-fc62883f6927 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:53.064205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956863e4-41e4-495e-aff2-fc62883f6927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:53.064469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956863e4-41e4-495e-aff2-fc62883f6927 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:53.065147 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956863e4-41e4-495e-aff2-fc62883f6927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:53.067049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956863e4-41e4-495e-aff2-fc62883f6927 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:53.092038 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1339/2656] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:39:52 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:39:53.096179 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fc8bf-2d90-4cdb-a45c-fc03de29612b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:53.107580 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fc8bf-2d90-4cdb-a45c-fc03de29612b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:53.156720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:53.163729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce8aea-2746-40ef-9fc1-36782ca4f176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:53.164570 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce8aea-2746-40ef-9fc1-36782ca4f176 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:53.165018 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce8aea-2746-40ef-9fc1-36782ca4f176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:53.165473 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce8aea-2746-40ef-9fc1-36782ca4f176 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:53.166204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce8aea-2746-40ef-9fc1-36782ca4f176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:53.168721 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce8aea-2746-40ef-9fc1-36782ca4f176 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:53.188749 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1318/2657] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:39:53 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:39:53.192944 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956863e4-41e4-495e-aff2-fc62883f6927 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:53.203132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956863e4-41e4-495e-aff2-fc62883f6927 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:53.207612 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75369e02-3eb1-4aab-978c-0328898059d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:53.208259 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75369e02-3eb1-4aab-978c-0328898059d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:53.208535 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75369e02-3eb1-4aab-978c-0328898059d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:53.208802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75369e02-3eb1-4aab-978c-0328898059d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:53.209502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75369e02-3eb1-4aab-978c-0328898059d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:53.211112 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75369e02-3eb1-4aab-978c-0328898059d3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:53.221621 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1340/2658] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:53.225732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce8aea-2746-40ef-9fc1-36782ca4f176 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:53.236752 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce8aea-2746-40ef-9fc1-36782ca4f176 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:53.241458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b68481-9157-4e53-a183-e29297240f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:53.242336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b68481-9157-4e53-a183-e29297240f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:53.242619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b68481-9157-4e53-a183-e29297240f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:53.242928 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b68481-9157-4e53-a183-e29297240f5c admin admin] PATH_INFO: `/v3/projects/c580ad3a442e4e4f9e6975e2a7a6ff22/users/91d4e9e7526d42f79f6e309d722b6106/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:53.258248 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b68481-9157-4e53-a183-e29297240f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c580ad3a442e4e4f9e6975e2a7a6ff22, user_id=91d4e9e7526d42f79f6e309d722b6106, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:53.260920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b68481-9157-4e53-a183-e29297240f5c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:53.273703 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1319/2659] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:39:53 2022] PUT /identity/v3/projects/c580ad3a442e4e4f9e6975e2a7a6ff22/users/91d4e9e7526d42f79f6e309d722b6106/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:39:53.277908 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75369e02-3eb1-4aab-978c-0328898059d3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:53.290084 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75369e02-3eb1-4aab-978c-0328898059d3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:53.346934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4b055-4977-472b-85f7-9ccb477f6fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:53.347601 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4b055-4977-472b-85f7-9ccb477f6fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:53.347878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4b055-4977-472b-85f7-9ccb477f6fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:53.348147 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4b055-4977-472b-85f7-9ccb477f6fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:53.348855 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4b055-4977-472b-85f7-9ccb477f6fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:53.350419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4b055-4977-472b-85f7-9ccb477f6fc7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:53.361107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1341/2660] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:53.365235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b68481-9157-4e53-a183-e29297240f5c admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:53.376156 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b68481-9157-4e53-a183-e29297240f5c admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:53.380821 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f74f7-d866-44be-a291-2b19d458a418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:53.381697 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f74f7-d866-44be-a291-2b19d458a418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:53.381982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f74f7-d866-44be-a291-2b19d458a418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:53.382254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f74f7-d866-44be-a291-2b19d458a418 admin admin] PATH_INFO: `/v3/projects/c580ad3a442e4e4f9e6975e2a7a6ff22/users/91d4e9e7526d42f79f6e309d722b6106/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:53.384337 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f74f7-d866-44be-a291-2b19d458a418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c580ad3a442e4e4f9e6975e2a7a6ff22, user_id=91d4e9e7526d42f79f6e309d722b6106, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:53.387215 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f74f7-d866-44be-a291-2b19d458a418 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:53.397680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1320/2661] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:39:53 2022] PUT /identity/v3/projects/c580ad3a442e4e4f9e6975e2a7a6ff22/users/91d4e9e7526d42f79f6e309d722b6106/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:53.408058 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fb517-8a0d-4bb0-b7ab-ded6300cb313 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:53.408350 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fb517-8a0d-4bb0-b7ab-ded6300cb313 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:53.408628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fb517-8a0d-4bb0-b7ab-ded6300cb313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:53.435692 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4a9fb517-8a0d-4bb0-b7ab-ded6300cb313 None None] MFA Rules not processed for user `91d4e9e7526d42f79f6e309d722b6106`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:53.436895 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4a9fb517-8a0d-4bb0-b7ab-ded6300cb313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:53.484361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:53.507472 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1342/2662] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:53.518213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f74f7-d866-44be-a291-2b19d458a418 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:53.520274 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b07f74f7-d866-44be-a291-2b19d458a418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:53.577021 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f74f7-d866-44be-a291-2b19d458a418 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:53.580836 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7666f0-cab9-4327-a348-d41cff9ea17c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:53.581473 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7666f0-cab9-4327-a348-d41cff9ea17c service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:53.581751 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7666f0-cab9-4327-a348-d41cff9ea17c service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:53.582021 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7666f0-cab9-4327-a348-d41cff9ea17c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:53.591847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7666f0-cab9-4327-a348-d41cff9ea17c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:53.593197 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7666f0-cab9-4327-a348-d41cff9ea17c service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:53.602484 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1321/2663] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:53.698347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fb517-8a0d-4bb0-b7ab-ded6300cb313 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:53.708278 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fb517-8a0d-4bb0-b7ab-ded6300cb313 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:53.711813 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fad796-7634-49d6-9388-8ecbbf93c2fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:53.712444 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fad796-7634-49d6-9388-8ecbbf93c2fd service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:53.712719 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fad796-7634-49d6-9388-8ecbbf93c2fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:53.712986 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fad796-7634-49d6-9388-8ecbbf93c2fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:53.770593 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fad796-7634-49d6-9388-8ecbbf93c2fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:53.772311 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fad796-7634-49d6-9388-8ecbbf93c2fd service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:53.781851 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1343/2664] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:56.345874 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7666f0-cab9-4327-a348-d41cff9ea17c service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:56.408222 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7666f0-cab9-4327-a348-d41cff9ea17c service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:56.412884 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a342729-374e-4380-81fb-dd19f1cbc7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:56.413695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a342729-374e-4380-81fb-dd19f1cbc7dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:56.413977 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a342729-374e-4380-81fb-dd19f1cbc7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:56.414252 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a342729-374e-4380-81fb-dd19f1cbc7dc admin admin] PATH_INFO: `/v3/users/233c91d8171f429999b7a2e92c341bbd` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:56.415457 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a342729-374e-4380-81fb-dd19f1cbc7dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=233c91d8171f429999b7a2e92c341bbd)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:56.417359 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a342729-374e-4380-81fb-dd19f1cbc7dc admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:56.462078 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5a342729-374e-4380-81fb-dd19f1cbc7dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233c91d8171f429999b7a2e92c341bbd'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:56.467917 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:56.469937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5a342729-374e-4380-81fb-dd19f1cbc7dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233c91d8171f429999b7a2e92c341bbd'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:56.484401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5a342729-374e-4380-81fb-dd19f1cbc7dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233c91d8171f429999b7a2e92c341bbd'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:56.491694 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5a342729-374e-4380-81fb-dd19f1cbc7dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233c91d8171f429999b7a2e92c341bbd'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:56.492422 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5a342729-374e-4380-81fb-dd19f1cbc7dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233c91d8171f429999b7a2e92c341bbd'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:56.498685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1322/2665] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:39:56 2022] DELETE /identity/v3/users/233c91d8171f429999b7a2e92c341bbd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:56.503255 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973befb2-b36f-4f6e-9e53-87f0eb9caa61 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:56.503717 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973befb2-b36f-4f6e-9e53-87f0eb9caa61 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:56.503852 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973befb2-b36f-4f6e-9e53-87f0eb9caa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:56.520755 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-973befb2-b36f-4f6e-9e53-87f0eb9caa61 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:56.522246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-973befb2-b36f-4f6e-9e53-87f0eb9caa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:56.581301 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1344/2666] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:56.591586 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a342729-374e-4380-81fb-dd19f1cbc7dc admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:56.593007 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5a342729-374e-4380-81fb-dd19f1cbc7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:56.650319 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a342729-374e-4380-81fb-dd19f1cbc7dc admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:56.654645 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b0d1b-353b-489f-8c7f-6bd8bb8fad8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:56.655309 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b0d1b-353b-489f-8c7f-6bd8bb8fad8f service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:56.655586 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b0d1b-353b-489f-8c7f-6bd8bb8fad8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:56.655856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b0d1b-353b-489f-8c7f-6bd8bb8fad8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:56.664827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b0d1b-353b-489f-8c7f-6bd8bb8fad8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:56.666171 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b0d1b-353b-489f-8c7f-6bd8bb8fad8f service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:56.676459 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1323/2667] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:39:56.940029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973befb2-b36f-4f6e-9e53-87f0eb9caa61 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:56.941516 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-973befb2-b36f-4f6e-9e53-87f0eb9caa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:56.954717 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973befb2-b36f-4f6e-9e53-87f0eb9caa61 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:56.959963 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf8519-e4f2-4ab7-8416-e276016e08b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:56.960830 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf8519-e4f2-4ab7-8416-e276016e08b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:56.961117 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf8519-e4f2-4ab7-8416-e276016e08b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:56.961409 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf8519-e4f2-4ab7-8416-e276016e08b8 admin admin] PATH_INFO: `/v3/projects/be70c09d965a40f9a1cb0102a68c5548` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:56.962917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf8519-e4f2-4ab7-8416-e276016e08b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be70c09d965a40f9a1cb0102a68c5548)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:56.965627 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf8519-e4f2-4ab7-8416-e276016e08b8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:57.012029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f8bf8519-e4f2-4ab7-8416-e276016e08b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be70c09d965a40f9a1cb0102a68c5548', 'request_id': 'req-f8bf8519-e4f2-4ab7-8416-e276016e08b8'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:57.017710 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f8bf8519-e4f2-4ab7-8416-e276016e08b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be70c09d965a40f9a1cb0102a68c5548', 'request_id': 'req-f8bf8519-e4f2-4ab7-8416-e276016e08b8'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:57.025245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f8bf8519-e4f2-4ab7-8416-e276016e08b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be70c09d965a40f9a1cb0102a68c5548', 'request_id': 'req-f8bf8519-e4f2-4ab7-8416-e276016e08b8'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:57.036889 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f8bf8519-e4f2-4ab7-8416-e276016e08b8 admin admin] The token cache is being invalidate because project be70c09d965a40f9a1cb0102a68c5548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:39:57.037177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f8bf8519-e4f2-4ab7-8416-e276016e08b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:57.037824 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f8bf8519-e4f2-4ab7-8416-e276016e08b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:57.039373 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1345/2668] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:39:56 2022] DELETE /identity/v3/projects/be70c09d965a40f9a1cb0102a68c5548 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:57.043495 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b0d1b-353b-489f-8c7f-6bd8bb8fad8f service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:57.053051 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b0d1b-353b-489f-8c7f-6bd8bb8fad8f service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:57.110500 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f735d5-bdc8-47e5-bf9a-780c20c0ee34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:57.111406 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f735d5-bdc8-47e5-bf9a-780c20c0ee34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:57.111689 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f735d5-bdc8-47e5-bf9a-780c20c0ee34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:57.111962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f735d5-bdc8-47e5-bf9a-780c20c0ee34 admin admin] PATH_INFO: `/v3/users/91d4e9e7526d42f79f6e309d722b6106` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:57.113141 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f735d5-bdc8-47e5-bf9a-780c20c0ee34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d4e9e7526d42f79f6e309d722b6106)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:57.115076 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f735d5-bdc8-47e5-bf9a-780c20c0ee34 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:57.162427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f1f735d5-bdc8-47e5-bf9a-780c20c0ee34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d4e9e7526d42f79f6e309d722b6106'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:57.169869 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f1f735d5-bdc8-47e5-bf9a-780c20c0ee34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d4e9e7526d42f79f6e309d722b6106'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:57.181492 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f1f735d5-bdc8-47e5-bf9a-780c20c0ee34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d4e9e7526d42f79f6e309d722b6106'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:57.184476 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:57.189369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f1f735d5-bdc8-47e5-bf9a-780c20c0ee34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d4e9e7526d42f79f6e309d722b6106'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:57.189976 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f1f735d5-bdc8-47e5-bf9a-780c20c0ee34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d4e9e7526d42f79f6e309d722b6106'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:57.196696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1324/2669] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:39:57 2022] DELETE /identity/v3/users/91d4e9e7526d42f79f6e309d722b6106 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:57.472047 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf8519-e4f2-4ab7-8416-e276016e08b8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:57.473550 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f8bf8519-e4f2-4ab7-8416-e276016e08b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:57.487150 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf8519-e4f2-4ab7-8416-e276016e08b8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:57.492979 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:57.549034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ed998-7395-4418-9728-f67d6e19c1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:57.549897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ed998-7395-4418-9728-f67d6e19c1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:57.550176 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ed998-7395-4418-9728-f67d6e19c1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:57.550443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ed998-7395-4418-9728-f67d6e19c1f8 admin admin] PATH_INFO: `/v3/projects/c580ad3a442e4e4f9e6975e2a7a6ff22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:57.551680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ed998-7395-4418-9728-f67d6e19c1f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c580ad3a442e4e4f9e6975e2a7a6ff22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:57.553567 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ed998-7395-4418-9728-f67d6e19c1f8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:57.599011 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-652ed998-7395-4418-9728-f67d6e19c1f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c580ad3a442e4e4f9e6975e2a7a6ff22', 'request_id': 'req-652ed998-7395-4418-9728-f67d6e19c1f8'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:57.604528 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-652ed998-7395-4418-9728-f67d6e19c1f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c580ad3a442e4e4f9e6975e2a7a6ff22', 'request_id': 'req-652ed998-7395-4418-9728-f67d6e19c1f8'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:57.611551 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-652ed998-7395-4418-9728-f67d6e19c1f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c580ad3a442e4e4f9e6975e2a7a6ff22', 'request_id': 'req-652ed998-7395-4418-9728-f67d6e19c1f8'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:57.622615 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-652ed998-7395-4418-9728-f67d6e19c1f8 admin admin] The token cache is being invalidate because project c580ad3a442e4e4f9e6975e2a7a6ff22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:39:57.622935 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-652ed998-7395-4418-9728-f67d6e19c1f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:57.623698 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-652ed998-7395-4418-9728-f67d6e19c1f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:57.625201 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1346/2670] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:39:57 2022] DELETE /identity/v3/projects/c580ad3a442e4e4f9e6975e2a7a6ff22 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:57.630094 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bc396-0fa7-4e1c-8bc5-8c698420fd5c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:57.630563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bc396-0fa7-4e1c-8bc5-8c698420fd5c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:57.630673 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bc396-0fa7-4e1c-8bc5-8c698420fd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:57.648866 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a63bc396-0fa7-4e1c-8bc5-8c698420fd5c None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:57.650064 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a63bc396-0fa7-4e1c-8bc5-8c698420fd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:57.709614 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1325/2671] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:57.718135 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e429450-81a2-4c36-9504-7e71dc3ed4f2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:57.718426 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e429450-81a2-4c36-9504-7e71dc3ed4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:57.718700 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e429450-81a2-4c36-9504-7e71dc3ed4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:57.737182 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2e429450-81a2-4c36-9504-7e71dc3ed4f2 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:57.738383 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2e429450-81a2-4c36-9504-7e71dc3ed4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:57.746431 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1347/2672] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:39:57.750850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bc396-0fa7-4e1c-8bc5-8c698420fd5c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:57.760507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bc396-0fa7-4e1c-8bc5-8c698420fd5c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:57.765943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb775fb5-0ecf-4ffe-9576-44e1ae4b89d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:57.766596 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb775fb5-0ecf-4ffe-9576-44e1ae4b89d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:57.766914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb775fb5-0ecf-4ffe-9576-44e1ae4b89d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:57.767187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb775fb5-0ecf-4ffe-9576-44e1ae4b89d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:57.767908 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb775fb5-0ecf-4ffe-9576-44e1ae4b89d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:39:57.768212 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb775fb5-0ecf-4ffe-9576-44e1ae4b89d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:57.769801 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb775fb5-0ecf-4ffe-9576-44e1ae4b89d1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:57.782447 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1326/2673] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:39:57.786822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e429450-81a2-4c36-9504-7e71dc3ed4f2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:57.796360 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e429450-81a2-4c36-9504-7e71dc3ed4f2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:57.800947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921f97b-3050-4b55-aa22-06a195d6f07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:57.801587 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921f97b-3050-4b55-aa22-06a195d6f07e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:57.801866 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921f97b-3050-4b55-aa22-06a195d6f07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:57.802138 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921f97b-3050-4b55-aa22-06a195d6f07e admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:57.802862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921f97b-3050-4b55-aa22-06a195d6f07e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:57.804729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921f97b-3050-4b55-aa22-06a195d6f07e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:57.830136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1348/2674] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:39:57 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:39:57.834175 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb775fb5-0ecf-4ffe-9576-44e1ae4b89d1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:57.844401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb775fb5-0ecf-4ffe-9576-44e1ae4b89d1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:57.902247 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c7a30-d3ea-4249-a617-b60a6a8e09c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:57.903041 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7a30-d3ea-4249-a617-b60a6a8e09c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:57.903323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7a30-d3ea-4249-a617-b60a6a8e09c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:57.903622 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7a30-d3ea-4249-a617-b60a6a8e09c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:57.904298 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c7a30-d3ea-4249-a617-b60a6a8e09c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:57.906193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c7a30-d3ea-4249-a617-b60a6a8e09c8 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:57.925760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1327/2675] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:39:57 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:39:57.929928 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921f97b-3050-4b55-aa22-06a195d6f07e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:57.940875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921f97b-3050-4b55-aa22-06a195d6f07e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:57.945505 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b82147-09db-4cc3-aef0-cfb906fb794c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:57.946182 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b82147-09db-4cc3-aef0-cfb906fb794c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:57.946459 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b82147-09db-4cc3-aef0-cfb906fb794c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:57.946729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b82147-09db-4cc3-aef0-cfb906fb794c admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:57.947507 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b82147-09db-4cc3-aef0-cfb906fb794c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:57.949107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b82147-09db-4cc3-aef0-cfb906fb794c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:57.959442 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1349/2676] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:57.963360 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c7a30-d3ea-4249-a617-b60a6a8e09c8 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:57.974363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c7a30-d3ea-4249-a617-b60a6a8e09c8 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:57.979131 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f8c48-71e7-40f5-923e-c91dff17cdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:57.979782 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f8c48-71e7-40f5-923e-c91dff17cdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:57.980101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f8c48-71e7-40f5-923e-c91dff17cdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:57.980900 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f8c48-71e7-40f5-923e-c91dff17cdb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:57.981621 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f8c48-71e7-40f5-923e-c91dff17cdb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:57.983229 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f8c48-71e7-40f5-923e-c91dff17cdb2 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:57.993277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1328/2677] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:57.997672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b82147-09db-4cc3-aef0-cfb906fb794c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:58.007688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b82147-09db-4cc3-aef0-cfb906fb794c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:58.012468 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9f5fa-76fb-4e7e-bde7-5495702c0bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:58.013329 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9f5fa-76fb-4e7e-bde7-5495702c0bed admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:58.013611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9f5fa-76fb-4e7e-bde7-5495702c0bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:58.013880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9f5fa-76fb-4e7e-bde7-5495702c0bed admin admin] PATH_INFO: `/v3/projects/44a6e07a784447e7a62aa98f77b6bea5/users/c51b3a0cab524fc3a231dec16f98b051/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:58.029025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9f5fa-76fb-4e7e-bde7-5495702c0bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a6e07a784447e7a62aa98f77b6bea5, user_id=c51b3a0cab524fc3a231dec16f98b051, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:58.031678 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9f5fa-76fb-4e7e-bde7-5495702c0bed admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:58.044947 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1350/2678] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:39:57 2022] PUT /identity/v3/projects/44a6e07a784447e7a62aa98f77b6bea5/users/c51b3a0cab524fc3a231dec16f98b051/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:58.056026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d1984-236c-4772-be4c-88216e4e3c59 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:58.056385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d1984-236c-4772-be4c-88216e4e3c59 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:58.056753 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d1984-236c-4772-be4c-88216e4e3c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:58.084230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4b0d1984-236c-4772-be4c-88216e4e3c59 None None] MFA Rules not processed for user `c51b3a0cab524fc3a231dec16f98b051`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:58.085443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4b0d1984-236c-4772-be4c-88216e4e3c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:58.132137 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:58.151610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1329/2679] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:58.156600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9f5fa-76fb-4e7e-bde7-5495702c0bed admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:58.195247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:58.220001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9f5fa-76fb-4e7e-bde7-5495702c0bed admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:58.224607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d33a7-e937-4e5b-9d97-70172318fe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:58.225276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d33a7-e937-4e5b-9d97-70172318fe39 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:58.225559 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d33a7-e937-4e5b-9d97-70172318fe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:58.225830 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d33a7-e937-4e5b-9d97-70172318fe39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:58.226545 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d33a7-e937-4e5b-9d97-70172318fe39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:58.228449 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d33a7-e937-4e5b-9d97-70172318fe39 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:58.253217 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1351/2680] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:39:58 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:39:58.257255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d1984-236c-4772-be4c-88216e4e3c59 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:58.267865 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d1984-236c-4772-be4c-88216e4e3c59 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:58.325301 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c9597-7665-493e-bd79-b69ddb691ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:58.325976 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c9597-7665-493e-bd79-b69ddb691ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:58.326258 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c9597-7665-493e-bd79-b69ddb691ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:58.326533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c9597-7665-493e-bd79-b69ddb691ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:58.327258 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c9597-7665-493e-bd79-b69ddb691ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:58.329160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c9597-7665-493e-bd79-b69ddb691ce1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:58.349969 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1330/2681] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:39:58 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:39:58.354004 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d33a7-e937-4e5b-9d97-70172318fe39 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:58.364555 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d33a7-e937-4e5b-9d97-70172318fe39 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:58.369394 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0421a5-7bb3-4e59-ab62-118c5dee2447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:58.370053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0421a5-7bb3-4e59-ab62-118c5dee2447 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:58.370357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0421a5-7bb3-4e59-ab62-118c5dee2447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:58.370632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0421a5-7bb3-4e59-ab62-118c5dee2447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:58.371633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0421a5-7bb3-4e59-ab62-118c5dee2447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:58.373214 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0421a5-7bb3-4e59-ab62-118c5dee2447 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:58.383658 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1352/2682] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:58.388106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c9597-7665-493e-bd79-b69ddb691ce1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:58.398565 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c9597-7665-493e-bd79-b69ddb691ce1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:58.404021 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5be00f-c400-464a-a93e-092993bde741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:58.404677 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5be00f-c400-464a-a93e-092993bde741 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:58.404960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5be00f-c400-464a-a93e-092993bde741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:58.405234 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5be00f-c400-464a-a93e-092993bde741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:58.405957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5be00f-c400-464a-a93e-092993bde741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:58.407568 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5be00f-c400-464a-a93e-092993bde741 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:58.417403 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1331/2683] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:58.421717 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0421a5-7bb3-4e59-ab62-118c5dee2447 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:58.431591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0421a5-7bb3-4e59-ab62-118c5dee2447 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:58.436391 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51072437-8cb6-4f8f-919d-06932abf948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:58.437255 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51072437-8cb6-4f8f-919d-06932abf948b admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:58.437533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51072437-8cb6-4f8f-919d-06932abf948b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:58.437807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51072437-8cb6-4f8f-919d-06932abf948b admin admin] PATH_INFO: `/v3/projects/d31590a223d1489bbab3430b307cd316/users/7f2e5102bc6a42b084a8f9d84500ac82/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:58.452593 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51072437-8cb6-4f8f-919d-06932abf948b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31590a223d1489bbab3430b307cd316, user_id=7f2e5102bc6a42b084a8f9d84500ac82, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:58.455249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51072437-8cb6-4f8f-919d-06932abf948b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:58.468900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1353/2684] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:39:58 2022] PUT /identity/v3/projects/d31590a223d1489bbab3430b307cd316/users/7f2e5102bc6a42b084a8f9d84500ac82/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:58.479304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d80734-a1c0-45b0-aab1-42640199628e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:58.479538 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d80734-a1c0-45b0-aab1-42640199628e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:58.479816 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d80734-a1c0-45b0-aab1-42640199628e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:58.505908 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-81d80734-a1c0-45b0-aab1-42640199628e None None] MFA Rules not processed for user `7f2e5102bc6a42b084a8f9d84500ac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:58.507148 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-81d80734-a1c0-45b0-aab1-42640199628e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:58.573250 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1332/2685] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:39:58.578378 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51072437-8cb6-4f8f-919d-06932abf948b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:58.643144 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51072437-8cb6-4f8f-919d-06932abf948b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:58.648139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4746f4-1c33-47d4-a343-88a639c9cfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:58.648790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4746f4-1c33-47d4-a343-88a639c9cfe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:58.649064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4746f4-1c33-47d4-a343-88a639c9cfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:58.649332 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4746f4-1c33-47d4-a343-88a639c9cfe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:58.650007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4746f4-1c33-47d4-a343-88a639c9cfe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:58.651940 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4746f4-1c33-47d4-a343-88a639c9cfe9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:58.678894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1354/2686] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:39:58 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:39:58.684220 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d80734-a1c0-45b0-aab1-42640199628e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:58.700562 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d80734-a1c0-45b0-aab1-42640199628e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:58.751530 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:58.758486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859505b1-1995-4d28-8651-ae952dec706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:58.759194 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859505b1-1995-4d28-8651-ae952dec706b admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:58.759477 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859505b1-1995-4d28-8651-ae952dec706b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:58.759752 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859505b1-1995-4d28-8651-ae952dec706b admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:58.760443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859505b1-1995-4d28-8651-ae952dec706b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:58.762408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859505b1-1995-4d28-8651-ae952dec706b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:58.782592 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1333/2687] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:39:58 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:39:58.786685 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4746f4-1c33-47d4-a343-88a639c9cfe9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:58.797720 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4746f4-1c33-47d4-a343-88a639c9cfe9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:58.802351 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8fdf0-a3a3-4a77-a348-8f212cc81d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:58.803043 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8fdf0-a3a3-4a77-a348-8f212cc81d56 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:58.803325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8fdf0-a3a3-4a77-a348-8f212cc81d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:58.803599 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8fdf0-a3a3-4a77-a348-8f212cc81d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:58.804340 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8fdf0-a3a3-4a77-a348-8f212cc81d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:58.805939 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8fdf0-a3a3-4a77-a348-8f212cc81d56 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:58.817543 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1355/2688] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:58.821681 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859505b1-1995-4d28-8651-ae952dec706b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:58.832045 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859505b1-1995-4d28-8651-ae952dec706b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:58.836763 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b61a6-f372-4da1-9eb0-f934febae9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:58.837638 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b61a6-f372-4da1-9eb0-f934febae9d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:58.837921 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b61a6-f372-4da1-9eb0-f934febae9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:58.838204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b61a6-f372-4da1-9eb0-f934febae9d8 admin admin] PATH_INFO: `/v3/projects/a8ad615eb7ab40698adb66eba6a71ccc/users/1e9b51da5ca546089f2fd4aadb3cd11a/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:58.853799 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b61a6-f372-4da1-9eb0-f934febae9d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ad615eb7ab40698adb66eba6a71ccc, user_id=1e9b51da5ca546089f2fd4aadb3cd11a, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:58.857118 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b61a6-f372-4da1-9eb0-f934febae9d8 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:58.869933 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1334/2689] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:39:58 2022] PUT /identity/v3/projects/a8ad615eb7ab40698adb66eba6a71ccc/users/1e9b51da5ca546089f2fd4aadb3cd11a/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:58.874137 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8fdf0-a3a3-4a77-a348-8f212cc81d56 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:58.884168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8fdf0-a3a3-4a77-a348-8f212cc81d56 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:58.941057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d8161-9cbf-4cbe-8df7-8c26989f6ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:58.941717 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d8161-9cbf-4cbe-8df7-8c26989f6ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:58.941997 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d8161-9cbf-4cbe-8df7-8c26989f6ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:58.942270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d8161-9cbf-4cbe-8df7-8c26989f6ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:58.943015 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d8161-9cbf-4cbe-8df7-8c26989f6ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:58.944591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d8161-9cbf-4cbe-8df7-8c26989f6ebd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:58.945818 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:58.956069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1356/2690] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:58.960260 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b61a6-f372-4da1-9eb0-f934febae9d8 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:58.970886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b61a6-f372-4da1-9eb0-f934febae9d8 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:58.975589 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c6044-182c-419f-986e-2d27b89961f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:58.976455 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c6044-182c-419f-986e-2d27b89961f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:58.976732 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c6044-182c-419f-986e-2d27b89961f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:58.977003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c6044-182c-419f-986e-2d27b89961f7 admin admin] PATH_INFO: `/v3/projects/a8ad615eb7ab40698adb66eba6a71ccc/users/1e9b51da5ca546089f2fd4aadb3cd11a/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:58.979110 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c6044-182c-419f-986e-2d27b89961f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ad615eb7ab40698adb66eba6a71ccc, user_id=1e9b51da5ca546089f2fd4aadb3cd11a, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:58.982225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c6044-182c-419f-986e-2d27b89961f7 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:58.992250 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1335/2691] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:39:58 2022] PUT /identity/v3/projects/a8ad615eb7ab40698adb66eba6a71ccc/users/1e9b51da5ca546089f2fd4aadb3cd11a/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:39:59.002489 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fec7f3-e8b5-456d-b1e1-5a5ec85e5b84 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:59.002717 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fec7f3-e8b5-456d-b1e1-5a5ec85e5b84 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:59.003055 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fec7f3-e8b5-456d-b1e1-5a5ec85e5b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:59.029602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-63fec7f3-e8b5-456d-b1e1-5a5ec85e5b84 None None] MFA Rules not processed for user `1e9b51da5ca546089f2fd4aadb3cd11a`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:59.030837 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-63fec7f3-e8b5-456d-b1e1-5a5ec85e5b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:59.098024 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1357/2692] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:39:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:59.109462 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c6044-182c-419f-986e-2d27b89961f7 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:59.111270 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1c6c6044-182c-419f-986e-2d27b89961f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:59.170385 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c6044-182c-419f-986e-2d27b89961f7 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:59.174027 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abf9cd-5793-494f-a54b-dc5e05b63b48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:59.174659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abf9cd-5793-494f-a54b-dc5e05b63b48 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:59.174987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abf9cd-5793-494f-a54b-dc5e05b63b48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:59.175257 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abf9cd-5793-494f-a54b-dc5e05b63b48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:59.184846 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abf9cd-5793-494f-a54b-dc5e05b63b48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:59.186320 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abf9cd-5793-494f-a54b-dc5e05b63b48 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:59.196669 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1336/2693] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:59.237137 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fec7f3-e8b5-456d-b1e1-5a5ec85e5b84 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:59.238670 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-63fec7f3-e8b5-456d-b1e1-5a5ec85e5b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:59.251712 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fec7f3-e8b5-456d-b1e1-5a5ec85e5b84 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:59.255496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94762d2e-a8e0-4cf5-af08-ba82cb1ac1ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:59.256117 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94762d2e-a8e0-4cf5-af08-ba82cb1ac1ac service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:59.256430 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94762d2e-a8e0-4cf5-af08-ba82cb1ac1ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:59.256702 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94762d2e-a8e0-4cf5-af08-ba82cb1ac1ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:59.320948 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94762d2e-a8e0-4cf5-af08-ba82cb1ac1ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:59.322426 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94762d2e-a8e0-4cf5-af08-ba82cb1ac1ac service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:59.332502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1358/2694] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:40:02.181673 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abf9cd-5793-494f-a54b-dc5e05b63b48 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:02.248320 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abf9cd-5793-494f-a54b-dc5e05b63b48 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:02.252929 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe961040-05c6-4b7d-9d1c-3cddc1d23f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:02.253811 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe961040-05c6-4b7d-9d1c-3cddc1d23f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:02.254087 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe961040-05c6-4b7d-9d1c-3cddc1d23f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:02.254358 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe961040-05c6-4b7d-9d1c-3cddc1d23f1c admin admin] PATH_INFO: `/v3/users/c51b3a0cab524fc3a231dec16f98b051` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:02.255605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe961040-05c6-4b7d-9d1c-3cddc1d23f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c51b3a0cab524fc3a231dec16f98b051)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:02.257510 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe961040-05c6-4b7d-9d1c-3cddc1d23f1c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:02.308324 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fe961040-05c6-4b7d-9d1c-3cddc1d23f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c51b3a0cab524fc3a231dec16f98b051'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:02.314479 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:02.317061 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fe961040-05c6-4b7d-9d1c-3cddc1d23f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c51b3a0cab524fc3a231dec16f98b051'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:02.332485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fe961040-05c6-4b7d-9d1c-3cddc1d23f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c51b3a0cab524fc3a231dec16f98b051'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:02.341849 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fe961040-05c6-4b7d-9d1c-3cddc1d23f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c51b3a0cab524fc3a231dec16f98b051'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:02.342468 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fe961040-05c6-4b7d-9d1c-3cddc1d23f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c51b3a0cab524fc3a231dec16f98b051'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:02.348967 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1337/2695] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:40:02 2022] DELETE /identity/v3/users/c51b3a0cab524fc3a231dec16f98b051 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:40:02.353601 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e93ad-9426-4a00-bdb0-b14ec1b81199 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:02.354088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e93ad-9426-4a00-bdb0-b14ec1b81199 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:02.354207 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e93ad-9426-4a00-bdb0-b14ec1b81199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:02.372031 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fe0e93ad-9426-4a00-bdb0-b14ec1b81199 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:40:02.373232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fe0e93ad-9426-4a00-bdb0-b14ec1b81199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:02.434425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1359/2696] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:40:02.443857 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe961040-05c6-4b7d-9d1c-3cddc1d23f1c admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:02.445255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fe961040-05c6-4b7d-9d1c-3cddc1d23f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:02.502853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe961040-05c6-4b7d-9d1c-3cddc1d23f1c admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:02.506480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf8100-9426-4675-97c1-bb56c7530159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:02.507146 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf8100-9426-4675-97c1-bb56c7530159 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:02.507427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf8100-9426-4675-97c1-bb56c7530159 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:02.507698 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf8100-9426-4675-97c1-bb56c7530159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:02.517270 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf8100-9426-4675-97c1-bb56c7530159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:02.518674 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf8100-9426-4675-97c1-bb56c7530159 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:02.528517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1338/2697] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:40:02.796322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e93ad-9426-4a00-bdb0-b14ec1b81199 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:02.797828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fe0e93ad-9426-4a00-bdb0-b14ec1b81199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:02.811190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e93ad-9426-4a00-bdb0-b14ec1b81199 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:02.815919 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb78c93-3b03-413f-a3d6-ef431e85c8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:02.816854 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb78c93-3b03-413f-a3d6-ef431e85c8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:02.817205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb78c93-3b03-413f-a3d6-ef431e85c8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:02.817543 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb78c93-3b03-413f-a3d6-ef431e85c8d2 admin admin] PATH_INFO: `/v3/projects/44a6e07a784447e7a62aa98f77b6bea5` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:02.818835 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb78c93-3b03-413f-a3d6-ef431e85c8d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44a6e07a784447e7a62aa98f77b6bea5)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:02.820867 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb78c93-3b03-413f-a3d6-ef431e85c8d2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:02.838304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:02.869778 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3cb78c93-3b03-413f-a3d6-ef431e85c8d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44a6e07a784447e7a62aa98f77b6bea5', 'request_id': 'req-3cb78c93-3b03-413f-a3d6-ef431e85c8d2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:02.875771 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3cb78c93-3b03-413f-a3d6-ef431e85c8d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44a6e07a784447e7a62aa98f77b6bea5', 'request_id': 'req-3cb78c93-3b03-413f-a3d6-ef431e85c8d2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:02.882805 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3cb78c93-3b03-413f-a3d6-ef431e85c8d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44a6e07a784447e7a62aa98f77b6bea5', 'request_id': 'req-3cb78c93-3b03-413f-a3d6-ef431e85c8d2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:02.894112 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3cb78c93-3b03-413f-a3d6-ef431e85c8d2 admin admin] The token cache is being invalidate because project 44a6e07a784447e7a62aa98f77b6bea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:40:02.894401 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3cb78c93-3b03-413f-a3d6-ef431e85c8d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:02.895065 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3cb78c93-3b03-413f-a3d6-ef431e85c8d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:02.896869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1360/2698] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:40:02 2022] DELETE /identity/v3/projects/44a6e07a784447e7a62aa98f77b6bea5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:40:02.901010 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf8100-9426-4675-97c1-bb56c7530159 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:02.910605 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf8100-9426-4675-97c1-bb56c7530159 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:02.967249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c36b1c-2f76-4a40-b9ef-7e1b685c2df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:02.968121 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c36b1c-2f76-4a40-b9ef-7e1b685c2df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:02.968396 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c36b1c-2f76-4a40-b9ef-7e1b685c2df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:02.968743 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c36b1c-2f76-4a40-b9ef-7e1b685c2df6 admin admin] PATH_INFO: `/v3/users/7f2e5102bc6a42b084a8f9d84500ac82` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:02.970053 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c36b1c-2f76-4a40-b9ef-7e1b685c2df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2e5102bc6a42b084a8f9d84500ac82)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:02.972085 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c36b1c-2f76-4a40-b9ef-7e1b685c2df6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:03.017888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-78c36b1c-2f76-4a40-b9ef-7e1b685c2df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2e5102bc6a42b084a8f9d84500ac82'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:03.024911 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-78c36b1c-2f76-4a40-b9ef-7e1b685c2df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2e5102bc6a42b084a8f9d84500ac82'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:03.036565 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-78c36b1c-2f76-4a40-b9ef-7e1b685c2df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2e5102bc6a42b084a8f9d84500ac82'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:03.039024 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:03.045091 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-78c36b1c-2f76-4a40-b9ef-7e1b685c2df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2e5102bc6a42b084a8f9d84500ac82'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:03.045839 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-78c36b1c-2f76-4a40-b9ef-7e1b685c2df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2e5102bc6a42b084a8f9d84500ac82'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:03.053072 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1339/2699] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:40:02 2022] DELETE /identity/v3/users/7f2e5102bc6a42b084a8f9d84500ac82 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:40:03.326398 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb78c93-3b03-413f-a3d6-ef431e85c8d2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:03.327882 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3cb78c93-3b03-413f-a3d6-ef431e85c8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:03.343294 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb78c93-3b03-413f-a3d6-ef431e85c8d2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:03.401264 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67540ccb-0b31-4662-bbe0-1c9f2c8fa3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:03.402132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67540ccb-0b31-4662-bbe0-1c9f2c8fa3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:03.402957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67540ccb-0b31-4662-bbe0-1c9f2c8fa3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:03.403229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67540ccb-0b31-4662-bbe0-1c9f2c8fa3b7 admin admin] PATH_INFO: `/v3/projects/d31590a223d1489bbab3430b307cd316` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:03.404419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67540ccb-0b31-4662-bbe0-1c9f2c8fa3b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31590a223d1489bbab3430b307cd316)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:03.406336 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67540ccb-0b31-4662-bbe0-1c9f2c8fa3b7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:03.452731 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-67540ccb-0b31-4662-bbe0-1c9f2c8fa3b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31590a223d1489bbab3430b307cd316', 'request_id': 'req-67540ccb-0b31-4662-bbe0-1c9f2c8fa3b7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:03.458676 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-67540ccb-0b31-4662-bbe0-1c9f2c8fa3b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31590a223d1489bbab3430b307cd316', 'request_id': 'req-67540ccb-0b31-4662-bbe0-1c9f2c8fa3b7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:03.468238 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-67540ccb-0b31-4662-bbe0-1c9f2c8fa3b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31590a223d1489bbab3430b307cd316', 'request_id': 'req-67540ccb-0b31-4662-bbe0-1c9f2c8fa3b7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:03.480327 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-67540ccb-0b31-4662-bbe0-1c9f2c8fa3b7 admin admin] The token cache is being invalidate because project d31590a223d1489bbab3430b307cd316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:40:03.481273 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-67540ccb-0b31-4662-bbe0-1c9f2c8fa3b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:03.481925 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-67540ccb-0b31-4662-bbe0-1c9f2c8fa3b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:03.483726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1361/2700] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:40:03 2022] DELETE /identity/v3/projects/d31590a223d1489bbab3430b307cd316 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:40:03.487767 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c36b1c-2f76-4a40-b9ef-7e1b685c2df6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:03.489232 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-78c36b1c-2f76-4a40-b9ef-7e1b685c2df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:03.504824 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c36b1c-2f76-4a40-b9ef-7e1b685c2df6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:03.571484 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1474864-7fd4-464a-9b58-5cf8a46ba397 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:03.571724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eca0cf-f786-46fa-86b1-97274eb1e8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:03.571857 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1474864-7fd4-464a-9b58-5cf8a46ba397 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:03.572027 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1474864-7fd4-464a-9b58-5cf8a46ba397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:03.572842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eca0cf-f786-46fa-86b1-97274eb1e8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:03.573138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eca0cf-f786-46fa-86b1-97274eb1e8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:03.573471 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eca0cf-f786-46fa-86b1-97274eb1e8b9 admin admin] PATH_INFO: `/v3/users/1e9b51da5ca546089f2fd4aadb3cd11a` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:03.575969 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eca0cf-f786-46fa-86b1-97274eb1e8b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9b51da5ca546089f2fd4aadb3cd11a)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:03.578136 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eca0cf-f786-46fa-86b1-97274eb1e8b9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:03.591616 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e1474864-7fd4-464a-9b58-5cf8a46ba397 None None] MFA Rules not processed for user `18030043de1942779baf3ad94aec4071`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:40:03.592626 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e1474864-7fd4-464a-9b58-5cf8a46ba397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:03.627586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:03.631849 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c7eca0cf-f786-46fa-86b1-97274eb1e8b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9b51da5ca546089f2fd4aadb3cd11a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:03.639490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c7eca0cf-f786-46fa-86b1-97274eb1e8b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9b51da5ca546089f2fd4aadb3cd11a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:03.652298 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c7eca0cf-f786-46fa-86b1-97274eb1e8b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9b51da5ca546089f2fd4aadb3cd11a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:03.658116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1362/2701] 10.222.0.25 () {58 vars in 967 bytes} [Tue Jul 19 12:40:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:40:03.661224 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c7eca0cf-f786-46fa-86b1-97274eb1e8b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9b51da5ca546089f2fd4aadb3cd11a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:03.661905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c7eca0cf-f786-46fa-86b1-97274eb1e8b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9b51da5ca546089f2fd4aadb3cd11a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:03.671319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1474864-7fd4-464a-9b58-5cf8a46ba397 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:03.672531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1340/2702] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:40:03 2022] DELETE /identity/v3/users/1e9b51da5ca546089f2fd4aadb3cd11a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:40:03.672680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e1474864-7fd4-464a-9b58-5cf8a46ba397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:03.744858 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1474864-7fd4-464a-9b58-5cf8a46ba397 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:03.807527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727b825-1bc1-4651-82f2-ea6fec313ceb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc2e1079d34745a279588028945c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:03.808175 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727b825-1bc1-4651-82f2-ea6fec313ceb service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:03.808496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727b825-1bc1-4651-82f2-ea6fec313ceb service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:03.808881 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727b825-1bc1-4651-82f2-ea6fec313ceb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:03.810749 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0727b825-1bc1-4651-82f2-ea6fec313ceb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:03.873511 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727b825-1bc1-4651-82f2-ea6fec313ceb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:03.875245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727b825-1bc1-4651-82f2-ea6fec313ceb service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:03.883800 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1363/2703] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 19 12:40:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 12:40:03.954880 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eca0cf-f786-46fa-86b1-97274eb1e8b9 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:03.957192 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c7eca0cf-f786-46fa-86b1-97274eb1e8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:04.033706 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eca0cf-f786-46fa-86b1-97274eb1e8b9 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:04.039250 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceea0ee-269d-41a0-b4a2-dea4ee8fe9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:04.040139 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceea0ee-269d-41a0-b4a2-dea4ee8fe9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:04.040420 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceea0ee-269d-41a0-b4a2-dea4ee8fe9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:04.040853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceea0ee-269d-41a0-b4a2-dea4ee8fe9d5 admin admin] PATH_INFO: `/v3/projects/a8ad615eb7ab40698adb66eba6a71ccc` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:04.042023 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceea0ee-269d-41a0-b4a2-dea4ee8fe9d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8ad615eb7ab40698adb66eba6a71ccc)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:04.044188 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceea0ee-269d-41a0-b4a2-dea4ee8fe9d5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:04.064125 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:04.098916 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fceea0ee-269d-41a0-b4a2-dea4ee8fe9d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8ad615eb7ab40698adb66eba6a71ccc', 'request_id': 'req-fceea0ee-269d-41a0-b4a2-dea4ee8fe9d5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:04.105720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fceea0ee-269d-41a0-b4a2-dea4ee8fe9d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8ad615eb7ab40698adb66eba6a71ccc', 'request_id': 'req-fceea0ee-269d-41a0-b4a2-dea4ee8fe9d5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:04.114899 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fceea0ee-269d-41a0-b4a2-dea4ee8fe9d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8ad615eb7ab40698adb66eba6a71ccc', 'request_id': 'req-fceea0ee-269d-41a0-b4a2-dea4ee8fe9d5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:04.128338 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fceea0ee-269d-41a0-b4a2-dea4ee8fe9d5 admin admin] The token cache is being invalidate because project a8ad615eb7ab40698adb66eba6a71ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:40:04.128624 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fceea0ee-269d-41a0-b4a2-dea4ee8fe9d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:04.129314 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fceea0ee-269d-41a0-b4a2-dea4ee8fe9d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:04.131164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1341/2704] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:40:03 2022] DELETE /identity/v3/projects/a8ad615eb7ab40698adb66eba6a71ccc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:40:04.139348 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf2a32-f434-49d7-8226-52203fad4975 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:04.140050 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf2a32-f434-49d7-8226-52203fad4975 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:04.140334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf2a32-f434-49d7-8226-52203fad4975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:04.159718 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-acbf2a32-f434-49d7-8226-52203fad4975 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:40:04.160829 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-acbf2a32-f434-49d7-8226-52203fad4975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:04.178593 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:04.224605 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1364/2705] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:40:04.289335 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2b041-34d3-45f0-a722-f02593a4b638 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:04.289619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2b041-34d3-45f0-a722-f02593a4b638 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:04.289896 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2b041-34d3-45f0-a722-f02593a4b638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:04.308272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-bfc2b041-34d3-45f0-a722-f02593a4b638 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:40:04.310142 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bfc2b041-34d3-45f0-a722-f02593a4b638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:04.318625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1342/2706] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:40:04.322990 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf2a32-f434-49d7-8226-52203fad4975 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:04.333663 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf2a32-f434-49d7-8226-52203fad4975 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:04.340631 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c0650-4f4a-4e63-8051-e568cff0410b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:04.341606 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c0650-4f4a-4e63-8051-e568cff0410b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:04.341973 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c0650-4f4a-4e63-8051-e568cff0410b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:04.342245 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c0650-4f4a-4e63-8051-e568cff0410b admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:04.343143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c0650-4f4a-4e63-8051-e568cff0410b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:40:04.343448 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c0650-4f4a-4e63-8051-e568cff0410b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:04.345055 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c0650-4f4a-4e63-8051-e568cff0410b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:04.357713 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1365/2707] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:40:04.362492 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2b041-34d3-45f0-a722-f02593a4b638 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:04.372900 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2b041-34d3-45f0-a722-f02593a4b638 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:04.377626 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628242b-4dd5-4785-8a27-c3efd15778df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:04.378308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628242b-4dd5-4785-8a27-c3efd15778df admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:04.378610 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628242b-4dd5-4785-8a27-c3efd15778df admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:04.378930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628242b-4dd5-4785-8a27-c3efd15778df admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:04.379630 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628242b-4dd5-4785-8a27-c3efd15778df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:04.381530 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628242b-4dd5-4785-8a27-c3efd15778df admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:04.411373 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1343/2708] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:40:04 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:40:04.415586 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c0650-4f4a-4e63-8051-e568cff0410b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:04.426199 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c0650-4f4a-4e63-8051-e568cff0410b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:04.485561 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2de2f-3b6f-43e1-a74d-71efe1cb00ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:04.486234 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2de2f-3b6f-43e1-a74d-71efe1cb00ea admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:04.486517 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2de2f-3b6f-43e1-a74d-71efe1cb00ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:04.486835 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2de2f-3b6f-43e1-a74d-71efe1cb00ea admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:04.487536 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2de2f-3b6f-43e1-a74d-71efe1cb00ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:04.489446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2de2f-3b6f-43e1-a74d-71efe1cb00ea admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:04.508221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1366/2709] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:40:04 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:40:04.513033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628242b-4dd5-4785-8a27-c3efd15778df admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:04.523691 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628242b-4dd5-4785-8a27-c3efd15778df admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:04.528922 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc2a87-ba3a-4717-874e-220c549306d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:04.529576 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc2a87-ba3a-4717-874e-220c549306d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:04.529858 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc2a87-ba3a-4717-874e-220c549306d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:04.530132 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc2a87-ba3a-4717-874e-220c549306d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:04.530892 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc2a87-ba3a-4717-874e-220c549306d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:04.532477 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc2a87-ba3a-4717-874e-220c549306d0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:04.542812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1344/2710] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:40:04.546767 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2de2f-3b6f-43e1-a74d-71efe1cb00ea admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:04.556850 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2de2f-3b6f-43e1-a74d-71efe1cb00ea admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:04.561781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a407ac-3e6b-4cec-996f-529cb39357b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:04.562438 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a407ac-3e6b-4cec-996f-529cb39357b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:04.562716 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a407ac-3e6b-4cec-996f-529cb39357b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:04.563015 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a407ac-3e6b-4cec-996f-529cb39357b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:04.563731 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a407ac-3e6b-4cec-996f-529cb39357b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:04.565303 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a407ac-3e6b-4cec-996f-529cb39357b0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:04.576015 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1367/2711] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:40:04.580298 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc2a87-ba3a-4717-874e-220c549306d0 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:04.590698 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc2a87-ba3a-4717-874e-220c549306d0 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:04.595400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8718536-a4e9-4aca-b6f1-64e0e60457ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:04.596266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8718536-a4e9-4aca-b6f1-64e0e60457ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:04.596548 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8718536-a4e9-4aca-b6f1-64e0e60457ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:04.596822 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8718536-a4e9-4aca-b6f1-64e0e60457ba admin admin] PATH_INFO: `/v3/projects/653cd94ac0a449c3aac795650f195ed3/users/37fe6160e966452e9ac14f88c0555033/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:04.611424 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8718536-a4e9-4aca-b6f1-64e0e60457ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=653cd94ac0a449c3aac795650f195ed3, user_id=37fe6160e966452e9ac14f88c0555033, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:04.614047 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8718536-a4e9-4aca-b6f1-64e0e60457ba admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:04.626984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1345/2712] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:40:04 2022] PUT /identity/v3/projects/653cd94ac0a449c3aac795650f195ed3/users/37fe6160e966452e9ac14f88c0555033/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:40:04.639061 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c63b7-71ba-40e8-873b-885096c08fdf None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:04.639468 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c63b7-71ba-40e8-873b-885096c08fdf None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:04.639871 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c63b7-71ba-40e8-873b-885096c08fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:04.668305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6b4c63b7-71ba-40e8-873b-885096c08fdf None None] MFA Rules not processed for user `37fe6160e966452e9ac14f88c0555033`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:40:04.669445 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6b4c63b7-71ba-40e8-873b-885096c08fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:04.737794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1368/2713] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:40:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:40:04.742276 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8718536-a4e9-4aca-b6f1-64e0e60457ba admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:04.805802 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8718536-a4e9-4aca-b6f1-64e0e60457ba admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:04.811119 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673008b-349a-4cf3-a342-c605dc399630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:04.811782 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673008b-349a-4cf3-a342-c605dc399630 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:04.812065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673008b-349a-4cf3-a342-c605dc399630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:04.812340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673008b-349a-4cf3-a342-c605dc399630 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:04.813024 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673008b-349a-4cf3-a342-c605dc399630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:04.814938 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673008b-349a-4cf3-a342-c605dc399630 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:04.840520 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1346/2714] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:40:04 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:40:04.844671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c63b7-71ba-40e8-873b-885096c08fdf None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:04.855519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c63b7-71ba-40e8-873b-885096c08fdf None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:04.867737 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:04.915075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f915b-501a-45ba-8773-a58ac524c40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:04.915727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f915b-501a-45ba-8773-a58ac524c40a admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:04.916007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f915b-501a-45ba-8773-a58ac524c40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:04.916279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f915b-501a-45ba-8773-a58ac524c40a admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:04.917000 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f915b-501a-45ba-8773-a58ac524c40a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:04.919395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f915b-501a-45ba-8773-a58ac524c40a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:04.939419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1369/2715] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:40:04 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:40:04.943408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673008b-349a-4cf3-a342-c605dc399630 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:04.954355 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673008b-349a-4cf3-a342-c605dc399630 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:04.959219 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98be1fa-a639-4e01-89ab-d900dd887f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:04.959911 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98be1fa-a639-4e01-89ab-d900dd887f8c admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:04.960191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98be1fa-a639-4e01-89ab-d900dd887f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:04.960492 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98be1fa-a639-4e01-89ab-d900dd887f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:04.961271 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98be1fa-a639-4e01-89ab-d900dd887f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:04.962923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98be1fa-a639-4e01-89ab-d900dd887f8c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:04.973702 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1347/2716] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:40:04.977845 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f915b-501a-45ba-8773-a58ac524c40a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:04.987764 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f915b-501a-45ba-8773-a58ac524c40a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:04.992249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca98149-42b5-4145-8995-b3bc27e4f26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:04.993114 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca98149-42b5-4145-8995-b3bc27e4f26c admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:04.993388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca98149-42b5-4145-8995-b3bc27e4f26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:04.993653 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca98149-42b5-4145-8995-b3bc27e4f26c admin admin] PATH_INFO: `/v3/projects/b3fe30d57ff947349ba5bc727702feba/users/759efe366d2e4f7b85480f55f2b1c42a/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:05.008747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca98149-42b5-4145-8995-b3bc27e4f26c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3fe30d57ff947349ba5bc727702feba, user_id=759efe366d2e4f7b85480f55f2b1c42a, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:05.011410 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca98149-42b5-4145-8995-b3bc27e4f26c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:05.026010 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1370/2717] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:40:04 2022] PUT /identity/v3/projects/b3fe30d57ff947349ba5bc727702feba/users/759efe366d2e4f7b85480f55f2b1c42a/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:40:05.030234 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98be1fa-a639-4e01-89ab-d900dd887f8c admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:05.040223 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98be1fa-a639-4e01-89ab-d900dd887f8c admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:05.049096 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:05.098682 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac8b1a-8b7c-424c-a00e-579b2ffa33c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:05.099381 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac8b1a-8b7c-424c-a00e-579b2ffa33c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:05.099665 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac8b1a-8b7c-424c-a00e-579b2ffa33c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:05.099941 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac8b1a-8b7c-424c-a00e-579b2ffa33c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:05.100664 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac8b1a-8b7c-424c-a00e-579b2ffa33c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:05.102249 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac8b1a-8b7c-424c-a00e-579b2ffa33c0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:05.112518 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1348/2718] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:40:05.116893 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca98149-42b5-4145-8995-b3bc27e4f26c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:05.127914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca98149-42b5-4145-8995-b3bc27e4f26c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:05.132480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a15eb3-8d06-409d-8d41-71a5f72ab899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:05.133346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a15eb3-8d06-409d-8d41-71a5f72ab899 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:05.133626 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a15eb3-8d06-409d-8d41-71a5f72ab899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:05.133894 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a15eb3-8d06-409d-8d41-71a5f72ab899 admin admin] PATH_INFO: `/v3/projects/b3fe30d57ff947349ba5bc727702feba/users/759efe366d2e4f7b85480f55f2b1c42a/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:05.135877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a15eb3-8d06-409d-8d41-71a5f72ab899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3fe30d57ff947349ba5bc727702feba, user_id=759efe366d2e4f7b85480f55f2b1c42a, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:05.138471 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a15eb3-8d06-409d-8d41-71a5f72ab899 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:05.148881 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1371/2719] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:40:05 2022] PUT /identity/v3/projects/b3fe30d57ff947349ba5bc727702feba/users/759efe366d2e4f7b85480f55f2b1c42a/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:40:05.158956 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd08063-572e-4843-8960-8d38211e9cf1 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:05.159250 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd08063-572e-4843-8960-8d38211e9cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:05.159532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd08063-572e-4843-8960-8d38211e9cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:05.186597 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3fd08063-572e-4843-8960-8d38211e9cf1 None None] MFA Rules not processed for user `759efe366d2e4f7b85480f55f2b1c42a`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:40:05.187788 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3fd08063-572e-4843-8960-8d38211e9cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:05.255398 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1349/2720] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:40:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:40:05.268346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a15eb3-8d06-409d-8d41-71a5f72ab899 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:05.270083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-60a15eb3-8d06-409d-8d41-71a5f72ab899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:05.327188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a15eb3-8d06-409d-8d41-71a5f72ab899 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:05.330791 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bac944-7685-4c28-81ed-37685e9e49fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:05.331418 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bac944-7685-4c28-81ed-37685e9e49fc service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:05.331694 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bac944-7685-4c28-81ed-37685e9e49fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:05.331962 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bac944-7685-4c28-81ed-37685e9e49fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:05.341129 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bac944-7685-4c28-81ed-37685e9e49fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:05.342532 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bac944-7685-4c28-81ed-37685e9e49fc service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:05.352233 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1372/2721] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:40:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:40:05.424254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd08063-572e-4843-8960-8d38211e9cf1 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:05.434815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd08063-572e-4843-8960-8d38211e9cf1 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:05.438537 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2216c-1f92-413a-8529-b57984b98618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:05.439152 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2216c-1f92-413a-8529-b57984b98618 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:05.439440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2216c-1f92-413a-8529-b57984b98618 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:05.439717 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2216c-1f92-413a-8529-b57984b98618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:05.499035 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2216c-1f92-413a-8529-b57984b98618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:05.500454 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2216c-1f92-413a-8529-b57984b98618 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:05.509227 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1350/2722] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:40:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:40:05.767185 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bac944-7685-4c28-81ed-37685e9e49fc service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:05.830973 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bac944-7685-4c28-81ed-37685e9e49fc service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:05.836742 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d030af8-3ece-4289-8dda-7ef410177f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:05.837734 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d030af8-3ece-4289-8dda-7ef410177f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:05.838015 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d030af8-3ece-4289-8dda-7ef410177f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:05.838285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d030af8-3ece-4289-8dda-7ef410177f1d admin admin] PATH_INFO: `/v3/users/37fe6160e966452e9ac14f88c0555033` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:05.839501 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d030af8-3ece-4289-8dda-7ef410177f1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=37fe6160e966452e9ac14f88c0555033)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:05.841974 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d030af8-3ece-4289-8dda-7ef410177f1d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:05.855980 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:05.889669 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5d030af8-3ece-4289-8dda-7ef410177f1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37fe6160e966452e9ac14f88c0555033'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:05.896908 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5d030af8-3ece-4289-8dda-7ef410177f1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37fe6160e966452e9ac14f88c0555033'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:05.909705 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5d030af8-3ece-4289-8dda-7ef410177f1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37fe6160e966452e9ac14f88c0555033'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:05.916994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5d030af8-3ece-4289-8dda-7ef410177f1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37fe6160e966452e9ac14f88c0555033'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:05.917604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5d030af8-3ece-4289-8dda-7ef410177f1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37fe6160e966452e9ac14f88c0555033'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:05.923863 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1373/2723] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:40:05 2022] DELETE /identity/v3/users/37fe6160e966452e9ac14f88c0555033 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:40:05.928499 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba09977-93a6-4d1e-becd-a2728fbb6e62 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:05.928967 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba09977-93a6-4d1e-becd-a2728fbb6e62 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:05.929063 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba09977-93a6-4d1e-becd-a2728fbb6e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:05.945929 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-fba09977-93a6-4d1e-becd-a2728fbb6e62 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:40:05.947092 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fba09977-93a6-4d1e-becd-a2728fbb6e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:05.976230 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:06.007598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1351/2724] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:40:06.017774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d030af8-3ece-4289-8dda-7ef410177f1d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:06.019281 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5d030af8-3ece-4289-8dda-7ef410177f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:06.077203 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d030af8-3ece-4289-8dda-7ef410177f1d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:06.080930 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78b693-1d66-42c7-8241-1cffda7ddcbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:06.081568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78b693-1d66-42c7-8241-1cffda7ddcbe service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:06.081850 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78b693-1d66-42c7-8241-1cffda7ddcbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:06.082126 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78b693-1d66-42c7-8241-1cffda7ddcbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:06.091606 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78b693-1d66-42c7-8241-1cffda7ddcbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:06.093028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78b693-1d66-42c7-8241-1cffda7ddcbe service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:06.102498 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1374/2725] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:40:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:40:06.363899 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba09977-93a6-4d1e-becd-a2728fbb6e62 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:06.365387 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fba09977-93a6-4d1e-becd-a2728fbb6e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:06.379543 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba09977-93a6-4d1e-becd-a2728fbb6e62 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:06.384695 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68203ad5-227a-4d6a-9a88-343f6b2c8c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:06.385730 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68203ad5-227a-4d6a-9a88-343f6b2c8c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:06.386015 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68203ad5-227a-4d6a-9a88-343f6b2c8c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:06.386331 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68203ad5-227a-4d6a-9a88-343f6b2c8c3b admin admin] PATH_INFO: `/v3/projects/653cd94ac0a449c3aac795650f195ed3` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:06.388203 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68203ad5-227a-4d6a-9a88-343f6b2c8c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=653cd94ac0a449c3aac795650f195ed3)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:06.390260 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68203ad5-227a-4d6a-9a88-343f6b2c8c3b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:06.437861 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-68203ad5-227a-4d6a-9a88-343f6b2c8c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '653cd94ac0a449c3aac795650f195ed3', 'request_id': 'req-68203ad5-227a-4d6a-9a88-343f6b2c8c3b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:06.443242 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-68203ad5-227a-4d6a-9a88-343f6b2c8c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '653cd94ac0a449c3aac795650f195ed3', 'request_id': 'req-68203ad5-227a-4d6a-9a88-343f6b2c8c3b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:06.450507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-68203ad5-227a-4d6a-9a88-343f6b2c8c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '653cd94ac0a449c3aac795650f195ed3', 'request_id': 'req-68203ad5-227a-4d6a-9a88-343f6b2c8c3b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:06.461625 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-68203ad5-227a-4d6a-9a88-343f6b2c8c3b admin admin] The token cache is being invalidate because project 653cd94ac0a449c3aac795650f195ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:40:06.461906 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-68203ad5-227a-4d6a-9a88-343f6b2c8c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:06.462533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-68203ad5-227a-4d6a-9a88-343f6b2c8c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:06.464104 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1352/2726] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:40:06 2022] DELETE /identity/v3/projects/653cd94ac0a449c3aac795650f195ed3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:40:06.468597 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78b693-1d66-42c7-8241-1cffda7ddcbe service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:06.478428 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78b693-1d66-42c7-8241-1cffda7ddcbe service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:06.535743 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1317b-b713-4c61-a214-fe29f3a63eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:06.536533 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1317b-b713-4c61-a214-fe29f3a63eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:06.536814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1317b-b713-4c61-a214-fe29f3a63eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:06.537086 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1317b-b713-4c61-a214-fe29f3a63eb0 admin admin] PATH_INFO: `/v3/users/759efe366d2e4f7b85480f55f2b1c42a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:06.538265 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1317b-b713-4c61-a214-fe29f3a63eb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=759efe366d2e4f7b85480f55f2b1c42a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:06.540207 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1317b-b713-4c61-a214-fe29f3a63eb0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:06.577827 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:06.586790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-abe1317b-b713-4c61-a214-fe29f3a63eb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759efe366d2e4f7b85480f55f2b1c42a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:06.594982 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-abe1317b-b713-4c61-a214-fe29f3a63eb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759efe366d2e4f7b85480f55f2b1c42a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:06.606866 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-abe1317b-b713-4c61-a214-fe29f3a63eb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759efe366d2e4f7b85480f55f2b1c42a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:06.614208 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-abe1317b-b713-4c61-a214-fe29f3a63eb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759efe366d2e4f7b85480f55f2b1c42a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:06.614869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-abe1317b-b713-4c61-a214-fe29f3a63eb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759efe366d2e4f7b85480f55f2b1c42a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:06.621047 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1375/2727] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:40:06 2022] DELETE /identity/v3/users/759efe366d2e4f7b85480f55f2b1c42a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:40:06.901780 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68203ad5-227a-4d6a-9a88-343f6b2c8c3b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:06.903976 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-68203ad5-227a-4d6a-9a88-343f6b2c8c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:06.918643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68203ad5-227a-4d6a-9a88-343f6b2c8c3b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:06.976804 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd088801-7a6d-455d-af2a-985507bf6966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:06.977659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd088801-7a6d-455d-af2a-985507bf6966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:06.977936 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd088801-7a6d-455d-af2a-985507bf6966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:06.978207 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd088801-7a6d-455d-af2a-985507bf6966 admin admin] PATH_INFO: `/v3/projects/b3fe30d57ff947349ba5bc727702feba` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:06.979371 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd088801-7a6d-455d-af2a-985507bf6966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3fe30d57ff947349ba5bc727702feba)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:06.981396 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd088801-7a6d-455d-af2a-985507bf6966 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:07.026655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-dd088801-7a6d-455d-af2a-985507bf6966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3fe30d57ff947349ba5bc727702feba', 'request_id': 'req-dd088801-7a6d-455d-af2a-985507bf6966'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:07.032102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-dd088801-7a6d-455d-af2a-985507bf6966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3fe30d57ff947349ba5bc727702feba', 'request_id': 'req-dd088801-7a6d-455d-af2a-985507bf6966'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:07.033698 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:07.040008 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-dd088801-7a6d-455d-af2a-985507bf6966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3fe30d57ff947349ba5bc727702feba', 'request_id': 'req-dd088801-7a6d-455d-af2a-985507bf6966'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:07.051990 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-dd088801-7a6d-455d-af2a-985507bf6966 admin admin] The token cache is being invalidate because project b3fe30d57ff947349ba5bc727702feba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:40:07.052277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-dd088801-7a6d-455d-af2a-985507bf6966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:07.052908 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-dd088801-7a6d-455d-af2a-985507bf6966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:07.054438 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1353/2728] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:40:06 2022] DELETE /identity/v3/projects/b3fe30d57ff947349ba5bc727702feba => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:40:07.060124 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6337b06-5570-4824-8baa-2ed628bdda7c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:07.060578 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6337b06-5570-4824-8baa-2ed628bdda7c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:07.060691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6337b06-5570-4824-8baa-2ed628bdda7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:07.079067 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e6337b06-5570-4824-8baa-2ed628bdda7c None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:40:07.080198 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e6337b06-5570-4824-8baa-2ed628bdda7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:07.139045 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1376/2729] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:40:07.147057 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41829f3c-05fc-4eb3-b8c5-8b5ff06c355f None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:07.147349 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41829f3c-05fc-4eb3-b8c5-8b5ff06c355f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:07.147628 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41829f3c-05fc-4eb3-b8c5-8b5ff06c355f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:07.165546 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-41829f3c-05fc-4eb3-b8c5-8b5ff06c355f None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:40:07.166766 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-41829f3c-05fc-4eb3-b8c5-8b5ff06c355f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:07.174786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1354/2730] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:40:07.178839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6337b06-5570-4824-8baa-2ed628bdda7c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:07.189077 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6337b06-5570-4824-8baa-2ed628bdda7c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:07.193657 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd407bf-601f-4a8b-97c4-59741a424de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:07.194308 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd407bf-601f-4a8b-97c4-59741a424de9 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:07.194587 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd407bf-601f-4a8b-97c4-59741a424de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:07.194892 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd407bf-601f-4a8b-97c4-59741a424de9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:07.195611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd407bf-601f-4a8b-97c4-59741a424de9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:40:07.195915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd407bf-601f-4a8b-97c4-59741a424de9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:07.197485 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd407bf-601f-4a8b-97c4-59741a424de9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:07.209644 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1377/2731] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:40:07.213866 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41829f3c-05fc-4eb3-b8c5-8b5ff06c355f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:07.223290 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41829f3c-05fc-4eb3-b8c5-8b5ff06c355f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:07.228009 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fddcb-123d-43b0-afed-33551df875f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:07.228655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fddcb-123d-43b0-afed-33551df875f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:07.228937 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fddcb-123d-43b0-afed-33551df875f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:07.229213 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fddcb-123d-43b0-afed-33551df875f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:07.229893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fddcb-123d-43b0-afed-33551df875f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:07.231863 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89fddcb-123d-43b0-afed-33551df875f7 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:07.260666 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1355/2732] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:40:07 2022] POST /identity/v3/projects => generated 361 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:40:07.265865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd407bf-601f-4a8b-97c4-59741a424de9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:07.276672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd407bf-601f-4a8b-97c4-59741a424de9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:07.334905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26dac4-acde-407c-a183-d1bbc228b244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:07.335486 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26dac4-acde-407c-a183-d1bbc228b244 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:07.335763 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26dac4-acde-407c-a183-d1bbc228b244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:07.336035 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26dac4-acde-407c-a183-d1bbc228b244 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:07.336704 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26dac4-acde-407c-a183-d1bbc228b244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:07.338589 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26dac4-acde-407c-a183-d1bbc228b244 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:07.359911 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1378/2733] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:40:07 2022] POST /identity/v3/users => generated 281 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:40:07.363973 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fddcb-123d-43b0-afed-33551df875f7 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:07.375366 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fddcb-123d-43b0-afed-33551df875f7 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:07.380036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8b125-c36e-44a5-89ca-0e3f288fab53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:07.380687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8b125-c36e-44a5-89ca-0e3f288fab53 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:07.380965 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8b125-c36e-44a5-89ca-0e3f288fab53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:07.381234 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8b125-c36e-44a5-89ca-0e3f288fab53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:07.381979 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8b125-c36e-44a5-89ca-0e3f288fab53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:07.383582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8b125-c36e-44a5-89ca-0e3f288fab53 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:07.393935 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1356/2734] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:40:07.398106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26dac4-acde-407c-a183-d1bbc228b244 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:07.408435 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26dac4-acde-407c-a183-d1bbc228b244 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:07.413180 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f11de-201e-4f7c-bcd1-829dd886e9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:07.413827 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f11de-201e-4f7c-bcd1-829dd886e9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:07.414105 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f11de-201e-4f7c-bcd1-829dd886e9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:07.414377 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f11de-201e-4f7c-bcd1-829dd886e9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:07.415123 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f11de-201e-4f7c-bcd1-829dd886e9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:07.416689 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f11de-201e-4f7c-bcd1-829dd886e9e0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:07.427042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1379/2735] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:40:07.431082 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8b125-c36e-44a5-89ca-0e3f288fab53 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:07.441444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8b125-c36e-44a5-89ca-0e3f288fab53 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:07.446001 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8586dd-fb5b-49c2-a79b-b3feef04cb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:07.447030 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8586dd-fb5b-49c2-a79b-b3feef04cb9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:07.447318 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8586dd-fb5b-49c2-a79b-b3feef04cb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:07.447574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8586dd-fb5b-49c2-a79b-b3feef04cb9f admin admin] PATH_INFO: `/v3/projects/e1a50c56143a41b8b1503995e41c50c2/users/c39a0fdc1f3d4fadb62f51d98cdb2a8a/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:07.461859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8586dd-fb5b-49c2-a79b-b3feef04cb9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a50c56143a41b8b1503995e41c50c2, user_id=c39a0fdc1f3d4fadb62f51d98cdb2a8a, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:07.464511 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8586dd-fb5b-49c2-a79b-b3feef04cb9f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:07.477567 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1357/2736] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:40:07 2022] PUT /identity/v3/projects/e1a50c56143a41b8b1503995e41c50c2/users/c39a0fdc1f3d4fadb62f51d98cdb2a8a/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:40:07.488530 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30887aa-7031-4724-aaa2-b99ac638f2ea None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:07.488820 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30887aa-7031-4724-aaa2-b99ac638f2ea None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:07.489097 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30887aa-7031-4724-aaa2-b99ac638f2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:07.516483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c30887aa-7031-4724-aaa2-b99ac638f2ea None None] MFA Rules not processed for user `c39a0fdc1f3d4fadb62f51d98cdb2a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:40:07.517681 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c30887aa-7031-4724-aaa2-b99ac638f2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:07.526066 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:07.583733 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1380/2737] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:40:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:40:07.614478 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8586dd-fb5b-49c2-a79b-b3feef04cb9f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:07.616186 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bd8586dd-fb5b-49c2-a79b-b3feef04cb9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:07.672664 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8586dd-fb5b-49c2-a79b-b3feef04cb9f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:07.676254 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa87b18-98a6-4828-b1de-a09ecd40a32a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:07.676889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa87b18-98a6-4828-b1de-a09ecd40a32a service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:07.677169 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa87b18-98a6-4828-b1de-a09ecd40a32a service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:07.677440 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa87b18-98a6-4828-b1de-a09ecd40a32a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:07.686183 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa87b18-98a6-4828-b1de-a09ecd40a32a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:07.687630 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa87b18-98a6-4828-b1de-a09ecd40a32a service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:07.696818 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1358/2738] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:40:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:40:07.710819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30887aa-7031-4724-aaa2-b99ac638f2ea None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:07.773421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30887aa-7031-4724-aaa2-b99ac638f2ea None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:07.778581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7171b8f-80bc-44fa-be7c-422d85a01e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:07.779497 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7171b8f-80bc-44fa-be7c-422d85a01e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:07.779779 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7171b8f-80bc-44fa-be7c-422d85a01e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:07.780054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7171b8f-80bc-44fa-be7c-422d85a01e0d admin admin] PATH_INFO: `/v3/users/c39a0fdc1f3d4fadb62f51d98cdb2a8a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:07.781251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7171b8f-80bc-44fa-be7c-422d85a01e0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c39a0fdc1f3d4fadb62f51d98cdb2a8a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:07.783228 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7171b8f-80bc-44fa-be7c-422d85a01e0d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:07.828117 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f7171b8f-80bc-44fa-be7c-422d85a01e0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c39a0fdc1f3d4fadb62f51d98cdb2a8a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:07.834941 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f7171b8f-80bc-44fa-be7c-422d85a01e0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c39a0fdc1f3d4fadb62f51d98cdb2a8a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:07.847787 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f7171b8f-80bc-44fa-be7c-422d85a01e0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c39a0fdc1f3d4fadb62f51d98cdb2a8a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:07.854659 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f7171b8f-80bc-44fa-be7c-422d85a01e0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c39a0fdc1f3d4fadb62f51d98cdb2a8a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:07.855934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f7171b8f-80bc-44fa-be7c-422d85a01e0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c39a0fdc1f3d4fadb62f51d98cdb2a8a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:07.861976 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1381/2739] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:40:07 2022] DELETE /identity/v3/users/c39a0fdc1f3d4fadb62f51d98cdb2a8a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:40:07.866560 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a84ceb-b761-4dd1-978a-ea97d981058b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:07.866876 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a84ceb-b761-4dd1-978a-ea97d981058b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:07.867154 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a84ceb-b761-4dd1-978a-ea97d981058b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:07.884352 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-66a84ceb-b761-4dd1-978a-ea97d981058b None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:40:07.885663 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-66a84ceb-b761-4dd1-978a-ea97d981058b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:07.943351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1359/2740] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:40:07.952904 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7171b8f-80bc-44fa-be7c-422d85a01e0d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:07.954313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f7171b8f-80bc-44fa-be7c-422d85a01e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:07.987739 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:08.015139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7171b8f-80bc-44fa-be7c-422d85a01e0d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:08.018800 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f2fc7-6c67-47d8-991a-11a4a991fd2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:08.019443 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f2fc7-6c67-47d8-991a-11a4a991fd2f service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:08.019721 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f2fc7-6c67-47d8-991a-11a4a991fd2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:08.019989 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f2fc7-6c67-47d8-991a-11a4a991fd2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:08.029838 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f2fc7-6c67-47d8-991a-11a4a991fd2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:08.031310 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f2fc7-6c67-47d8-991a-11a4a991fd2f service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:08.040720 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1382/2741] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:40:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:40:08.311828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a84ceb-b761-4dd1-978a-ea97d981058b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:08.314363 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-66a84ceb-b761-4dd1-978a-ea97d981058b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:08.327443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a84ceb-b761-4dd1-978a-ea97d981058b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:08.332081 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b900a7f-67b0-4a11-ab3d-537fbfb5a290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:08.332952 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b900a7f-67b0-4a11-ab3d-537fbfb5a290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:08.333225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b900a7f-67b0-4a11-ab3d-537fbfb5a290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:08.333494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b900a7f-67b0-4a11-ab3d-537fbfb5a290 admin admin] PATH_INFO: `/v3/projects/e1a50c56143a41b8b1503995e41c50c2` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:08.334680 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b900a7f-67b0-4a11-ab3d-537fbfb5a290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a50c56143a41b8b1503995e41c50c2)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:08.336595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b900a7f-67b0-4a11-ab3d-537fbfb5a290 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:08.360419 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:08.384552 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3b900a7f-67b0-4a11-ab3d-537fbfb5a290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a50c56143a41b8b1503995e41c50c2', 'request_id': 'req-3b900a7f-67b0-4a11-ab3d-537fbfb5a290'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:08.390509 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3b900a7f-67b0-4a11-ab3d-537fbfb5a290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a50c56143a41b8b1503995e41c50c2', 'request_id': 'req-3b900a7f-67b0-4a11-ab3d-537fbfb5a290'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:08.400000 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3b900a7f-67b0-4a11-ab3d-537fbfb5a290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a50c56143a41b8b1503995e41c50c2', 'request_id': 'req-3b900a7f-67b0-4a11-ab3d-537fbfb5a290'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:08.411746 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3b900a7f-67b0-4a11-ab3d-537fbfb5a290 admin admin] The token cache is being invalidate because project e1a50c56143a41b8b1503995e41c50c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:40:08.412033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3b900a7f-67b0-4a11-ab3d-537fbfb5a290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:08.412664 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3b900a7f-67b0-4a11-ab3d-537fbfb5a290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:08.414211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1360/2742] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:40:08 2022] DELETE /identity/v3/projects/e1a50c56143a41b8b1503995e41c50c2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:40:08.419576 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b7782-cd5f-4688-9eda-adc9023854f0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:08.420089 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b7782-cd5f-4688-9eda-adc9023854f0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:08.420191 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b7782-cd5f-4688-9eda-adc9023854f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:08.437537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-271b7782-cd5f-4688-9eda-adc9023854f0 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:40:08.438720 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-271b7782-cd5f-4688-9eda-adc9023854f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:08.499750 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1383/2743] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:40:08.508626 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf956c5-2cc4-4100-9219-8eb44714cc06 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:08.508914 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf956c5-2cc4-4100-9219-8eb44714cc06 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:08.509189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf956c5-2cc4-4100-9219-8eb44714cc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:08.530292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-5cf956c5-2cc4-4100-9219-8eb44714cc06 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:40:08.532184 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5cf956c5-2cc4-4100-9219-8eb44714cc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:08.540106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1361/2744] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:40:08.545178 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b7782-cd5f-4688-9eda-adc9023854f0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:08.554923 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b7782-cd5f-4688-9eda-adc9023854f0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:08.560107 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a64501-f5e6-41fb-ab56-17b63ce3189b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:08.560747 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a64501-f5e6-41fb-ab56-17b63ce3189b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:08.561025 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a64501-f5e6-41fb-ab56-17b63ce3189b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:08.561295 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a64501-f5e6-41fb-ab56-17b63ce3189b admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:08.562004 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a64501-f5e6-41fb-ab56-17b63ce3189b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:40:08.562305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a64501-f5e6-41fb-ab56-17b63ce3189b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:08.563932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a64501-f5e6-41fb-ab56-17b63ce3189b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:08.575331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1384/2745] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:40:08.579577 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf956c5-2cc4-4100-9219-8eb44714cc06 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:08.588863 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf956c5-2cc4-4100-9219-8eb44714cc06 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:08.594042 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc306a-6a48-49bb-b529-0112f3dd59a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:08.594685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc306a-6a48-49bb-b529-0112f3dd59a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:08.595053 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc306a-6a48-49bb-b529-0112f3dd59a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:08.595323 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc306a-6a48-49bb-b529-0112f3dd59a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:08.596013 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc306a-6a48-49bb-b529-0112f3dd59a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:08.597897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc306a-6a48-49bb-b529-0112f3dd59a6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:08.623585 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1362/2746] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:40:08 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:40:08.627572 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a64501-f5e6-41fb-ab56-17b63ce3189b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:08.637842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a64501-f5e6-41fb-ab56-17b63ce3189b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:08.694404 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfe2a4-6da8-4f71-b521-4e4310651ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:08.695120 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfe2a4-6da8-4f71-b521-4e4310651ecd admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:08.695395 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfe2a4-6da8-4f71-b521-4e4310651ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:08.695663 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfe2a4-6da8-4f71-b521-4e4310651ecd admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:08.696357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfe2a4-6da8-4f71-b521-4e4310651ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:08.698246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfe2a4-6da8-4f71-b521-4e4310651ecd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:08.719476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1385/2747] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:40:08 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:40:08.723813 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc306a-6a48-49bb-b529-0112f3dd59a6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:08.734725 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc306a-6a48-49bb-b529-0112f3dd59a6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:08.739554 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a6727-51da-4c98-aaff-2d9b20e24811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:08.740211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a6727-51da-4c98-aaff-2d9b20e24811 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:08.740490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a6727-51da-4c98-aaff-2d9b20e24811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:08.740758 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a6727-51da-4c98-aaff-2d9b20e24811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:08.741476 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a6727-51da-4c98-aaff-2d9b20e24811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:08.743067 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a6727-51da-4c98-aaff-2d9b20e24811 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:08.753481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1363/2748] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:40:08.757496 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfe2a4-6da8-4f71-b521-4e4310651ecd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:08.767684 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfe2a4-6da8-4f71-b521-4e4310651ecd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:08.772652 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fe11c-8808-4c7e-9256-903701168ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:08.773361 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fe11c-8808-4c7e-9256-903701168ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:08.773649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fe11c-8808-4c7e-9256-903701168ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:08.773922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fe11c-8808-4c7e-9256-903701168ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:08.774637 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fe11c-8808-4c7e-9256-903701168ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:08.776251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fe11c-8808-4c7e-9256-903701168ea5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:08.787220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1386/2749] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:40:08.791274 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a6727-51da-4c98-aaff-2d9b20e24811 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:08.801895 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a6727-51da-4c98-aaff-2d9b20e24811 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:08.806603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed60a60-8c2d-477c-9021-16e69b0583a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:08.807517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed60a60-8c2d-477c-9021-16e69b0583a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:08.807798 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed60a60-8c2d-477c-9021-16e69b0583a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:08.808072 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed60a60-8c2d-477c-9021-16e69b0583a9 admin admin] PATH_INFO: `/v3/projects/1c4f5fbfdf8b40519f6abfe8385162e1/users/330425b57c45428f829cbaf5a10954c6/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:08.822516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed60a60-8c2d-477c-9021-16e69b0583a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4f5fbfdf8b40519f6abfe8385162e1, user_id=330425b57c45428f829cbaf5a10954c6, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:08.825998 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed60a60-8c2d-477c-9021-16e69b0583a9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:08.838461 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1364/2750] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:40:08 2022] PUT /identity/v3/projects/1c4f5fbfdf8b40519f6abfe8385162e1/users/330425b57c45428f829cbaf5a10954c6/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:40:08.849339 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9160e8-2239-4a7a-8649-1dbfa867e628 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:08.849656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9160e8-2239-4a7a-8649-1dbfa867e628 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:08.849934 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9160e8-2239-4a7a-8649-1dbfa867e628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:08.875875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3d9160e8-2239-4a7a-8649-1dbfa867e628 None None] MFA Rules not processed for user `330425b57c45428f829cbaf5a10954c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:40:08.877088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3d9160e8-2239-4a7a-8649-1dbfa867e628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:08.905462 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:08.944460 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1387/2751] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:40:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:40:08.956453 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed60a60-8c2d-477c-9021-16e69b0583a9 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:08.958245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5ed60a60-8c2d-477c-9021-16e69b0583a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:09.014559 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed60a60-8c2d-477c-9021-16e69b0583a9 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:09.018290 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e307c8-9440-48d1-9329-cd953852410f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:09.018969 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e307c8-9440-48d1-9329-cd953852410f service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:09.019255 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e307c8-9440-48d1-9329-cd953852410f service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:09.019532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e307c8-9440-48d1-9329-cd953852410f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:09.028774 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e307c8-9440-48d1-9329-cd953852410f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:09.030192 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e307c8-9440-48d1-9329-cd953852410f service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:09.039032 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1365/2752] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:40:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:40:18.941469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=15 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:19.034972 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:DELETE=7,keystone:SELECT=68,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:21.418021 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9160e8-2239-4a7a-8649-1dbfa867e628 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:21.479530 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9160e8-2239-4a7a-8649-1dbfa867e628 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:21.484711 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a054c-1c75-41fc-9f08-aad6352aa4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:21.485581 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a054c-1c75-41fc-9f08-aad6352aa4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:21.485861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a054c-1c75-41fc-9f08-aad6352aa4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:21.486136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a054c-1c75-41fc-9f08-aad6352aa4bd admin admin] PATH_INFO: `/v3/users/330425b57c45428f829cbaf5a10954c6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:21.487351 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a054c-1c75-41fc-9f08-aad6352aa4bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=330425b57c45428f829cbaf5a10954c6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:21.489265 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a054c-1c75-41fc-9f08-aad6352aa4bd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:21.535277 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-670a054c-1c75-41fc-9f08-aad6352aa4bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '330425b57c45428f829cbaf5a10954c6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:21.542080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-670a054c-1c75-41fc-9f08-aad6352aa4bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '330425b57c45428f829cbaf5a10954c6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:21.554589 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-670a054c-1c75-41fc-9f08-aad6352aa4bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '330425b57c45428f829cbaf5a10954c6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:21.561124 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-670a054c-1c75-41fc-9f08-aad6352aa4bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '330425b57c45428f829cbaf5a10954c6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:21.561840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-670a054c-1c75-41fc-9f08-aad6352aa4bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '330425b57c45428f829cbaf5a10954c6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:21.567837 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1388/2753] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:40:21 2022] DELETE /identity/v3/users/330425b57c45428f829cbaf5a10954c6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:40:21.572566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee97be-8545-4459-a8f9-81d283478ef3 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:21.573059 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee97be-8545-4459-a8f9-81d283478ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:21.573175 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee97be-8545-4459-a8f9-81d283478ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:21.591410 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8eee97be-8545-4459-a8f9-81d283478ef3 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:40:21.592727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8eee97be-8545-4459-a8f9-81d283478ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:21.652222 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1366/2754] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:40:21.662418 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a054c-1c75-41fc-9f08-aad6352aa4bd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:21.663868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-670a054c-1c75-41fc-9f08-aad6352aa4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:21.725753 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a054c-1c75-41fc-9f08-aad6352aa4bd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:21.729408 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0fa81-f0a5-49ac-99b3-ed5c0b012383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:21.730157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0fa81-f0a5-49ac-99b3-ed5c0b012383 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:21.730406 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0fa81-f0a5-49ac-99b3-ed5c0b012383 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:21.730681 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0fa81-f0a5-49ac-99b3-ed5c0b012383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:21.740831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0fa81-f0a5-49ac-99b3-ed5c0b012383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:21.742266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0fa81-f0a5-49ac-99b3-ed5c0b012383 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:21.753134 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1389/2755] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:40:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:40:22.032955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee97be-8545-4459-a8f9-81d283478ef3 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:22.034529 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8eee97be-8545-4459-a8f9-81d283478ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:22.046995 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee97be-8545-4459-a8f9-81d283478ef3 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:22.051932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506916b-81fa-4f63-9eac-9cd848c8370b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:22.052797 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506916b-81fa-4f63-9eac-9cd848c8370b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:22.053073 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506916b-81fa-4f63-9eac-9cd848c8370b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:22.053345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506916b-81fa-4f63-9eac-9cd848c8370b admin admin] PATH_INFO: `/v3/projects/1c4f5fbfdf8b40519f6abfe8385162e1` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:22.054529 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506916b-81fa-4f63-9eac-9cd848c8370b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c4f5fbfdf8b40519f6abfe8385162e1)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:22.056468 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506916b-81fa-4f63-9eac-9cd848c8370b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:22.105901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e506916b-81fa-4f63-9eac-9cd848c8370b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c4f5fbfdf8b40519f6abfe8385162e1', 'request_id': 'req-e506916b-81fa-4f63-9eac-9cd848c8370b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:22.111425 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e506916b-81fa-4f63-9eac-9cd848c8370b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c4f5fbfdf8b40519f6abfe8385162e1', 'request_id': 'req-e506916b-81fa-4f63-9eac-9cd848c8370b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:22.119714 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e506916b-81fa-4f63-9eac-9cd848c8370b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c4f5fbfdf8b40519f6abfe8385162e1', 'request_id': 'req-e506916b-81fa-4f63-9eac-9cd848c8370b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:22.131842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e506916b-81fa-4f63-9eac-9cd848c8370b admin admin] The token cache is being invalidate because project 1c4f5fbfdf8b40519f6abfe8385162e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:40:22.132720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e506916b-81fa-4f63-9eac-9cd848c8370b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:22.133516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e506916b-81fa-4f63-9eac-9cd848c8370b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:40:22.135122 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1367/2756] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:40:22 2022] DELETE /identity/v3/projects/1c4f5fbfdf8b40519f6abfe8385162e1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:40:31.748420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:32.128485 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:41:07.157453 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110bef2-15c1-4344-ab20-8a97ca5d22b7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:41:07.157981 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110bef2-15c1-4344-ab20-8a97ca5d22b7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:41:07.157981 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110bef2-15c1-4344-ab20-8a97ca5d22b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:41:07.176313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b110bef2-15c1-4344-ab20-8a97ca5d22b7 None None] MFA Rules not processed for user `82d0c6bdb1054960b40faa9cb82d4092`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:41:07.177520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b110bef2-15c1-4344-ab20-8a97ca5d22b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:41:07.232651 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1390/2757] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:41:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:41:17.225078 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=25 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:41:18.607826 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506916b-81fa-4f63-9eac-9cd848c8370b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:41:18.609244 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e506916b-81fa-4f63-9eac-9cd848c8370b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:41:18.665845 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506916b-81fa-4f63-9eac-9cd848c8370b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:41:18.670074 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75058c4-86c5-44b9-b0af-9359b2660902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:41:18.670713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75058c4-86c5-44b9-b0af-9359b2660902 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:41:18.671020 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75058c4-86c5-44b9-b0af-9359b2660902 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:41:18.671291 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75058c4-86c5-44b9-b0af-9359b2660902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:41:18.673040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e75058c4-86c5-44b9-b0af-9359b2660902 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:41:18.743056 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75058c4-86c5-44b9-b0af-9359b2660902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:41:18.744474 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75058c4-86c5-44b9-b0af-9359b2660902 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:41:18.756041 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1368/2758] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:41:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:41:28.750943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=54 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:42:24.194539 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110bef2-15c1-4344-ab20-8a97ca5d22b7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:42:24.196076 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b110bef2-15c1-4344-ab20-8a97ca5d22b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:42:24.208981 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110bef2-15c1-4344-ab20-8a97ca5d22b7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:42:24.212632 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577bd29-ab14-4d6b-853b-17162f5ad873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:42:24.213265 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577bd29-ab14-4d6b-853b-17162f5ad873 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:42:24.213541 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577bd29-ab14-4d6b-853b-17162f5ad873 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:42:24.213807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577bd29-ab14-4d6b-853b-17162f5ad873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:42:24.215554 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8577bd29-ab14-4d6b-853b-17162f5ad873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:42:24.225374 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577bd29-ab14-4d6b-853b-17162f5ad873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:42:24.226875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577bd29-ab14-4d6b-853b-17162f5ad873 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:42:24.235202 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1391/2759] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:42:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:42:26.558398 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75058c4-86c5-44b9-b0af-9359b2660902 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:42:26.567911 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75058c4-86c5-44b9-b0af-9359b2660902 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:42:26.571530 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bde34-c166-49e2-8014-a9352c180c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:42:26.572165 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bde34-c166-49e2-8014-a9352c180c30 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:42:26.572442 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bde34-c166-49e2-8014-a9352c180c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:42:26.572710 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bde34-c166-49e2-8014-a9352c180c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:42:26.574438 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5a6bde34-c166-49e2-8014-a9352c180c30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:42:26.587837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bde34-c166-49e2-8014-a9352c180c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:42:26.589244 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bde34-c166-49e2-8014-a9352c180c30 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:42:26.600972 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1369/2760] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:42:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:42:31.499437 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577bd29-ab14-4d6b-853b-17162f5ad873 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:42:31.500875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8577bd29-ab14-4d6b-853b-17162f5ad873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:42:31.517433 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577bd29-ab14-4d6b-853b-17162f5ad873 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:42:31.523369 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70a6ce-4e62-4e16-8e5a-a516c178cbd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:42:31.524006 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70a6ce-4e62-4e16-8e5a-a516c178cbd3 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:42:31.524287 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70a6ce-4e62-4e16-8e5a-a516c178cbd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:42:31.524564 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70a6ce-4e62-4e16-8e5a-a516c178cbd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:42:31.526278 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9e70a6ce-4e62-4e16-8e5a-a516c178cbd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:42:31.536849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70a6ce-4e62-4e16-8e5a-a516c178cbd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:42:31.538425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70a6ce-4e62-4e16-8e5a-a516c178cbd3 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:42:31.547504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1392/2761] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:42:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:42:36.595116 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=6 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:42:41.543272 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=12 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:42:42.991187 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e902baa-9fa9-47b6-abf2-075fadbe94ff None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:42:42.991653 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e902baa-9fa9-47b6-abf2-075fadbe94ff None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:42:42.991766 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e902baa-9fa9-47b6-abf2-075fadbe94ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:42:43.041708 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9e902baa-9fa9-47b6-abf2-075fadbe94ff None None] MFA Rules not processed for user `18030043de1942779baf3ad94aec4071`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:42:43.042961 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9e902baa-9fa9-47b6-abf2-075fadbe94ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:42:43.109816 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1370/2762] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 19 12:42:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:42:43.156765 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70a6ce-4e62-4e16-8e5a-a516c178cbd3 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:42:43.158173 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9e70a6ce-4e62-4e16-8e5a-a516c178cbd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:42:43.247109 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70a6ce-4e62-4e16-8e5a-a516c178cbd3 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:42:43.252237 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8eea4-2d05-462e-b493-608430f608b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc2e1079d34745a279588028945c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:42:43.253423 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8eea4-2d05-462e-b493-608430f608b7 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:42:43.253811 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8eea4-2d05-462e-b493-608430f608b7 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:42:43.254095 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8eea4-2d05-462e-b493-608430f608b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:42:43.263575 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8eea4-2d05-462e-b493-608430f608b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:42:43.265153 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8eea4-2d05-462e-b493-608430f608b7 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:42:43.274633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1393/2763] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 19 12:42:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:42:53.106754 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=40 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:42:53.270983 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=41 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:42:56.042903 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e902baa-9fa9-47b6-abf2-075fadbe94ff None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:42:56.058250 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e902baa-9fa9-47b6-abf2-075fadbe94ff None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:42:56.063923 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822de18-2d4b-4778-a9ab-c18c7d829e5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:42:56.064577 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822de18-2d4b-4778-a9ab-c18c7d829e5b service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:42:56.064857 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822de18-2d4b-4778-a9ab-c18c7d829e5b service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:42:56.065128 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822de18-2d4b-4778-a9ab-c18c7d829e5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:42:56.066984 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a822de18-2d4b-4778-a9ab-c18c7d829e5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:42:56.079248 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822de18-2d4b-4778-a9ab-c18c7d829e5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:42:56.080805 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822de18-2d4b-4778-a9ab-c18c7d829e5b service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:42:56.091506 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1371/2764] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:42:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:42:57.422234 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8eea4-2d05-462e-b493-608430f608b7 service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:42:57.423669 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7ee8eea4-2d05-462e-b493-608430f608b7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:42:57.496691 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8eea4-2d05-462e-b493-608430f608b7 service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:42:57.501607 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342effb-0d1a-4fbe-be09-e932a2108c46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:42:57.502243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342effb-0d1a-4fbe-be09-e932a2108c46 service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:42:57.502520 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342effb-0d1a-4fbe-be09-e932a2108c46 service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:42:57.502838 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342effb-0d1a-4fbe-be09-e932a2108c46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:42:57.504627 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b342effb-0d1a-4fbe-be09-e932a2108c46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:42:57.516184 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342effb-0d1a-4fbe-be09-e932a2108c46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:42:57.517726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342effb-0d1a-4fbe-be09-e932a2108c46 service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:42:57.527965 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1394/2765] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:42:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:42:58.977769 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a349ba-b950-4124-8aa2-67d524dc0e94 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:42:58.978295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a349ba-b950-4124-8aa2-67d524dc0e94 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:42:58.978295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a349ba-b950-4124-8aa2-67d524dc0e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:42:58.996778 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a8a349ba-b950-4124-8aa2-67d524dc0e94 None None] MFA Rules not processed for user `18030043de1942779baf3ad94aec4071`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:42:58.998012 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a8a349ba-b950-4124-8aa2-67d524dc0e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:42:59.005244 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1372/2766] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 19 12:42:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:42:59.016942 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342effb-0d1a-4fbe-be09-e932a2108c46 service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:42:59.029227 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342effb-0d1a-4fbe-be09-e932a2108c46 service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:42:59.034230 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd7ec8-b058-4ef6-8f30-fa3ba96332bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc2e1079d34745a279588028945c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:42:59.034912 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd7ec8-b058-4ef6-8f30-fa3ba96332bb service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:42:59.035193 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd7ec8-b058-4ef6-8f30-fa3ba96332bb service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:42:59.035565 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd7ec8-b058-4ef6-8f30-fa3ba96332bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:42:59.044594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd7ec8-b058-4ef6-8f30-fa3ba96332bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:42:59.046133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd7ec8-b058-4ef6-8f30-fa3ba96332bb service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:42:59.054876 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1395/2767] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 19 12:42:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:43:08.991386 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=9 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:43:09.051509 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=38 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:43:18.080193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132ebd9-8d4a-491d-9722-3ee897a0fe04 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:43:18.080655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132ebd9-8d4a-491d-9722-3ee897a0fe04 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:43:18.080759 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132ebd9-8d4a-491d-9722-3ee897a0fe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:43:18.100247 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4132ebd9-8d4a-491d-9722-3ee897a0fe04 None None] MFA Rules not processed for user `18030043de1942779baf3ad94aec4071`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:43:18.101432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4132ebd9-8d4a-491d-9722-3ee897a0fe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:43:18.108561 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1373/2768] 10.222.0.25 () {58 vars in 967 bytes} [Tue Jul 19 12:43:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:43:18.120723 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd7ec8-b058-4ef6-8f30-fa3ba96332bb service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:43:18.131640 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd7ec8-b058-4ef6-8f30-fa3ba96332bb service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:43:18.136688 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3589d7-e8c3-46d0-9fb6-95c334377e4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc2e1079d34745a279588028945c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:43:18.137315 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3589d7-e8c3-46d0-9fb6-95c334377e4c service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:43:18.137631 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3589d7-e8c3-46d0-9fb6-95c334377e4c service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:43:18.137907 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3589d7-e8c3-46d0-9fb6-95c334377e4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:43:18.146817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3589d7-e8c3-46d0-9fb6-95c334377e4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:43:18.148583 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3589d7-e8c3-46d0-9fb6-95c334377e4c service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:43:18.156735 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1396/2769] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 19 12:43:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:43:28.093582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:43:28.153434 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:44:17.894561 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132ebd9-8d4a-491d-9722-3ee897a0fe04 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:17.910163 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132ebd9-8d4a-491d-9722-3ee897a0fe04 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:17.917908 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e846a3-7b76-443a-aca5-e49440033248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:17.918578 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e846a3-7b76-443a-aca5-e49440033248 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:17.918910 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e846a3-7b76-443a-aca5-e49440033248 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:17.919182 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e846a3-7b76-443a-aca5-e49440033248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:17.921009 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-80e846a3-7b76-443a-aca5-e49440033248 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:17.939796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e846a3-7b76-443a-aca5-e49440033248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:17.941314 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e846a3-7b76-443a-aca5-e49440033248 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:17.956982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1374/2770] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:44:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:44:21.937276 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3589d7-e8c3-46d0-9fb6-95c334377e4c service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:21.947519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3589d7-e8c3-46d0-9fb6-95c334377e4c service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:21.951151 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07ef24-452b-42f3-9a1a-3ca6a63a4f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:21.951728 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07ef24-452b-42f3-9a1a-3ca6a63a4f62 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:21.952005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07ef24-452b-42f3-9a1a-3ca6a63a4f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:21.952442 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07ef24-452b-42f3-9a1a-3ca6a63a4f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:21.954042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6e07ef24-452b-42f3-9a1a-3ca6a63a4f62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:22.018561 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07ef24-452b-42f3-9a1a-3ca6a63a4f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:22.020039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07ef24-452b-42f3-9a1a-3ca6a63a4f62 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:22.030676 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1397/2771] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:44:24.901699 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e846a3-7b76-443a-aca5-e49440033248 service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:24.923855 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e846a3-7b76-443a-aca5-e49440033248 service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:24.930976 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29b00e-7cfa-4e3e-a804-844601589336 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:24.931763 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29b00e-7cfa-4e3e-a804-844601589336 service placement] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:24.932111 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29b00e-7cfa-4e3e-a804-844601589336 service placement] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:24.932458 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29b00e-7cfa-4e3e-a804-844601589336 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:24.934476 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9b29b00e-7cfa-4e3e-a804-844601589336 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:24.950351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29b00e-7cfa-4e3e-a804-844601589336 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:24.952292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29b00e-7cfa-4e3e-a804-844601589336 service placement] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:24.964696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1375/2772] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:44:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:44:25.100148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07ef24-452b-42f3-9a1a-3ca6a63a4f62 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:25.123372 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07ef24-452b-42f3-9a1a-3ca6a63a4f62 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:25.130982 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0bfe0-17a2-432b-98c1-57259e38d947 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:25.132083 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0bfe0-17a2-432b-98c1-57259e38d947 service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:25.132568 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0bfe0-17a2-432b-98c1-57259e38d947 service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:25.133016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0bfe0-17a2-432b-98c1-57259e38d947 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:25.135148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4cb0bfe0-17a2-432b-98c1-57259e38d947 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:25.153738 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0bfe0-17a2-432b-98c1-57259e38d947 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:25.155515 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0bfe0-17a2-432b-98c1-57259e38d947 service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:25.181504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1398/2773] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:44:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:44:25.207765 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29b00e-7cfa-4e3e-a804-844601589336 service placement] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:25.210167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9b29b00e-7cfa-4e3e-a804-844601589336 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:25.240149 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29b00e-7cfa-4e3e-a804-844601589336 service placement] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:25.245715 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d91f8b-254e-4cc2-ae64-ff4eec45cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:25.246598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d91f8b-254e-4cc2-ae64-ff4eec45cd00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:25.246919 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d91f8b-254e-4cc2-ae64-ff4eec45cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:25.247198 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d91f8b-254e-4cc2-ae64-ff4eec45cd00 admin admin] PATH_INFO: `/v3/users/82d0c6bdb1054960b40faa9cb82d4092` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:25.248415 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d91f8b-254e-4cc2-ae64-ff4eec45cd00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d0c6bdb1054960b40faa9cb82d4092)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:25.250322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d91f8b-254e-4cc2-ae64-ff4eec45cd00 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:25.303004 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c2d91f8b-254e-4cc2-ae64-ff4eec45cd00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d0c6bdb1054960b40faa9cb82d4092'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:25.310310 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c2d91f8b-254e-4cc2-ae64-ff4eec45cd00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d0c6bdb1054960b40faa9cb82d4092'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:25.323301 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c2d91f8b-254e-4cc2-ae64-ff4eec45cd00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d0c6bdb1054960b40faa9cb82d4092'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:25.330615 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c2d91f8b-254e-4cc2-ae64-ff4eec45cd00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d0c6bdb1054960b40faa9cb82d4092'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:25.331293 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c2d91f8b-254e-4cc2-ae64-ff4eec45cd00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d0c6bdb1054960b40faa9cb82d4092'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:25.337543 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1376/2774] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:44:25 2022] DELETE /identity/v3/users/82d0c6bdb1054960b40faa9cb82d4092 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:44:25.513830 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0bfe0-17a2-432b-98c1-57259e38d947 service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:25.525701 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0bfe0-17a2-432b-98c1-57259e38d947 service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:25.581946 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d9991-f271-40f7-941f-58c85de70ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:25.582836 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d9991-f271-40f7-941f-58c85de70ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:25.583258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d9991-f271-40f7-941f-58c85de70ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:25.583659 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d9991-f271-40f7-941f-58c85de70ca0 admin admin] PATH_INFO: `/v3/projects/61ee663117a7415d8da674ca2a07b910` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:25.584833 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d9991-f271-40f7-941f-58c85de70ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ee663117a7415d8da674ca2a07b910)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:25.586729 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d9991-f271-40f7-941f-58c85de70ca0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:25.634300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e7d9991-f271-40f7-941f-58c85de70ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ee663117a7415d8da674ca2a07b910', 'request_id': 'req-1e7d9991-f271-40f7-941f-58c85de70ca0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:25.639794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e7d9991-f271-40f7-941f-58c85de70ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ee663117a7415d8da674ca2a07b910', 'request_id': 'req-1e7d9991-f271-40f7-941f-58c85de70ca0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:25.647323 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e7d9991-f271-40f7-941f-58c85de70ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ee663117a7415d8da674ca2a07b910', 'request_id': 'req-1e7d9991-f271-40f7-941f-58c85de70ca0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:25.659139 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e7d9991-f271-40f7-941f-58c85de70ca0 admin admin] The token cache is being invalidate because project 61ee663117a7415d8da674ca2a07b910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:44:25.659425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e7d9991-f271-40f7-941f-58c85de70ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:25.660073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e7d9991-f271-40f7-941f-58c85de70ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:25.661958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1399/2775] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:44:25 2022] DELETE /identity/v3/projects/61ee663117a7415d8da674ca2a07b910 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:44:25.666650 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9f4b1-7fda-4c32-bfab-4b0ab1aa2042 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:25.667185 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9f4b1-7fda-4c32-bfab-4b0ab1aa2042 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:25.667465 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9f4b1-7fda-4c32-bfab-4b0ab1aa2042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:25.687102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c1d9f4b1-7fda-4c32-bfab-4b0ab1aa2042 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:44:25.688421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c1d9f4b1-7fda-4c32-bfab-4b0ab1aa2042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:25.756631 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1377/2776] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:44:25.764455 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700927d-3e07-414e-8fca-a15c7f5bb51d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:25.764748 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700927d-3e07-414e-8fca-a15c7f5bb51d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:25.765032 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700927d-3e07-414e-8fca-a15c7f5bb51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:25.783509 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a700927d-3e07-414e-8fca-a15c7f5bb51d None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:44:25.784710 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a700927d-3e07-414e-8fca-a15c7f5bb51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:25.793206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1400/2777] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:44:25.797372 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9f4b1-7fda-4c32-bfab-4b0ab1aa2042 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:25.807786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9f4b1-7fda-4c32-bfab-4b0ab1aa2042 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:25.812887 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e5aa8-b6ef-4865-88b1-7a4df3c773fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:25.813555 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e5aa8-b6ef-4865-88b1-7a4df3c773fe admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:25.813842 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e5aa8-b6ef-4865-88b1-7a4df3c773fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:25.814121 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e5aa8-b6ef-4865-88b1-7a4df3c773fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:25.814888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e5aa8-b6ef-4865-88b1-7a4df3c773fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:44:25.815196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e5aa8-b6ef-4865-88b1-7a4df3c773fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:25.816794 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e5aa8-b6ef-4865-88b1-7a4df3c773fe admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:25.829072 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1378/2778] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:44:25.833524 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700927d-3e07-414e-8fca-a15c7f5bb51d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:25.839334 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:44:25.843368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700927d-3e07-414e-8fca-a15c7f5bb51d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:25.849950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe489a8e-8efd-4d10-aebe-cee050efabe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:25.850880 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe489a8e-8efd-4d10-aebe-cee050efabe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:25.851400 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe489a8e-8efd-4d10-aebe-cee050efabe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:25.851846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe489a8e-8efd-4d10-aebe-cee050efabe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:25.852652 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe489a8e-8efd-4d10-aebe-cee050efabe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:25.854698 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe489a8e-8efd-4d10-aebe-cee050efabe0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:25.891635 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1401/2779] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:44:25 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:44:25.895894 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e5aa8-b6ef-4865-88b1-7a4df3c773fe admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:25.906271 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e5aa8-b6ef-4865-88b1-7a4df3c773fe admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:25.937488 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:44:25.965615 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94e66f-1dba-41af-b66f-e59dac76c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:25.966278 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94e66f-1dba-41af-b66f-e59dac76c9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:25.966557 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94e66f-1dba-41af-b66f-e59dac76c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:25.966856 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94e66f-1dba-41af-b66f-e59dac76c9c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:25.967544 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94e66f-1dba-41af-b66f-e59dac76c9c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:25.969508 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94e66f-1dba-41af-b66f-e59dac76c9c9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:25.988971 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1379/2780] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:44:25 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:44:25.993990 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe489a8e-8efd-4d10-aebe-cee050efabe0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:26.004207 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe489a8e-8efd-4d10-aebe-cee050efabe0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:26.008984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52990ada-a128-45ca-8c42-55f61ae0801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:26.009635 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52990ada-a128-45ca-8c42-55f61ae0801d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:26.009910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52990ada-a128-45ca-8c42-55f61ae0801d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:26.010178 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52990ada-a128-45ca-8c42-55f61ae0801d admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:26.010940 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52990ada-a128-45ca-8c42-55f61ae0801d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:26.012502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52990ada-a128-45ca-8c42-55f61ae0801d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:26.022931 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1402/2781] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:44:26.027072 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94e66f-1dba-41af-b66f-e59dac76c9c9 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:26.037912 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94e66f-1dba-41af-b66f-e59dac76c9c9 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:26.042533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a57038-37b4-41ad-b7bc-de966e3b788b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:26.043284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a57038-37b4-41ad-b7bc-de966e3b788b admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:26.043519 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a57038-37b4-41ad-b7bc-de966e3b788b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:26.043796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a57038-37b4-41ad-b7bc-de966e3b788b admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:26.044511 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a57038-37b4-41ad-b7bc-de966e3b788b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:26.046114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a57038-37b4-41ad-b7bc-de966e3b788b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:26.056926 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1380/2782] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:44:26.060937 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52990ada-a128-45ca-8c42-55f61ae0801d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:26.071088 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52990ada-a128-45ca-8c42-55f61ae0801d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:26.075895 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bd875-6d9c-40e3-b31d-5c4fb2a92d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:26.076776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bd875-6d9c-40e3-b31d-5c4fb2a92d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:26.077056 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bd875-6d9c-40e3-b31d-5c4fb2a92d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:26.077329 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bd875-6d9c-40e3-b31d-5c4fb2a92d32 admin admin] PATH_INFO: `/v3/projects/9b694b58cda947568f499adfb8202544/users/333459d9c2764ca6b69dfabc4c941c79/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:26.092694 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bd875-6d9c-40e3-b31d-5c4fb2a92d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b694b58cda947568f499adfb8202544, user_id=333459d9c2764ca6b69dfabc4c941c79, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:26.095355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bd875-6d9c-40e3-b31d-5c4fb2a92d32 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:26.108975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1403/2783] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:44:26 2022] PUT /identity/v3/projects/9b694b58cda947568f499adfb8202544/users/333459d9c2764ca6b69dfabc4c941c79/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:44:26.114118 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a5807-f1a5-4422-889e-e0c1c3ecc07c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:26.114531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a5807-f1a5-4422-889e-e0c1c3ecc07c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:26.114968 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a5807-f1a5-4422-889e-e0c1c3ecc07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:26.133116 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-124a5807-f1a5-4422-889e-e0c1c3ecc07c None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:44:26.134338 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-124a5807-f1a5-4422-889e-e0c1c3ecc07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:26.192882 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1381/2784] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:44:26.202426 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bd875-6d9c-40e3-b31d-5c4fb2a92d32 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:26.204136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4a5bd875-6d9c-40e3-b31d-5c4fb2a92d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:26.261661 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bd875-6d9c-40e3-b31d-5c4fb2a92d32 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:26.265388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e24ba-ae41-4559-8ab8-2d8d2a4bb385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:26.266037 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e24ba-ae41-4559-8ab8-2d8d2a4bb385 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:26.266319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e24ba-ae41-4559-8ab8-2d8d2a4bb385 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:26.266594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e24ba-ae41-4559-8ab8-2d8d2a4bb385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:26.276802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e24ba-ae41-4559-8ab8-2d8d2a4bb385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:26.278218 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e24ba-ae41-4559-8ab8-2d8d2a4bb385 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:26.288410 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1404/2785] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:44:30.223081 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68898a9c-68c2-4797-a8e9-1e40846567e9 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:30.223627 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68898a9c-68c2-4797-a8e9-1e40846567e9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:30.223727 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68898a9c-68c2-4797-a8e9-1e40846567e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:30.257706 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-68898a9c-68c2-4797-a8e9-1e40846567e9 None None] MFA Rules not processed for user `333459d9c2764ca6b69dfabc4c941c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:44:30.259030 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-68898a9c-68c2-4797-a8e9-1e40846567e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:30.335263 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1382/2786] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:44:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:44:30.342521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e24ba-ae41-4559-8ab8-2d8d2a4bb385 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:30.344007 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3d5e24ba-ae41-4559-8ab8-2d8d2a4bb385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:30.450016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e24ba-ae41-4559-8ab8-2d8d2a4bb385 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:30.455772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b3e1f-dfa3-45f1-a3d7-d48e83b63bd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:30.456427 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b3e1f-dfa3-45f1-a3d7-d48e83b63bd7 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:30.456706 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b3e1f-dfa3-45f1-a3d7-d48e83b63bd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:30.457010 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b3e1f-dfa3-45f1-a3d7-d48e83b63bd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:30.466636 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b3e1f-dfa3-45f1-a3d7-d48e83b63bd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:30.468298 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b3e1f-dfa3-45f1-a3d7-d48e83b63bd7 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:30.478704 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1405/2787] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:44:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:44:31.887269 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45e902-8e48-43ec-99c0-84a85daff92b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:31.887774 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45e902-8e48-43ec-99c0-84a85daff92b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:31.887863 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45e902-8e48-43ec-99c0-84a85daff92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:31.906619 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3d45e902-8e48-43ec-99c0-84a85daff92b None None] MFA Rules not processed for user `333459d9c2764ca6b69dfabc4c941c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:44:31.907862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3d45e902-8e48-43ec-99c0-84a85daff92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:31.916296 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1383/2788] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:44:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:44:32.232390 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b3e1f-dfa3-45f1-a3d7-d48e83b63bd7 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:32.233981 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-368b3e1f-dfa3-45f1-a3d7-d48e83b63bd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:32.246631 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b3e1f-dfa3-45f1-a3d7-d48e83b63bd7 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:32.250429 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cef55-d79c-4cc3-951c-36f50e507047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:32.251111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cef55-d79c-4cc3-951c-36f50e507047 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:32.251388 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cef55-d79c-4cc3-951c-36f50e507047 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:32.251655 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cef55-d79c-4cc3-951c-36f50e507047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:32.253425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-621cef55-d79c-4cc3-951c-36f50e507047 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:32.263325 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cef55-d79c-4cc3-951c-36f50e507047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:32.264731 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cef55-d79c-4cc3-951c-36f50e507047 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:32.274153 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1406/2789] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:44:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:44:41.901027 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:44:42.269305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:44:44.443910 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45e902-8e48-43ec-99c0-84a85daff92b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:44.445333 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3d45e902-8e48-43ec-99c0-84a85daff92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:44.462901 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45e902-8e48-43ec-99c0-84a85daff92b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:44.468734 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdb635-d9dd-48a8-919a-29fc8c45773c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:44.469387 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb635-d9dd-48a8-919a-29fc8c45773c service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:44.470159 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb635-d9dd-48a8-919a-29fc8c45773c service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:44.470448 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb635-d9dd-48a8-919a-29fc8c45773c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:44.472320 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cccdb635-d9dd-48a8-919a-29fc8c45773c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:44.485162 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdb635-d9dd-48a8-919a-29fc8c45773c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:44.486757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdb635-d9dd-48a8-919a-29fc8c45773c service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:44.497867 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1384/2790] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:44:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:44:54.493337 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=6 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:46:20.017485 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cef55-d79c-4cc3-951c-36f50e507047 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:46:20.027036 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cef55-d79c-4cc3-951c-36f50e507047 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:46:20.031243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953e40e-90e4-4e5d-be85-bc3b1af83cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:46:20.032064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953e40e-90e4-4e5d-be85-bc3b1af83cfb service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:46:20.032353 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953e40e-90e4-4e5d-be85-bc3b1af83cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:46:20.032633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953e40e-90e4-4e5d-be85-bc3b1af83cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:46:20.034521 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c953e40e-90e4-4e5d-be85-bc3b1af83cfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:46:20.049322 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953e40e-90e4-4e5d-be85-bc3b1af83cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:46:20.050796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953e40e-90e4-4e5d-be85-bc3b1af83cfb service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:46:20.063623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1407/2791] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:46:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:46:30.057537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:47:26.736266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdb635-d9dd-48a8-919a-29fc8c45773c service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:47:26.745785 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdb635-d9dd-48a8-919a-29fc8c45773c service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:47:26.749424 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53d63b-9ffd-48ba-a56c-c49823cd8cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:47:26.750090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53d63b-9ffd-48ba-a56c-c49823cd8cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:47:26.750369 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53d63b-9ffd-48ba-a56c-c49823cd8cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:47:26.750646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53d63b-9ffd-48ba-a56c-c49823cd8cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:47:26.752456 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cf53d63b-9ffd-48ba-a56c-c49823cd8cc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:47:26.765888 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53d63b-9ffd-48ba-a56c-c49823cd8cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:47:26.767334 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53d63b-9ffd-48ba-a56c-c49823cd8cc1 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:47:26.779038 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1385/2792] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:47:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:47:30.564897 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953e40e-90e4-4e5d-be85-bc3b1af83cfb service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:47:30.573570 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953e40e-90e4-4e5d-be85-bc3b1af83cfb service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:47:30.577266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59fba7-9d6f-41a2-a967-65adad91f101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:47:30.577910 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59fba7-9d6f-41a2-a967-65adad91f101 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:47:30.578189 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59fba7-9d6f-41a2-a967-65adad91f101 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:47:30.578461 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59fba7-9d6f-41a2-a967-65adad91f101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:47:30.580295 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1b59fba7-9d6f-41a2-a967-65adad91f101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:47:30.590920 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59fba7-9d6f-41a2-a967-65adad91f101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:47:30.592349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59fba7-9d6f-41a2-a967-65adad91f101 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:47:30.600819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1408/2793] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:47:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:47:36.773325 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=6 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:47:40.597072 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:48:35.385225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e193-1d89-4e6d-b379-b95f5d8c43ac None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:48:35.385757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e193-1d89-4e6d-b379-b95f5d8c43ac None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:48:35.385757 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e193-1d89-4e6d-b379-b95f5d8c43ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:48:35.404710 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2f97e193-1d89-4e6d-b379-b95f5d8c43ac None None] MFA Rules not processed for user `333459d9c2764ca6b69dfabc4c941c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:48:35.405952 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2f97e193-1d89-4e6d-b379-b95f5d8c43ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:48:35.413194 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1386/2794] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:48:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:48:36.021228 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59fba7-9d6f-41a2-a967-65adad91f101 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:48:36.022708 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1b59fba7-9d6f-41a2-a967-65adad91f101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:48:36.095900 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59fba7-9d6f-41a2-a967-65adad91f101 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:48:36.100999 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d1e16-426d-4e84-8669-56803462ccc8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:48:36.101647 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d1e16-426d-4e84-8669-56803462ccc8 service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:48:36.101929 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d1e16-426d-4e84-8669-56803462ccc8 service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:48:36.102206 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d1e16-426d-4e84-8669-56803462ccc8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:48:36.104018 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-265d1e16-426d-4e84-8669-56803462ccc8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:48:36.115494 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d1e16-426d-4e84-8669-56803462ccc8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:48:36.117071 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d1e16-426d-4e84-8669-56803462ccc8 service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:48:36.127217 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1409/2795] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:48:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:48:43.738898 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97e193-1d89-4e6d-b379-b95f5d8c43ac None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:48:43.753135 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97e193-1d89-4e6d-b379-b95f5d8c43ac None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:48:43.758798 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89752e50-b2e6-4fba-b8cb-7f044b7cb732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:48:43.759487 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89752e50-b2e6-4fba-b8cb-7f044b7cb732 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:48:43.759768 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89752e50-b2e6-4fba-b8cb-7f044b7cb732 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:48:43.760045 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89752e50-b2e6-4fba-b8cb-7f044b7cb732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:48:43.761837 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-89752e50-b2e6-4fba-b8cb-7f044b7cb732 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:48:43.775129 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89752e50-b2e6-4fba-b8cb-7f044b7cb732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:48:43.776710 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89752e50-b2e6-4fba-b8cb-7f044b7cb732 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:48:43.788003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1387/2796] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:48:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:48:46.123026 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=32 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:48:53.783374 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=9 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:49:28.912205 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d1e16-426d-4e84-8669-56803462ccc8 service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:49:28.970218 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d1e16-426d-4e84-8669-56803462ccc8 service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:49:28.975241 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e368485-46b0-49ea-887e-c2693b8e737f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:49:28.975862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e368485-46b0-49ea-887e-c2693b8e737f service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:49:28.976141 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e368485-46b0-49ea-887e-c2693b8e737f service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:49:28.976417 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e368485-46b0-49ea-887e-c2693b8e737f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:49:28.978196 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3e368485-46b0-49ea-887e-c2693b8e737f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:49:29.012155 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e368485-46b0-49ea-887e-c2693b8e737f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:49:29.013737 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e368485-46b0-49ea-887e-c2693b8e737f service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:49:29.023891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1410/2797] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:49:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:49:39.019643 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=36 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:49:52.245311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89752e50-b2e6-4fba-b8cb-7f044b7cb732 service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:49:52.311659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89752e50-b2e6-4fba-b8cb-7f044b7cb732 service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:49:52.317204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d976f03-c7e3-410d-b67d-21a03c6fb24f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:49:52.317851 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d976f03-c7e3-410d-b67d-21a03c6fb24f service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:49:52.318136 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d976f03-c7e3-410d-b67d-21a03c6fb24f service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:49:52.318412 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d976f03-c7e3-410d-b67d-21a03c6fb24f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:49:52.326603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d976f03-c7e3-410d-b67d-21a03c6fb24f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:49:52.328237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d976f03-c7e3-410d-b67d-21a03c6fb24f service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:49:52.337220 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1388/2798] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:49:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:50:02.333209 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=30 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:05.235684 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e368485-46b0-49ea-887e-c2693b8e737f service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:05.250355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e368485-46b0-49ea-887e-c2693b8e737f service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:05.256772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29334743-9893-445c-9cb9-ff172dc18ddc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:05.257551 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29334743-9893-445c-9cb9-ff172dc18ddc service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:05.257891 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29334743-9893-445c-9cb9-ff172dc18ddc service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:05.258347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29334743-9893-445c-9cb9-ff172dc18ddc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:05.260409 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-29334743-9893-445c-9cb9-ff172dc18ddc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:05.300912 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29334743-9893-445c-9cb9-ff172dc18ddc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:05.302636 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29334743-9893-445c-9cb9-ff172dc18ddc service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:05.317073 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1411/2799] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:50:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:50:10.296913 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d976f03-c7e3-410d-b67d-21a03c6fb24f service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:10.316593 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d976f03-c7e3-410d-b67d-21a03c6fb24f service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:10.320164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c2fe9-86ec-4920-a1c7-85387107ccc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:10.320800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c2fe9-86ec-4920-a1c7-85387107ccc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:10.321080 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c2fe9-86ec-4920-a1c7-85387107ccc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:10.321354 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c2fe9-86ec-4920-a1c7-85387107ccc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:10.331294 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c2fe9-86ec-4920-a1c7-85387107ccc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:10.332709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c2fe9-86ec-4920-a1c7-85387107ccc6 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:10.361167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1389/2800] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:50:13.140448 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29334743-9893-445c-9cb9-ff172dc18ddc service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:13.159878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29334743-9893-445c-9cb9-ff172dc18ddc service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:13.165666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3b044-11e0-4101-bfbf-23546e32fe3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:13.166326 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3b044-11e0-4101-bfbf-23546e32fe3a service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:13.166604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3b044-11e0-4101-bfbf-23546e32fe3a service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:13.166950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3b044-11e0-4101-bfbf-23546e32fe3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:13.168770 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fcc3b044-11e0-4101-bfbf-23546e32fe3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:13.181878 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3b044-11e0-4101-bfbf-23546e32fe3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:13.185122 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3b044-11e0-4101-bfbf-23546e32fe3a service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:13.199744 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1412/2801] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:50:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:50:13.218716 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c2fe9-86ec-4920-a1c7-85387107ccc6 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:13.230969 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c2fe9-86ec-4920-a1c7-85387107ccc6 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:13.255470 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fb676-08b9-4748-a59d-d2275e2ecffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:13.256365 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fb676-08b9-4748-a59d-d2275e2ecffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:13.256646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fb676-08b9-4748-a59d-d2275e2ecffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:13.256987 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fb676-08b9-4748-a59d-d2275e2ecffe admin admin] PATH_INFO: `/v3/users/333459d9c2764ca6b69dfabc4c941c79` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:13.258361 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fb676-08b9-4748-a59d-d2275e2ecffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=333459d9c2764ca6b69dfabc4c941c79)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:13.260384 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fb676-08b9-4748-a59d-d2275e2ecffe admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:13.433713 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5a0fb676-08b9-4748-a59d-d2275e2ecffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '333459d9c2764ca6b69dfabc4c941c79'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:13.440617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5a0fb676-08b9-4748-a59d-d2275e2ecffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '333459d9c2764ca6b69dfabc4c941c79'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:13.452684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5a0fb676-08b9-4748-a59d-d2275e2ecffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '333459d9c2764ca6b69dfabc4c941c79'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:13.459450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5a0fb676-08b9-4748-a59d-d2275e2ecffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '333459d9c2764ca6b69dfabc4c941c79'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:13.460327 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5a0fb676-08b9-4748-a59d-d2275e2ecffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '333459d9c2764ca6b69dfabc4c941c79'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:13.466204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1390/2802] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:50:13 2022] DELETE /identity/v3/users/333459d9c2764ca6b69dfabc4c941c79 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:13.647285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3b044-11e0-4101-bfbf-23546e32fe3a service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:13.662331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3b044-11e0-4101-bfbf-23546e32fe3a service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:13.720097 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdf589-223b-4e0d-abdc-1d5f32d476cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:13.720955 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdf589-223b-4e0d-abdc-1d5f32d476cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:13.721232 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdf589-223b-4e0d-abdc-1d5f32d476cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:13.721504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdf589-223b-4e0d-abdc-1d5f32d476cf admin admin] PATH_INFO: `/v3/projects/9b694b58cda947568f499adfb8202544` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:13.722662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdf589-223b-4e0d-abdc-1d5f32d476cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b694b58cda947568f499adfb8202544)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:13.724682 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdf589-223b-4e0d-abdc-1d5f32d476cf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:13.769366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fbdf589-223b-4e0d-abdc-1d5f32d476cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b694b58cda947568f499adfb8202544', 'request_id': 'req-5fbdf589-223b-4e0d-abdc-1d5f32d476cf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:13.775027 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fbdf589-223b-4e0d-abdc-1d5f32d476cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b694b58cda947568f499adfb8202544', 'request_id': 'req-5fbdf589-223b-4e0d-abdc-1d5f32d476cf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:13.782933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fbdf589-223b-4e0d-abdc-1d5f32d476cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b694b58cda947568f499adfb8202544', 'request_id': 'req-5fbdf589-223b-4e0d-abdc-1d5f32d476cf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:13.805902 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fbdf589-223b-4e0d-abdc-1d5f32d476cf admin admin] The token cache is being invalidate because project 9b694b58cda947568f499adfb8202544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:50:13.806188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fbdf589-223b-4e0d-abdc-1d5f32d476cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:13.806837 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fbdf589-223b-4e0d-abdc-1d5f32d476cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:13.808573 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1413/2803] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:50:13 2022] DELETE /identity/v3/projects/9b694b58cda947568f499adfb8202544 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:50:13.813382 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1fce0-0626-4da0-b850-99fa4dcafc6d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:13.813693 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1fce0-0626-4da0-b850-99fa4dcafc6d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:13.813963 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1fce0-0626-4da0-b850-99fa4dcafc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:13.868978 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-f0f1fce0-0626-4da0-b850-99fa4dcafc6d None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:13.870176 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f0f1fce0-0626-4da0-b850-99fa4dcafc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:13.928085 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1391/2804] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:13.936001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95289c9c-7f74-4ab3-bda7-a18af5894d8c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:13.936993 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95289c9c-7f74-4ab3-bda7-a18af5894d8c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:13.937456 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95289c9c-7f74-4ab3-bda7-a18af5894d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:13.955536 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-95289c9c-7f74-4ab3-bda7-a18af5894d8c None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:13.956672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-95289c9c-7f74-4ab3-bda7-a18af5894d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:13.964466 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1414/2805] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:13.968557 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1fce0-0626-4da0-b850-99fa4dcafc6d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:13.974383 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:13.978629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1fce0-0626-4da0-b850-99fa4dcafc6d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:13.984589 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fc46d-eae2-48d2-a17f-d1506bbae2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:13.985453 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fc46d-eae2-48d2-a17f-d1506bbae2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:13.985771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fc46d-eae2-48d2-a17f-d1506bbae2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:13.986043 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fc46d-eae2-48d2-a17f-d1506bbae2c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:13.986958 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fc46d-eae2-48d2-a17f-d1506bbae2c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:50:13.987427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fc46d-eae2-48d2-a17f-d1506bbae2c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:13.989160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fc46d-eae2-48d2-a17f-d1506bbae2c2 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:14.001449 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1392/2806] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:50:14.005659 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95289c9c-7f74-4ab3-bda7-a18af5894d8c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:14.015798 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95289c9c-7f74-4ab3-bda7-a18af5894d8c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:14.020528 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1b951-d44d-4cf5-aa3b-0e9515dbb98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:14.021172 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1b951-d44d-4cf5-aa3b-0e9515dbb98c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:14.021453 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1b951-d44d-4cf5-aa3b-0e9515dbb98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:14.021723 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1b951-d44d-4cf5-aa3b-0e9515dbb98c admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:14.022392 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1b951-d44d-4cf5-aa3b-0e9515dbb98c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:14.024326 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1b951-d44d-4cf5-aa3b-0e9515dbb98c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:14.053290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1415/2807] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:50:14 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:50:14.057383 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fc46d-eae2-48d2-a17f-d1506bbae2c2 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:14.067921 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fc46d-eae2-48d2-a17f-d1506bbae2c2 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:14.122813 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad11360-4563-4bba-ac2e-f39a1ceb71aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:14.123470 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad11360-4563-4bba-ac2e-f39a1ceb71aa admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:14.124313 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad11360-4563-4bba-ac2e-f39a1ceb71aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:14.124759 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad11360-4563-4bba-ac2e-f39a1ceb71aa admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:14.125443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad11360-4563-4bba-ac2e-f39a1ceb71aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:14.127353 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad11360-4563-4bba-ac2e-f39a1ceb71aa admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:14.147278 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1393/2808] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:50:14 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:50:14.151710 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1b951-d44d-4cf5-aa3b-0e9515dbb98c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:14.162157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1b951-d44d-4cf5-aa3b-0e9515dbb98c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:14.166850 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1189c0-810a-4a14-afaa-cfcd192dee66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:14.167508 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1189c0-810a-4a14-afaa-cfcd192dee66 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:14.167790 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1189c0-810a-4a14-afaa-cfcd192dee66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:14.168060 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1189c0-810a-4a14-afaa-cfcd192dee66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:14.168776 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1189c0-810a-4a14-afaa-cfcd192dee66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:14.170355 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1189c0-810a-4a14-afaa-cfcd192dee66 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:14.180217 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1416/2809] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:50:14.183962 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad11360-4563-4bba-ac2e-f39a1ceb71aa admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:14.194283 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad11360-4563-4bba-ac2e-f39a1ceb71aa admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:14.199151 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859500b-7d61-4e08-a447-424c0ea1e07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:14.199807 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859500b-7d61-4e08-a447-424c0ea1e07f admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:14.200087 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859500b-7d61-4e08-a447-424c0ea1e07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:14.200356 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859500b-7d61-4e08-a447-424c0ea1e07f admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:14.201066 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859500b-7d61-4e08-a447-424c0ea1e07f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:14.203377 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859500b-7d61-4e08-a447-424c0ea1e07f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:14.213862 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1394/2810] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:50:14.217836 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1189c0-810a-4a14-afaa-cfcd192dee66 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:14.223043 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:14.229727 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1189c0-810a-4a14-afaa-cfcd192dee66 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:14.235708 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066693e-498d-4023-a5d0-9196a32266c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:14.236600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066693e-498d-4023-a5d0-9196a32266c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:14.236875 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066693e-498d-4023-a5d0-9196a32266c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:14.237141 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066693e-498d-4023-a5d0-9196a32266c7 admin admin] PATH_INFO: `/v3/projects/84357b28048645a5ba829e20069a864f/users/3d3569bd687041f581a906df1a67e23b/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:14.253109 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066693e-498d-4023-a5d0-9196a32266c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84357b28048645a5ba829e20069a864f, user_id=3d3569bd687041f581a906df1a67e23b, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:14.255786 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066693e-498d-4023-a5d0-9196a32266c7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:14.269364 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1417/2811] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:50:14 2022] PUT /identity/v3/projects/84357b28048645a5ba829e20069a864f/users/3d3569bd687041f581a906df1a67e23b/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:14.279642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ce21f-e85f-4e65-bb90-f84ffb35cb2e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:14.280174 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ce21f-e85f-4e65-bb90-f84ffb35cb2e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:14.280443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ce21f-e85f-4e65-bb90-f84ffb35cb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:14.306152 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-451ce21f-e85f-4e65-bb90-f84ffb35cb2e None None] MFA Rules not processed for user `3d3569bd687041f581a906df1a67e23b`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:14.307427 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-451ce21f-e85f-4e65-bb90-f84ffb35cb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:14.373312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1395/2812] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:14.378852 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066693e-498d-4023-a5d0-9196a32266c7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:14.440085 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066693e-498d-4023-a5d0-9196a32266c7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:14.444657 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8fcd7-2513-4f91-b76e-d2f89b312162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:14.445305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8fcd7-2513-4f91-b76e-d2f89b312162 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:14.445583 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8fcd7-2513-4f91-b76e-d2f89b312162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:14.445853 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8fcd7-2513-4f91-b76e-d2f89b312162 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:14.446536 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8fcd7-2513-4f91-b76e-d2f89b312162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:14.448456 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8fcd7-2513-4f91-b76e-d2f89b312162 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:14.472592 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1418/2813] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:50:14 2022] POST /identity/v3/projects => generated 369 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:50:14.476620 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ce21f-e85f-4e65-bb90-f84ffb35cb2e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:14.487763 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ce21f-e85f-4e65-bb90-f84ffb35cb2e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:14.542470 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda079d-ebe5-4372-90cf-f9010746ff82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:14.543167 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda079d-ebe5-4372-90cf-f9010746ff82 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:14.543450 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda079d-ebe5-4372-90cf-f9010746ff82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:14.543724 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda079d-ebe5-4372-90cf-f9010746ff82 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:14.544494 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda079d-ebe5-4372-90cf-f9010746ff82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:14.546910 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda079d-ebe5-4372-90cf-f9010746ff82 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:14.553421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:14.566951 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1396/2814] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:50:14 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:50:14.570814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8fcd7-2513-4f91-b76e-d2f89b312162 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:14.581162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8fcd7-2513-4f91-b76e-d2f89b312162 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:14.585794 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315efdef-7ec2-41ec-9f42-d56f775b4a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:14.586446 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315efdef-7ec2-41ec-9f42-d56f775b4a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:14.586725 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315efdef-7ec2-41ec-9f42-d56f775b4a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:14.587028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315efdef-7ec2-41ec-9f42-d56f775b4a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:14.587742 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315efdef-7ec2-41ec-9f42-d56f775b4a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:14.589320 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315efdef-7ec2-41ec-9f42-d56f775b4a75 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:14.599888 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1419/2815] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:50:14.603788 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda079d-ebe5-4372-90cf-f9010746ff82 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:14.613965 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda079d-ebe5-4372-90cf-f9010746ff82 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:14.618498 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd19d92-8786-4875-80a1-edca7f2c1aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:14.619399 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd19d92-8786-4875-80a1-edca7f2c1aea admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:14.619674 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd19d92-8786-4875-80a1-edca7f2c1aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:14.619942 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd19d92-8786-4875-80a1-edca7f2c1aea admin admin] PATH_INFO: `/v3/projects/4f8554f6ff394c8b9a90b99e1b6b5d5f/users/2f5769c055ee433a9a8a3e7531897cf1/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:14.634723 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd19d92-8786-4875-80a1-edca7f2c1aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f8554f6ff394c8b9a90b99e1b6b5d5f, user_id=2f5769c055ee433a9a8a3e7531897cf1, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:14.637344 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd19d92-8786-4875-80a1-edca7f2c1aea admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:14.651646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1397/2816] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:50:14 2022] PUT /identity/v3/projects/4f8554f6ff394c8b9a90b99e1b6b5d5f/users/2f5769c055ee433a9a8a3e7531897cf1/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:50:14.655802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315efdef-7ec2-41ec-9f42-d56f775b4a75 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:14.665994 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315efdef-7ec2-41ec-9f42-d56f775b4a75 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:14.724069 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d5a2d-763a-4154-98a7-42d9b420e251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:14.724668 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d5a2d-763a-4154-98a7-42d9b420e251 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:14.724943 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d5a2d-763a-4154-98a7-42d9b420e251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:14.725213 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d5a2d-763a-4154-98a7-42d9b420e251 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:14.725916 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d5a2d-763a-4154-98a7-42d9b420e251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:14.727528 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d5a2d-763a-4154-98a7-42d9b420e251 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:14.737174 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1420/2817] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:50:14.741352 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd19d92-8786-4875-80a1-edca7f2c1aea admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:14.752389 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd19d92-8786-4875-80a1-edca7f2c1aea admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:14.756955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f488c-7546-4377-8819-dfae86658735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:14.757825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f488c-7546-4377-8819-dfae86658735 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:14.758109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f488c-7546-4377-8819-dfae86658735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:14.758383 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f488c-7546-4377-8819-dfae86658735 admin admin] PATH_INFO: `/v3/projects/4f8554f6ff394c8b9a90b99e1b6b5d5f/users/2f5769c055ee433a9a8a3e7531897cf1/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:14.760401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f488c-7546-4377-8819-dfae86658735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f8554f6ff394c8b9a90b99e1b6b5d5f, user_id=2f5769c055ee433a9a8a3e7531897cf1, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:14.763049 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f488c-7546-4377-8819-dfae86658735 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:14.773772 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1398/2818] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:50:14 2022] PUT /identity/v3/projects/4f8554f6ff394c8b9a90b99e1b6b5d5f/users/2f5769c055ee433a9a8a3e7531897cf1/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:14.832731 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d1047-f885-40d2-9e34-f9396d3c0bce None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:14.833001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d1047-f885-40d2-9e34-f9396d3c0bce None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:14.833285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d1047-f885-40d2-9e34-f9396d3c0bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:14.860010 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a50d1047-f885-40d2-9e34-f9396d3c0bce None None] MFA Rules not processed for user `2f5769c055ee433a9a8a3e7531897cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:14.861247 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a50d1047-f885-40d2-9e34-f9396d3c0bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:14.900017 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:14.930840 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1421/2819] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:14 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:14.942004 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f488c-7546-4377-8819-dfae86658735 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:14.943769 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-037f488c-7546-4377-8819-dfae86658735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:15.021546 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f488c-7546-4377-8819-dfae86658735 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:15.025400 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3374c0d-0991-4afa-aa83-7a0f27c61d51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:15.026030 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3374c0d-0991-4afa-aa83-7a0f27c61d51 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:15.026304 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3374c0d-0991-4afa-aa83-7a0f27c61d51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:15.026575 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3374c0d-0991-4afa-aa83-7a0f27c61d51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:15.036015 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3374c0d-0991-4afa-aa83-7a0f27c61d51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:15.037413 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3374c0d-0991-4afa-aa83-7a0f27c61d51 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:15.047481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1399/2820] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:50:14 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:50:16.341760 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d1047-f885-40d2-9e34-f9396d3c0bce None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:16.405042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d1047-f885-40d2-9e34-f9396d3c0bce None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:16.409616 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18f463-ed3a-4e5d-962b-38e752705e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:16.410485 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18f463-ed3a-4e5d-962b-38e752705e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:16.410781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18f463-ed3a-4e5d-962b-38e752705e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:16.411057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18f463-ed3a-4e5d-962b-38e752705e80 admin admin] PATH_INFO: `/v3/users/3d3569bd687041f581a906df1a67e23b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:16.412229 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18f463-ed3a-4e5d-962b-38e752705e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3569bd687041f581a906df1a67e23b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:16.414137 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18f463-ed3a-4e5d-962b-38e752705e80 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:16.461772 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8f18f463-ed3a-4e5d-962b-38e752705e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3569bd687041f581a906df1a67e23b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:16.468886 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8f18f463-ed3a-4e5d-962b-38e752705e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3569bd687041f581a906df1a67e23b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:16.480579 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8f18f463-ed3a-4e5d-962b-38e752705e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3569bd687041f581a906df1a67e23b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:16.488067 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8f18f463-ed3a-4e5d-962b-38e752705e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3569bd687041f581a906df1a67e23b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:16.488809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8f18f463-ed3a-4e5d-962b-38e752705e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3569bd687041f581a906df1a67e23b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:16.494819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1422/2821] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:50:16 2022] DELETE /identity/v3/users/3d3569bd687041f581a906df1a67e23b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:16.500090 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee802e03-b627-4ae0-b22f-8834e5e3c812 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:16.500617 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee802e03-b627-4ae0-b22f-8834e5e3c812 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:16.500760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee802e03-b627-4ae0-b22f-8834e5e3c812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:16.517995 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ee802e03-b627-4ae0-b22f-8834e5e3c812 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:16.519221 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ee802e03-b627-4ae0-b22f-8834e5e3c812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:16.577429 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1400/2822] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:16.586975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18f463-ed3a-4e5d-962b-38e752705e80 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:16.588419 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8f18f463-ed3a-4e5d-962b-38e752705e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:16.646301 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:16.659807 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18f463-ed3a-4e5d-962b-38e752705e80 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:16.663480 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fab406-9779-4926-bae5-6866362c5023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:16.664147 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fab406-9779-4926-bae5-6866362c5023 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:16.664424 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fab406-9779-4926-bae5-6866362c5023 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:16.664692 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fab406-9779-4926-bae5-6866362c5023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:16.674414 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fab406-9779-4926-bae5-6866362c5023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:16.675914 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fab406-9779-4926-bae5-6866362c5023 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:16.687780 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1423/2823] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:50:16.956749 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee802e03-b627-4ae0-b22f-8834e5e3c812 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:16.958473 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ee802e03-b627-4ae0-b22f-8834e5e3c812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:16.971029 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee802e03-b627-4ae0-b22f-8834e5e3c812 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:16.975626 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b31f6-77f4-41f1-875e-4acf52a0a1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:16.976483 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b31f6-77f4-41f1-875e-4acf52a0a1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:16.976759 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b31f6-77f4-41f1-875e-4acf52a0a1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:16.977026 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b31f6-77f4-41f1-875e-4acf52a0a1a0 admin admin] PATH_INFO: `/v3/projects/84357b28048645a5ba829e20069a864f` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:16.978370 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b31f6-77f4-41f1-875e-4acf52a0a1a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84357b28048645a5ba829e20069a864f)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:16.980338 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b31f6-77f4-41f1-875e-4acf52a0a1a0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:17.015866 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:INSERT=5,keystone:SELECT=93,keystone:DELETE=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:17.031088 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8b1b31f6-77f4-41f1-875e-4acf52a0a1a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84357b28048645a5ba829e20069a864f', 'request_id': 'req-8b1b31f6-77f4-41f1-875e-4acf52a0a1a0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:17.036498 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8b1b31f6-77f4-41f1-875e-4acf52a0a1a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84357b28048645a5ba829e20069a864f', 'request_id': 'req-8b1b31f6-77f4-41f1-875e-4acf52a0a1a0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:17.043718 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8b1b31f6-77f4-41f1-875e-4acf52a0a1a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84357b28048645a5ba829e20069a864f', 'request_id': 'req-8b1b31f6-77f4-41f1-875e-4acf52a0a1a0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:17.055895 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8b1b31f6-77f4-41f1-875e-4acf52a0a1a0 admin admin] The token cache is being invalidate because project 84357b28048645a5ba829e20069a864f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:50:17.056179 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8b1b31f6-77f4-41f1-875e-4acf52a0a1a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:17.056927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8b1b31f6-77f4-41f1-875e-4acf52a0a1a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:17.058434 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1401/2824] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:50:16 2022] DELETE /identity/v3/projects/84357b28048645a5ba829e20069a864f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:17.062394 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fab406-9779-4926-bae5-6866362c5023 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:17.072100 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fab406-9779-4926-bae5-6866362c5023 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:17.127389 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929b4f2-ce06-47bf-81ce-107ee3c586e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:17.128174 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929b4f2-ce06-47bf-81ce-107ee3c586e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:17.128450 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929b4f2-ce06-47bf-81ce-107ee3c586e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:17.128721 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929b4f2-ce06-47bf-81ce-107ee3c586e7 admin admin] PATH_INFO: `/v3/users/2f5769c055ee433a9a8a3e7531897cf1` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:17.129882 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929b4f2-ce06-47bf-81ce-107ee3c586e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f5769c055ee433a9a8a3e7531897cf1)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:17.131828 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929b4f2-ce06-47bf-81ce-107ee3c586e7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:17.179978 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c929b4f2-ce06-47bf-81ce-107ee3c586e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f5769c055ee433a9a8a3e7531897cf1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:17.186975 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c929b4f2-ce06-47bf-81ce-107ee3c586e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f5769c055ee433a9a8a3e7531897cf1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:17.198661 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c929b4f2-ce06-47bf-81ce-107ee3c586e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f5769c055ee433a9a8a3e7531897cf1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:17.207078 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c929b4f2-ce06-47bf-81ce-107ee3c586e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f5769c055ee433a9a8a3e7531897cf1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:17.207813 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c929b4f2-ce06-47bf-81ce-107ee3c586e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f5769c055ee433a9a8a3e7531897cf1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:17.213777 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1424/2825] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:50:17 2022] DELETE /identity/v3/users/2f5769c055ee433a9a8a3e7531897cf1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:17.486574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b31f6-77f4-41f1-875e-4acf52a0a1a0 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:17.488240 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8b1b31f6-77f4-41f1-875e-4acf52a0a1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:17.501875 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b31f6-77f4-41f1-875e-4acf52a0a1a0 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:17.562093 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758d27e-0461-4ff0-9d81-62f1dceef34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:17.562982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758d27e-0461-4ff0-9d81-62f1dceef34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:17.563264 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758d27e-0461-4ff0-9d81-62f1dceef34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:17.563539 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758d27e-0461-4ff0-9d81-62f1dceef34f admin admin] PATH_INFO: `/v3/projects/4f8554f6ff394c8b9a90b99e1b6b5d5f` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:17.564756 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758d27e-0461-4ff0-9d81-62f1dceef34f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f8554f6ff394c8b9a90b99e1b6b5d5f)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:17.566673 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758d27e-0461-4ff0-9d81-62f1dceef34f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:17.612452 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5758d27e-0461-4ff0-9d81-62f1dceef34f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f8554f6ff394c8b9a90b99e1b6b5d5f', 'request_id': 'req-5758d27e-0461-4ff0-9d81-62f1dceef34f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:17.617825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5758d27e-0461-4ff0-9d81-62f1dceef34f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f8554f6ff394c8b9a90b99e1b6b5d5f', 'request_id': 'req-5758d27e-0461-4ff0-9d81-62f1dceef34f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:17.625034 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5758d27e-0461-4ff0-9d81-62f1dceef34f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f8554f6ff394c8b9a90b99e1b6b5d5f', 'request_id': 'req-5758d27e-0461-4ff0-9d81-62f1dceef34f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:17.635916 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5758d27e-0461-4ff0-9d81-62f1dceef34f admin admin] The token cache is being invalidate because project 4f8554f6ff394c8b9a90b99e1b6b5d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:50:17.636196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5758d27e-0461-4ff0-9d81-62f1dceef34f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:17.636812 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5758d27e-0461-4ff0-9d81-62f1dceef34f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:17.638402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1402/2826] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:50:17 2022] DELETE /identity/v3/projects/4f8554f6ff394c8b9a90b99e1b6b5d5f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:17.643873 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f169c-fd88-4dc2-ad7b-2730fc818e12 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:17.644349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f169c-fd88-4dc2-ad7b-2730fc818e12 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:17.644456 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f169c-fd88-4dc2-ad7b-2730fc818e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:17.665200 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b77f169c-fd88-4dc2-ad7b-2730fc818e12 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:17.666344 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b77f169c-fd88-4dc2-ad7b-2730fc818e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:17.727172 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1425/2827] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:17.735295 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64a08b-ecd4-43d9-ad6e-00be3f95129a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:17.735588 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64a08b-ecd4-43d9-ad6e-00be3f95129a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:17.735868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64a08b-ecd4-43d9-ad6e-00be3f95129a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:17.754330 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6d64a08b-ecd4-43d9-ad6e-00be3f95129a None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:17.755571 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6d64a08b-ecd4-43d9-ad6e-00be3f95129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:17.763576 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1403/2828] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:17.768260 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f169c-fd88-4dc2-ad7b-2730fc818e12 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:17.774350 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:17.778344 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f169c-fd88-4dc2-ad7b-2730fc818e12 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:17.784513 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d02520-11c9-4110-aa7b-4de3bf9ab6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:17.785385 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d02520-11c9-4110-aa7b-4de3bf9ab6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:17.785673 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d02520-11c9-4110-aa7b-4de3bf9ab6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:17.786163 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d02520-11c9-4110-aa7b-4de3bf9ab6a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:17.786992 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d02520-11c9-4110-aa7b-4de3bf9ab6a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:50:17.787499 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d02520-11c9-4110-aa7b-4de3bf9ab6a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:17.789244 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d02520-11c9-4110-aa7b-4de3bf9ab6a6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:17.801016 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1426/2829] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:50:17.805202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64a08b-ecd4-43d9-ad6e-00be3f95129a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:17.816078 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64a08b-ecd4-43d9-ad6e-00be3f95129a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:17.820881 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ae7cd-f4ca-4213-969f-ef113a4cc516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:17.821528 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ae7cd-f4ca-4213-969f-ef113a4cc516 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:17.821806 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ae7cd-f4ca-4213-969f-ef113a4cc516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:17.822077 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ae7cd-f4ca-4213-969f-ef113a4cc516 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:17.822783 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ae7cd-f4ca-4213-969f-ef113a4cc516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:17.824681 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ae7cd-f4ca-4213-969f-ef113a4cc516 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:17.850184 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1404/2830] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:50:17 2022] POST /identity/v3/projects => generated 401 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:50:17.854343 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d02520-11c9-4110-aa7b-4de3bf9ab6a6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:17.864532 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d02520-11c9-4110-aa7b-4de3bf9ab6a6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:17.919849 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4410b-a8dc-4f2b-921d-f15772af6fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:17.920526 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4410b-a8dc-4f2b-921d-f15772af6fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:17.920796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4410b-a8dc-4f2b-921d-f15772af6fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:17.921067 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4410b-a8dc-4f2b-921d-f15772af6fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:17.921750 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4410b-a8dc-4f2b-921d-f15772af6fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:17.923671 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4410b-a8dc-4f2b-921d-f15772af6fb5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:17.943606 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1427/2831] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:50:17 2022] POST /identity/v3/users => generated 301 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:50:17.947927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ae7cd-f4ca-4213-969f-ef113a4cc516 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:17.958850 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ae7cd-f4ca-4213-969f-ef113a4cc516 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:17.963314 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae332d5b-1e0c-4214-8828-07d62b6531c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:17.963960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae332d5b-1e0c-4214-8828-07d62b6531c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:17.964236 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae332d5b-1e0c-4214-8828-07d62b6531c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:17.964502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae332d5b-1e0c-4214-8828-07d62b6531c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:17.965211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae332d5b-1e0c-4214-8828-07d62b6531c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:17.966827 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae332d5b-1e0c-4214-8828-07d62b6531c8 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:17.976941 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1405/2832] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:50:17.980762 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4410b-a8dc-4f2b-921d-f15772af6fb5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:17.991128 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4410b-a8dc-4f2b-921d-f15772af6fb5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:17.995750 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce57141-ffca-4e40-9b81-775632b58e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:17.996396 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce57141-ffca-4e40-9b81-775632b58e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:17.996676 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce57141-ffca-4e40-9b81-775632b58e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:17.996948 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce57141-ffca-4e40-9b81-775632b58e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:17.997662 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce57141-ffca-4e40-9b81-775632b58e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:18.000049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce57141-ffca-4e40-9b81-775632b58e49 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:18.009826 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1428/2833] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:50:18.013659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae332d5b-1e0c-4214-8828-07d62b6531c8 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:18.024159 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae332d5b-1e0c-4214-8828-07d62b6531c8 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:18.029040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51232009-7a2b-4fff-8643-a4fb2afffd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:18.029925 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51232009-7a2b-4fff-8643-a4fb2afffd30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:18.030202 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51232009-7a2b-4fff-8643-a4fb2afffd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:18.030469 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51232009-7a2b-4fff-8643-a4fb2afffd30 admin admin] PATH_INFO: `/v3/projects/4bb6dfe75f76435994130fd8487042be/users/518716f1592345ec978a0b131fb4ddc5/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:18.033551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:18.047355 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51232009-7a2b-4fff-8643-a4fb2afffd30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb6dfe75f76435994130fd8487042be, user_id=518716f1592345ec978a0b131fb4ddc5, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:18.050237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51232009-7a2b-4fff-8643-a4fb2afffd30 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:18.063552 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1406/2834] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:50:18 2022] PUT /identity/v3/projects/4bb6dfe75f76435994130fd8487042be/users/518716f1592345ec978a0b131fb4ddc5/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:18.073978 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12001e-a408-4b29-88c5-87f5dfc2c216 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:18.074264 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12001e-a408-4b29-88c5-87f5dfc2c216 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:18.074541 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12001e-a408-4b29-88c5-87f5dfc2c216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:18.100943 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1b12001e-a408-4b29-88c5-87f5dfc2c216 None None] MFA Rules not processed for user `518716f1592345ec978a0b131fb4ddc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:18.102148 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1b12001e-a408-4b29-88c5-87f5dfc2c216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:18.166525 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1429/2835] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:18.171752 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51232009-7a2b-4fff-8643-a4fb2afffd30 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:18.233612 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51232009-7a2b-4fff-8643-a4fb2afffd30 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:18.238268 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf2284-9267-4814-a59b-c860cfced999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:18.238959 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf2284-9267-4814-a59b-c860cfced999 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:18.239247 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf2284-9267-4814-a59b-c860cfced999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:18.239522 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf2284-9267-4814-a59b-c860cfced999 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:18.240205 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf2284-9267-4814-a59b-c860cfced999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:18.242082 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf2284-9267-4814-a59b-c860cfced999 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:18.267910 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1407/2836] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:50:18 2022] POST /identity/v3/projects => generated 401 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:50:18.271985 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12001e-a408-4b29-88c5-87f5dfc2c216 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:18.282892 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12001e-a408-4b29-88c5-87f5dfc2c216 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:18.337102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2148df-9ec8-4264-ad71-717608dad7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:18.337766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2148df-9ec8-4264-ad71-717608dad7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:18.338042 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2148df-9ec8-4264-ad71-717608dad7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:18.338338 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2148df-9ec8-4264-ad71-717608dad7e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:18.339054 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2148df-9ec8-4264-ad71-717608dad7e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:18.340950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2148df-9ec8-4264-ad71-717608dad7e2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:18.348029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:18.365077 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1430/2837] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:50:18 2022] POST /identity/v3/users => generated 307 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:50:18.366240 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf2284-9267-4814-a59b-c860cfced999 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:18.377668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf2284-9267-4814-a59b-c860cfced999 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:18.382313 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533736de-c1f9-4b37-a23a-ae84fe6bccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:18.382989 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533736de-c1f9-4b37-a23a-ae84fe6bccd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:18.383272 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533736de-c1f9-4b37-a23a-ae84fe6bccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:18.383545 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533736de-c1f9-4b37-a23a-ae84fe6bccd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:18.384260 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533736de-c1f9-4b37-a23a-ae84fe6bccd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:18.385815 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533736de-c1f9-4b37-a23a-ae84fe6bccd1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:18.396481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1408/2838] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:50:18.400842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2148df-9ec8-4264-ad71-717608dad7e2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:18.411168 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2148df-9ec8-4264-ad71-717608dad7e2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:18.415872 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731419fd-c223-4920-8071-bdb31147c07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:18.416745 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731419fd-c223-4920-8071-bdb31147c07d admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:18.417027 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731419fd-c223-4920-8071-bdb31147c07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:18.417313 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731419fd-c223-4920-8071-bdb31147c07d admin admin] PATH_INFO: `/v3/projects/7b9d20806ac0488e9659be7a86591f6a/users/0501fc28327f4c789632d9764d8b2c4e/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:18.432613 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731419fd-c223-4920-8071-bdb31147c07d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9d20806ac0488e9659be7a86591f6a, user_id=0501fc28327f4c789632d9764d8b2c4e, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:18.435252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731419fd-c223-4920-8071-bdb31147c07d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:18.448540 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1431/2839] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:50:18 2022] PUT /identity/v3/projects/7b9d20806ac0488e9659be7a86591f6a/users/0501fc28327f4c789632d9764d8b2c4e/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:50:18.452569 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533736de-c1f9-4b37-a23a-ae84fe6bccd1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:18.462408 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533736de-c1f9-4b37-a23a-ae84fe6bccd1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:18.517935 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4c6a6-ac21-4e6e-91ce-9b6ff7d23e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:18.518571 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4c6a6-ac21-4e6e-91ce-9b6ff7d23e7e admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:18.518886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4c6a6-ac21-4e6e-91ce-9b6ff7d23e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:18.519153 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4c6a6-ac21-4e6e-91ce-9b6ff7d23e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:18.519857 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4c6a6-ac21-4e6e-91ce-9b6ff7d23e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:18.521412 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4c6a6-ac21-4e6e-91ce-9b6ff7d23e7e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:18.531658 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1409/2840] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:50:18.535857 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731419fd-c223-4920-8071-bdb31147c07d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:18.547153 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731419fd-c223-4920-8071-bdb31147c07d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:18.551933 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff704822-e3ba-4a08-aa41-9dc991404148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:18.552839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff704822-e3ba-4a08-aa41-9dc991404148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:18.553120 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff704822-e3ba-4a08-aa41-9dc991404148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:18.553396 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff704822-e3ba-4a08-aa41-9dc991404148 admin admin] PATH_INFO: `/v3/projects/7b9d20806ac0488e9659be7a86591f6a/users/0501fc28327f4c789632d9764d8b2c4e/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:18.555429 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff704822-e3ba-4a08-aa41-9dc991404148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9d20806ac0488e9659be7a86591f6a, user_id=0501fc28327f4c789632d9764d8b2c4e, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:18.558117 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff704822-e3ba-4a08-aa41-9dc991404148 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:18.568686 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1432/2841] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:50:18 2022] PUT /identity/v3/projects/7b9d20806ac0488e9659be7a86591f6a/users/0501fc28327f4c789632d9764d8b2c4e/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:18.580080 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400a7b0-88bd-4efa-b5e3-5a7155b48e2d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:18.580362 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400a7b0-88bd-4efa-b5e3-5a7155b48e2d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:18.580632 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400a7b0-88bd-4efa-b5e3-5a7155b48e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:18.606497 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-f400a7b0-88bd-4efa-b5e3-5a7155b48e2d None None] MFA Rules not processed for user `0501fc28327f4c789632d9764d8b2c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:18.607722 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f400a7b0-88bd-4efa-b5e3-5a7155b48e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:18.650576 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:18.676770 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1410/2842] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:18 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:18.687438 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff704822-e3ba-4a08-aa41-9dc991404148 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:18.689176 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ff704822-e3ba-4a08-aa41-9dc991404148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:18.746683 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff704822-e3ba-4a08-aa41-9dc991404148 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:18.750518 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225ea67-5d29-464b-87e6-ca1732fa5693 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:18.751183 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225ea67-5d29-464b-87e6-ca1732fa5693 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:18.751462 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225ea67-5d29-464b-87e6-ca1732fa5693 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:18.751732 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225ea67-5d29-464b-87e6-ca1732fa5693 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:18.760696 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225ea67-5d29-464b-87e6-ca1732fa5693 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:18.762099 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225ea67-5d29-464b-87e6-ca1732fa5693 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:18.771606 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1433/2843] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:50:18 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:50:18.843624 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400a7b0-88bd-4efa-b5e3-5a7155b48e2d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:18.853591 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400a7b0-88bd-4efa-b5e3-5a7155b48e2d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:18.857309 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa86905-cfa8-4e6c-b245-8888ccb26ec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:18.858226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa86905-cfa8-4e6c-b245-8888ccb26ec2 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:18.858504 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa86905-cfa8-4e6c-b245-8888ccb26ec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:18.858814 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa86905-cfa8-4e6c-b245-8888ccb26ec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:18.915895 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa86905-cfa8-4e6c-b245-8888ccb26ec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:18.917342 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa86905-cfa8-4e6c-b245-8888ccb26ec2 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:18.926285 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1411/2844] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:50:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:50:22.961726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225ea67-5d29-464b-87e6-ca1732fa5693 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:23.025902 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225ea67-5d29-464b-87e6-ca1732fa5693 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:23.030458 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133602dd-131c-4abc-933a-84916f5d6f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:23.032091 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133602dd-131c-4abc-933a-84916f5d6f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:23.032371 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133602dd-131c-4abc-933a-84916f5d6f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:23.032645 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133602dd-131c-4abc-933a-84916f5d6f74 admin admin] PATH_INFO: `/v3/users/518716f1592345ec978a0b131fb4ddc5` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:23.033839 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133602dd-131c-4abc-933a-84916f5d6f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=518716f1592345ec978a0b131fb4ddc5)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:23.035804 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133602dd-131c-4abc-933a-84916f5d6f74 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:23.084866 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-133602dd-131c-4abc-933a-84916f5d6f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '518716f1592345ec978a0b131fb4ddc5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:23.091758 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-133602dd-131c-4abc-933a-84916f5d6f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '518716f1592345ec978a0b131fb4ddc5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:23.092877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:23.110411 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-133602dd-131c-4abc-933a-84916f5d6f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '518716f1592345ec978a0b131fb4ddc5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:23.117464 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-133602dd-131c-4abc-933a-84916f5d6f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '518716f1592345ec978a0b131fb4ddc5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:23.118077 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-133602dd-131c-4abc-933a-84916f5d6f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '518716f1592345ec978a0b131fb4ddc5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:23.124055 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1434/2845] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:50:22 2022] DELETE /identity/v3/users/518716f1592345ec978a0b131fb4ddc5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:23.128738 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e276eb-ca2e-47c5-ab2d-f75388cfdebc None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:23.129228 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e276eb-ca2e-47c5-ab2d-f75388cfdebc None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:23.129340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e276eb-ca2e-47c5-ab2d-f75388cfdebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:23.145597 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-77e276eb-ca2e-47c5-ab2d-f75388cfdebc None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:23.146796 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-77e276eb-ca2e-47c5-ab2d-f75388cfdebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:23.204114 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1412/2846] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:23.214259 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133602dd-131c-4abc-933a-84916f5d6f74 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:23.216074 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-133602dd-131c-4abc-933a-84916f5d6f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:23.273674 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133602dd-131c-4abc-933a-84916f5d6f74 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:23.277631 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10f09f-b4b1-46ee-8d9c-3cf0b152fb83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:23.278267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10f09f-b4b1-46ee-8d9c-3cf0b152fb83 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:23.278543 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10f09f-b4b1-46ee-8d9c-3cf0b152fb83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:23.278847 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10f09f-b4b1-46ee-8d9c-3cf0b152fb83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:23.288562 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10f09f-b4b1-46ee-8d9c-3cf0b152fb83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:23.289977 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10f09f-b4b1-46ee-8d9c-3cf0b152fb83 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:23.299905 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1435/2847] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:50:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:50:23.566349 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e276eb-ca2e-47c5-ab2d-f75388cfdebc None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:23.567831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-77e276eb-ca2e-47c5-ab2d-f75388cfdebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:23.580225 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e276eb-ca2e-47c5-ab2d-f75388cfdebc None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:23.584832 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9002a4d-2429-4a37-b92f-74076871eb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:23.585682 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9002a4d-2429-4a37-b92f-74076871eb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:23.585960 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9002a4d-2429-4a37-b92f-74076871eb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:23.586258 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9002a4d-2429-4a37-b92f-74076871eb82 admin admin] PATH_INFO: `/v3/projects/4bb6dfe75f76435994130fd8487042be` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:23.587480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9002a4d-2429-4a37-b92f-74076871eb82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb6dfe75f76435994130fd8487042be)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:23.590204 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9002a4d-2429-4a37-b92f-74076871eb82 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:23.637775 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c9002a4d-2429-4a37-b92f-74076871eb82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb6dfe75f76435994130fd8487042be', 'request_id': 'req-c9002a4d-2429-4a37-b92f-74076871eb82'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:23.643865 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c9002a4d-2429-4a37-b92f-74076871eb82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb6dfe75f76435994130fd8487042be', 'request_id': 'req-c9002a4d-2429-4a37-b92f-74076871eb82'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:23.651643 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c9002a4d-2429-4a37-b92f-74076871eb82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb6dfe75f76435994130fd8487042be', 'request_id': 'req-c9002a4d-2429-4a37-b92f-74076871eb82'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:23.663124 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c9002a4d-2429-4a37-b92f-74076871eb82 admin admin] The token cache is being invalidate because project 4bb6dfe75f76435994130fd8487042be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:50:23.663403 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c9002a4d-2429-4a37-b92f-74076871eb82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:23.664033 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c9002a4d-2429-4a37-b92f-74076871eb82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:23.665542 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1413/2848] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:50:23 2022] DELETE /identity/v3/projects/4bb6dfe75f76435994130fd8487042be => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:23.669711 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10f09f-b4b1-46ee-8d9c-3cf0b152fb83 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:23.679842 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10f09f-b4b1-46ee-8d9c-3cf0b152fb83 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:23.736588 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c270f-a1bb-4ede-8237-baa8ad22cfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:23.737454 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c270f-a1bb-4ede-8237-baa8ad22cfcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:23.737731 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c270f-a1bb-4ede-8237-baa8ad22cfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:23.738001 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c270f-a1bb-4ede-8237-baa8ad22cfcd admin admin] PATH_INFO: `/v3/users/0501fc28327f4c789632d9764d8b2c4e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:23.739202 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c270f-a1bb-4ede-8237-baa8ad22cfcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0501fc28327f4c789632d9764d8b2c4e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:23.741167 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c270f-a1bb-4ede-8237-baa8ad22cfcd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:23.788239 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-062c270f-a1bb-4ede-8237-baa8ad22cfcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0501fc28327f4c789632d9764d8b2c4e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:23.795000 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-062c270f-a1bb-4ede-8237-baa8ad22cfcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0501fc28327f4c789632d9764d8b2c4e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:23.806692 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-062c270f-a1bb-4ede-8237-baa8ad22cfcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0501fc28327f4c789632d9764d8b2c4e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:23.810185 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:23.816411 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-062c270f-a1bb-4ede-8237-baa8ad22cfcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0501fc28327f4c789632d9764d8b2c4e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:23.817516 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-062c270f-a1bb-4ede-8237-baa8ad22cfcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0501fc28327f4c789632d9764d8b2c4e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:23.824380 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1436/2849] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:50:23 2022] DELETE /identity/v3/users/0501fc28327f4c789632d9764d8b2c4e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:24.103383 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9002a4d-2429-4a37-b92f-74076871eb82 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:24.104810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c9002a4d-2429-4a37-b92f-74076871eb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:24.113635 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:24.120159 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9002a4d-2429-4a37-b92f-74076871eb82 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:24.180940 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10731913-167a-438d-a75d-cbe82a6afe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:24.181800 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10731913-167a-438d-a75d-cbe82a6afe60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:24.182082 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10731913-167a-438d-a75d-cbe82a6afe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:24.182354 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10731913-167a-438d-a75d-cbe82a6afe60 admin admin] PATH_INFO: `/v3/projects/7b9d20806ac0488e9659be7a86591f6a` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:24.183575 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10731913-167a-438d-a75d-cbe82a6afe60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9d20806ac0488e9659be7a86591f6a)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:24.185491 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10731913-167a-438d-a75d-cbe82a6afe60 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:24.230603 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-10731913-167a-438d-a75d-cbe82a6afe60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9d20806ac0488e9659be7a86591f6a', 'request_id': 'req-10731913-167a-438d-a75d-cbe82a6afe60'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:24.236599 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-10731913-167a-438d-a75d-cbe82a6afe60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9d20806ac0488e9659be7a86591f6a', 'request_id': 'req-10731913-167a-438d-a75d-cbe82a6afe60'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:24.243560 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-10731913-167a-438d-a75d-cbe82a6afe60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9d20806ac0488e9659be7a86591f6a', 'request_id': 'req-10731913-167a-438d-a75d-cbe82a6afe60'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:24.255067 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-10731913-167a-438d-a75d-cbe82a6afe60 admin admin] The token cache is being invalidate because project 7b9d20806ac0488e9659be7a86591f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:50:24.255296 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-10731913-167a-438d-a75d-cbe82a6afe60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:24.255927 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-10731913-167a-438d-a75d-cbe82a6afe60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:24.257455 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1414/2850] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:50:24 2022] DELETE /identity/v3/projects/7b9d20806ac0488e9659be7a86591f6a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:24.262504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a77107-3b7e-43f7-a154-709f6b360c4b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:24.263068 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a77107-3b7e-43f7-a154-709f6b360c4b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:24.263068 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a77107-3b7e-43f7-a154-709f6b360c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:24.281116 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e6a77107-3b7e-43f7-a154-709f6b360c4b None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:24.282356 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e6a77107-3b7e-43f7-a154-709f6b360c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:24.342040 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1437/2851] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:24.350217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61276b24-a75e-4ae9-8a29-05d7f5247203 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:24.350505 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61276b24-a75e-4ae9-8a29-05d7f5247203 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:24.350816 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61276b24-a75e-4ae9-8a29-05d7f5247203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:24.369948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-61276b24-a75e-4ae9-8a29-05d7f5247203 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:24.371391 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-61276b24-a75e-4ae9-8a29-05d7f5247203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:24.380302 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1415/2852] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:24.384538 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a77107-3b7e-43f7-a154-709f6b360c4b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:24.394617 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a77107-3b7e-43f7-a154-709f6b360c4b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:24.399267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec809c3-c58e-4db9-930f-9264f5a8c863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:24.400177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec809c3-c58e-4db9-930f-9264f5a8c863 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:24.400457 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec809c3-c58e-4db9-930f-9264f5a8c863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:24.400733 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec809c3-c58e-4db9-930f-9264f5a8c863 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:24.401450 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec809c3-c58e-4db9-930f-9264f5a8c863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:50:24.401756 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec809c3-c58e-4db9-930f-9264f5a8c863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:24.403381 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec809c3-c58e-4db9-930f-9264f5a8c863 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:24.415373 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1438/2853] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:50:24.419601 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61276b24-a75e-4ae9-8a29-05d7f5247203 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:24.429536 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61276b24-a75e-4ae9-8a29-05d7f5247203 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:24.434287 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f984ef-5e98-4988-86cc-d3e90213d109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:24.434964 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f984ef-5e98-4988-86cc-d3e90213d109 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:24.435245 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f984ef-5e98-4988-86cc-d3e90213d109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:24.435516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f984ef-5e98-4988-86cc-d3e90213d109 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:24.436193 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f984ef-5e98-4988-86cc-d3e90213d109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:24.438065 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f984ef-5e98-4988-86cc-d3e90213d109 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:24.462714 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1416/2854] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:50:24 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:50:24.466823 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec809c3-c58e-4db9-930f-9264f5a8c863 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:24.477259 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec809c3-c58e-4db9-930f-9264f5a8c863 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:24.532346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748d331-db82-4fbd-9d7c-aee4af8c2533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:24.532944 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d331-db82-4fbd-9d7c-aee4af8c2533 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:24.533221 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d331-db82-4fbd-9d7c-aee4af8c2533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:24.533490 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d331-db82-4fbd-9d7c-aee4af8c2533 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:24.534169 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748d331-db82-4fbd-9d7c-aee4af8c2533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:24.536080 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748d331-db82-4fbd-9d7c-aee4af8c2533 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:24.556299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1439/2855] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:50:24 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:50:24.560655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f984ef-5e98-4988-86cc-d3e90213d109 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:24.571189 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f984ef-5e98-4988-86cc-d3e90213d109 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:24.575859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451818c4-523d-4062-89c7-47ad2c6baa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:24.576544 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451818c4-523d-4062-89c7-47ad2c6baa63 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:24.576828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451818c4-523d-4062-89c7-47ad2c6baa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:24.577103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451818c4-523d-4062-89c7-47ad2c6baa63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:24.577999 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451818c4-523d-4062-89c7-47ad2c6baa63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:24.579754 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451818c4-523d-4062-89c7-47ad2c6baa63 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:24.590351 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1417/2856] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:50:24.595037 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748d331-db82-4fbd-9d7c-aee4af8c2533 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:24.604936 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748d331-db82-4fbd-9d7c-aee4af8c2533 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:24.610503 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07573185-c850-48af-9afc-f63c8768cd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:24.611252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07573185-c850-48af-9afc-f63c8768cd07 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:24.611545 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07573185-c850-48af-9afc-f63c8768cd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:24.611819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07573185-c850-48af-9afc-f63c8768cd07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:24.612537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07573185-c850-48af-9afc-f63c8768cd07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:24.614111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07573185-c850-48af-9afc-f63c8768cd07 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:24.623962 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1440/2857] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:50:24.627931 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451818c4-523d-4062-89c7-47ad2c6baa63 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:24.637899 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451818c4-523d-4062-89c7-47ad2c6baa63 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:24.642684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d44aee-d55f-4b5f-9228-4b47563fa1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:24.643581 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44aee-d55f-4b5f-9228-4b47563fa1d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:24.643859 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44aee-d55f-4b5f-9228-4b47563fa1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:24.644127 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44aee-d55f-4b5f-9228-4b47563fa1d2 admin admin] PATH_INFO: `/v3/projects/2c9fa23250e8422d8fa00c335fed68c5/users/f34be468989d419990d2e953b55f029a/roles/61c33763c453452d82531c56aeb67287` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:24.659331 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d44aee-d55f-4b5f-9228-4b47563fa1d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9fa23250e8422d8fa00c335fed68c5, user_id=f34be468989d419990d2e953b55f029a, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:24.661943 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d44aee-d55f-4b5f-9228-4b47563fa1d2 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:24.674996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1418/2858] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:50:24 2022] PUT /identity/v3/projects/2c9fa23250e8422d8fa00c335fed68c5/users/f34be468989d419990d2e953b55f029a/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:50:24.687394 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d9bd4-724e-47b4-9d05-2a71fcde2527 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:24.687802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d9bd4-724e-47b4-9d05-2a71fcde2527 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:24.688145 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d9bd4-724e-47b4-9d05-2a71fcde2527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:24.715888 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-462d9bd4-724e-47b4-9d05-2a71fcde2527 None None] MFA Rules not processed for user `f34be468989d419990d2e953b55f029a`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:24.717103 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-462d9bd4-724e-47b4-9d05-2a71fcde2527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:24.766440 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:24.784418 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1441/2859] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:50:24.788897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d44aee-d55f-4b5f-9228-4b47563fa1d2 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:24.819955 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:24.852365 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d44aee-d55f-4b5f-9228-4b47563fa1d2 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:24.857093 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b8aff-1f1e-40c2-83e8-d44a7206883b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:24.857751 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b8aff-1f1e-40c2-83e8-d44a7206883b admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:24.858036 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b8aff-1f1e-40c2-83e8-d44a7206883b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:24.858314 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b8aff-1f1e-40c2-83e8-d44a7206883b admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:24.859607 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b8aff-1f1e-40c2-83e8-d44a7206883b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:24.861482 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b8aff-1f1e-40c2-83e8-d44a7206883b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:24.886600 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1419/2860] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:50:24 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:50:24.890647 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d9bd4-724e-47b4-9d05-2a71fcde2527 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:24.901915 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d9bd4-724e-47b4-9d05-2a71fcde2527 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:24.960102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3ba9e-e7a0-4cf8-9208-d23ba18b3eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:24.960774 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3ba9e-e7a0-4cf8-9208-d23ba18b3eea admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:24.961055 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3ba9e-e7a0-4cf8-9208-d23ba18b3eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:24.961330 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3ba9e-e7a0-4cf8-9208-d23ba18b3eea admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:24.962023 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3ba9e-e7a0-4cf8-9208-d23ba18b3eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:24.963981 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3ba9e-e7a0-4cf8-9208-d23ba18b3eea admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:24.983123 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1442/2861] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:50:24 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:50:24.987853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b8aff-1f1e-40c2-83e8-d44a7206883b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:24.998016 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b8aff-1f1e-40c2-83e8-d44a7206883b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:25.005517 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000adddd-94a5-4b11-95b0-2f5cada22a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:25.006175 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000adddd-94a5-4b11-95b0-2f5cada22a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:25.006456 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000adddd-94a5-4b11-95b0-2f5cada22a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:25.006729 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000adddd-94a5-4b11-95b0-2f5cada22a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:25.007621 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000adddd-94a5-4b11-95b0-2f5cada22a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:25.009220 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000adddd-94a5-4b11-95b0-2f5cada22a2b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:25.020011 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1420/2862] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:50:25.024049 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3ba9e-e7a0-4cf8-9208-d23ba18b3eea admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:25.035031 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3ba9e-e7a0-4cf8-9208-d23ba18b3eea admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:25.039706 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee64b3-8c3b-4774-a547-10aea71801f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:25.040585 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee64b3-8c3b-4774-a547-10aea71801f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:25.040864 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee64b3-8c3b-4774-a547-10aea71801f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:25.041138 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee64b3-8c3b-4774-a547-10aea71801f9 admin admin] PATH_INFO: `/v3/projects/4762c287ba6b469b9c461ca88e89112e/users/0f2d3763483b455aac22474aa85f907a/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:25.056582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee64b3-8c3b-4774-a547-10aea71801f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4762c287ba6b469b9c461ca88e89112e, user_id=0f2d3763483b455aac22474aa85f907a, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:25.059262 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee64b3-8c3b-4774-a547-10aea71801f9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:25.074188 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1443/2863] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:50:25 2022] PUT /identity/v3/projects/4762c287ba6b469b9c461ca88e89112e/users/0f2d3763483b455aac22474aa85f907a/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:50:25.078102 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000adddd-94a5-4b11-95b0-2f5cada22a2b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:25.088208 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000adddd-94a5-4b11-95b0-2f5cada22a2b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:25.142981 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5075b0-4811-4f4b-947c-ae48558e1835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:25.143630 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5075b0-4811-4f4b-947c-ae48558e1835 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:25.143908 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5075b0-4811-4f4b-947c-ae48558e1835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:25.144179 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5075b0-4811-4f4b-947c-ae48558e1835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:25.144884 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5075b0-4811-4f4b-947c-ae48558e1835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:25.146444 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5075b0-4811-4f4b-947c-ae48558e1835 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:25.156756 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1421/2864] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:50:25.160949 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee64b3-8c3b-4774-a547-10aea71801f9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:25.172331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee64b3-8c3b-4774-a547-10aea71801f9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:25.176968 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa09e8-cf87-4940-bdb1-22ca5c7c59d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:25.177845 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa09e8-cf87-4940-bdb1-22ca5c7c59d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:25.178125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa09e8-cf87-4940-bdb1-22ca5c7c59d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:25.178399 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa09e8-cf87-4940-bdb1-22ca5c7c59d6 admin admin] PATH_INFO: `/v3/projects/4762c287ba6b469b9c461ca88e89112e/users/0f2d3763483b455aac22474aa85f907a/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:25.180418 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa09e8-cf87-4940-bdb1-22ca5c7c59d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4762c287ba6b469b9c461ca88e89112e, user_id=0f2d3763483b455aac22474aa85f907a, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:25.183075 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa09e8-cf87-4940-bdb1-22ca5c7c59d6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:25.193192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1444/2865] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:50:25 2022] PUT /identity/v3/projects/4762c287ba6b469b9c461ca88e89112e/users/0f2d3763483b455aac22474aa85f907a/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:25.203164 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364991de-edb1-4266-bddb-404c8d549bd2 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:25.203646 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364991de-edb1-4266-bddb-404c8d549bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:25.203760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364991de-edb1-4266-bddb-404c8d549bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:25.232210 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-364991de-edb1-4266-bddb-404c8d549bd2 None None] MFA Rules not processed for user `0f2d3763483b455aac22474aa85f907a`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:25.233402 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-364991de-edb1-4266-bddb-404c8d549bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:25.300588 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1422/2866] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:50:25.311160 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa09e8-cf87-4940-bdb1-22ca5c7c59d6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:25.313219 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-52fa09e8-cf87-4940-bdb1-22ca5c7c59d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:25.370246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa09e8-cf87-4940-bdb1-22ca5c7c59d6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:25.373884 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73778c8-0edd-4237-8912-f92e93ba5e99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:25.374594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73778c8-0edd-4237-8912-f92e93ba5e99 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:25.374869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73778c8-0edd-4237-8912-f92e93ba5e99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:25.375254 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73778c8-0edd-4237-8912-f92e93ba5e99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:25.430730 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73778c8-0edd-4237-8912-f92e93ba5e99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:25.432180 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73778c8-0edd-4237-8912-f92e93ba5e99 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:25.435699 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:25.441972 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1445/2867] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:50:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:50:27.955093 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364991de-edb1-4266-bddb-404c8d549bd2 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:27.981992 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:28.019445 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364991de-edb1-4266-bddb-404c8d549bd2 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:28.023879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec06b06-eea7-4289-a134-1b8bce3ff569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:28.024996 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec06b06-eea7-4289-a134-1b8bce3ff569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:28.025268 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec06b06-eea7-4289-a134-1b8bce3ff569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:28.025533 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec06b06-eea7-4289-a134-1b8bce3ff569 admin admin] PATH_INFO: `/v3/users/f34be468989d419990d2e953b55f029a` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:28.026705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec06b06-eea7-4289-a134-1b8bce3ff569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f34be468989d419990d2e953b55f029a)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:28.028616 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec06b06-eea7-4289-a134-1b8bce3ff569 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:28.076375 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3ec06b06-eea7-4289-a134-1b8bce3ff569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f34be468989d419990d2e953b55f029a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:28.083394 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3ec06b06-eea7-4289-a134-1b8bce3ff569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f34be468989d419990d2e953b55f029a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:28.095278 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3ec06b06-eea7-4289-a134-1b8bce3ff569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f34be468989d419990d2e953b55f029a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:28.102595 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3ec06b06-eea7-4289-a134-1b8bce3ff569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f34be468989d419990d2e953b55f029a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:28.103266 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3ec06b06-eea7-4289-a134-1b8bce3ff569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f34be468989d419990d2e953b55f029a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:28.109664 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1423/2868] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:50:27 2022] DELETE /identity/v3/users/f34be468989d419990d2e953b55f029a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:28.114318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d111af-89b3-42b0-a8f8-bebeadae43df None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:28.114826 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d111af-89b3-42b0-a8f8-bebeadae43df None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:28.114936 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d111af-89b3-42b0-a8f8-bebeadae43df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:28.132324 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c0d111af-89b3-42b0-a8f8-bebeadae43df None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:28.133529 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c0d111af-89b3-42b0-a8f8-bebeadae43df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:28.193238 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1446/2869] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:28.202986 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec06b06-eea7-4289-a134-1b8bce3ff569 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:28.204381 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3ec06b06-eea7-4289-a134-1b8bce3ff569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:28.261211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec06b06-eea7-4289-a134-1b8bce3ff569 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:28.264860 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566fa09-07eb-4303-875f-e571ba6a519b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:28.265720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566fa09-07eb-4303-875f-e571ba6a519b service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:28.266007 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566fa09-07eb-4303-875f-e571ba6a519b service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:28.266277 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566fa09-07eb-4303-875f-e571ba6a519b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:28.275657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566fa09-07eb-4303-875f-e571ba6a519b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:28.277076 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566fa09-07eb-4303-875f-e571ba6a519b service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:28.287138 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1424/2870] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:50:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:50:28.554401 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d111af-89b3-42b0-a8f8-bebeadae43df None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:28.555865 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c0d111af-89b3-42b0-a8f8-bebeadae43df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:28.569146 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d111af-89b3-42b0-a8f8-bebeadae43df None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:28.573909 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10b204-4d0d-49ff-8eb9-4b7097277c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:28.575293 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10b204-4d0d-49ff-8eb9-4b7097277c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:28.575537 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10b204-4d0d-49ff-8eb9-4b7097277c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:28.575813 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10b204-4d0d-49ff-8eb9-4b7097277c3a admin admin] PATH_INFO: `/v3/projects/2c9fa23250e8422d8fa00c335fed68c5` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:28.577133 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10b204-4d0d-49ff-8eb9-4b7097277c3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c9fa23250e8422d8fa00c335fed68c5)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:28.579746 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10b204-4d0d-49ff-8eb9-4b7097277c3a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:28.626788 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cc10b204-4d0d-49ff-8eb9-4b7097277c3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c9fa23250e8422d8fa00c335fed68c5', 'request_id': 'req-cc10b204-4d0d-49ff-8eb9-4b7097277c3a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:28.632850 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cc10b204-4d0d-49ff-8eb9-4b7097277c3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c9fa23250e8422d8fa00c335fed68c5', 'request_id': 'req-cc10b204-4d0d-49ff-8eb9-4b7097277c3a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:28.640628 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cc10b204-4d0d-49ff-8eb9-4b7097277c3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c9fa23250e8422d8fa00c335fed68c5', 'request_id': 'req-cc10b204-4d0d-49ff-8eb9-4b7097277c3a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:28.651979 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cc10b204-4d0d-49ff-8eb9-4b7097277c3a admin admin] The token cache is being invalidate because project 2c9fa23250e8422d8fa00c335fed68c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:50:28.652266 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cc10b204-4d0d-49ff-8eb9-4b7097277c3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:28.652887 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cc10b204-4d0d-49ff-8eb9-4b7097277c3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:28.654432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1447/2871] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:50:28 2022] DELETE /identity/v3/projects/2c9fa23250e8422d8fa00c335fed68c5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:28.658976 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566fa09-07eb-4303-875f-e571ba6a519b service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:28.668685 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566fa09-07eb-4303-875f-e571ba6a519b service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:28.713003 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:28.727683 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fe5eb-cb7a-43a9-996b-2fd77c1befc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:28.728551 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fe5eb-cb7a-43a9-996b-2fd77c1befc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:28.728831 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fe5eb-cb7a-43a9-996b-2fd77c1befc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:28.729103 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fe5eb-cb7a-43a9-996b-2fd77c1befc6 admin admin] PATH_INFO: `/v3/users/0f2d3763483b455aac22474aa85f907a` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:28.730284 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fe5eb-cb7a-43a9-996b-2fd77c1befc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f2d3763483b455aac22474aa85f907a)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:28.732207 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fe5eb-cb7a-43a9-996b-2fd77c1befc6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:28.777907 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-709fe5eb-cb7a-43a9-996b-2fd77c1befc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f2d3763483b455aac22474aa85f907a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:28.785731 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-709fe5eb-cb7a-43a9-996b-2fd77c1befc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f2d3763483b455aac22474aa85f907a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:28.797979 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-709fe5eb-cb7a-43a9-996b-2fd77c1befc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f2d3763483b455aac22474aa85f907a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:28.805516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-709fe5eb-cb7a-43a9-996b-2fd77c1befc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f2d3763483b455aac22474aa85f907a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:28.806173 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-709fe5eb-cb7a-43a9-996b-2fd77c1befc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f2d3763483b455aac22474aa85f907a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:28.812491 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1425/2872] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:50:28 2022] DELETE /identity/v3/users/0f2d3763483b455aac22474aa85f907a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:29.093602 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10b204-4d0d-49ff-8eb9-4b7097277c3a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:29.095231 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cc10b204-4d0d-49ff-8eb9-4b7097277c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:29.108302 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10b204-4d0d-49ff-8eb9-4b7097277c3a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:29.166659 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60257b24-2daa-44f1-b49e-5137140c2457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:29.167547 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60257b24-2daa-44f1-b49e-5137140c2457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:29.167825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60257b24-2daa-44f1-b49e-5137140c2457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:29.168094 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60257b24-2daa-44f1-b49e-5137140c2457 admin admin] PATH_INFO: `/v3/projects/4762c287ba6b469b9c461ca88e89112e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:29.169264 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60257b24-2daa-44f1-b49e-5137140c2457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4762c287ba6b469b9c461ca88e89112e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:29.171223 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60257b24-2daa-44f1-b49e-5137140c2457 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:29.197063 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:29.220709 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-60257b24-2daa-44f1-b49e-5137140c2457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4762c287ba6b469b9c461ca88e89112e', 'request_id': 'req-60257b24-2daa-44f1-b49e-5137140c2457'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:29.226415 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-60257b24-2daa-44f1-b49e-5137140c2457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4762c287ba6b469b9c461ca88e89112e', 'request_id': 'req-60257b24-2daa-44f1-b49e-5137140c2457'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:29.233162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-60257b24-2daa-44f1-b49e-5137140c2457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4762c287ba6b469b9c461ca88e89112e', 'request_id': 'req-60257b24-2daa-44f1-b49e-5137140c2457'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:29.244666 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-60257b24-2daa-44f1-b49e-5137140c2457 admin admin] The token cache is being invalidate because project 4762c287ba6b469b9c461ca88e89112e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:50:29.244950 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-60257b24-2daa-44f1-b49e-5137140c2457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:29.245630 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-60257b24-2daa-44f1-b49e-5137140c2457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:50:29.247246 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1448/2873] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:50:29 2022] DELETE /identity/v3/projects/4762c287ba6b469b9c461ca88e89112e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:29.252946 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2841e-b295-402b-8058-3c0e7c6f0269 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:29.253414 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2841e-b295-402b-8058-3c0e7c6f0269 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:29.253532 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2841e-b295-402b-8058-3c0e7c6f0269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:29.272490 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0ea2841e-b295-402b-8058-3c0e7c6f0269 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:29.273697 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0ea2841e-b295-402b-8058-3c0e7c6f0269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:29.332651 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1426/2874] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:29.340458 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6706c-0f79-4cc9-a430-df6b70b6ea1a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:29.340687 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6706c-0f79-4cc9-a430-df6b70b6ea1a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:29.340991 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6706c-0f79-4cc9-a430-df6b70b6ea1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:29.359868 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0bd6706c-0f79-4cc9-a430-df6b70b6ea1a None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:29.361098 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0bd6706c-0f79-4cc9-a430-df6b70b6ea1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:29.368984 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1449/2875] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:29.373097 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2841e-b295-402b-8058-3c0e7c6f0269 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:29.383689 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2841e-b295-402b-8058-3c0e7c6f0269 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:29.388312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b4dcf-6d13-415c-8ec4-ff9f25ae75e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:29.388957 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b4dcf-6d13-415c-8ec4-ff9f25ae75e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:29.389237 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b4dcf-6d13-415c-8ec4-ff9f25ae75e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:29.389512 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b4dcf-6d13-415c-8ec4-ff9f25ae75e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:29.390797 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b4dcf-6d13-415c-8ec4-ff9f25ae75e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:50:29.391106 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b4dcf-6d13-415c-8ec4-ff9f25ae75e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:29.392684 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b4dcf-6d13-415c-8ec4-ff9f25ae75e1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:29.404526 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1427/2876] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:50:29.409161 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6706c-0f79-4cc9-a430-df6b70b6ea1a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:29.418271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6706c-0f79-4cc9-a430-df6b70b6ea1a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:29.423649 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347f65d-e27d-44ac-a5bd-26dfed8d8dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:29.424287 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347f65d-e27d-44ac-a5bd-26dfed8d8dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:29.424563 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347f65d-e27d-44ac-a5bd-26dfed8d8dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:29.424833 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347f65d-e27d-44ac-a5bd-26dfed8d8dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:29.425511 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347f65d-e27d-44ac-a5bd-26dfed8d8dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:29.427425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347f65d-e27d-44ac-a5bd-26dfed8d8dc6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:29.452379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1450/2877] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:50:29 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:50:29.456755 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b4dcf-6d13-415c-8ec4-ff9f25ae75e1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:29.466776 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b4dcf-6d13-415c-8ec4-ff9f25ae75e1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:29.514706 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:29.525820 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95742d35-600d-4fd9-8243-df244da3d54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:29.526481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95742d35-600d-4fd9-8243-df244da3d54e admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:29.526790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95742d35-600d-4fd9-8243-df244da3d54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:29.527069 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95742d35-600d-4fd9-8243-df244da3d54e admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:29.527760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95742d35-600d-4fd9-8243-df244da3d54e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:29.529650 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95742d35-600d-4fd9-8243-df244da3d54e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:29.550180 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1428/2878] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:50:29 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:50:29.554670 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347f65d-e27d-44ac-a5bd-26dfed8d8dc6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:29.565821 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347f65d-e27d-44ac-a5bd-26dfed8d8dc6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:29.570421 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fab3f-f1b6-4d40-8b5f-95cbc8dad3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:29.571111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fab3f-f1b6-4d40-8b5f-95cbc8dad3ad admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:29.571389 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fab3f-f1b6-4d40-8b5f-95cbc8dad3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:29.571658 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fab3f-f1b6-4d40-8b5f-95cbc8dad3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:29.572387 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fab3f-f1b6-4d40-8b5f-95cbc8dad3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:29.573932 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fab3f-f1b6-4d40-8b5f-95cbc8dad3ad admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:29.584191 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1451/2879] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:50:29.588184 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95742d35-600d-4fd9-8243-df244da3d54e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:29.598149 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95742d35-600d-4fd9-8243-df244da3d54e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:29.602710 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b2dc1-8931-4c59-b85d-6ef0632b5042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:29.603463 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2dc1-8931-4c59-b85d-6ef0632b5042 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:29.603742 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2dc1-8931-4c59-b85d-6ef0632b5042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:29.604017 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2dc1-8931-4c59-b85d-6ef0632b5042 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:29.604736 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b2dc1-8931-4c59-b85d-6ef0632b5042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:29.606307 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b2dc1-8931-4c59-b85d-6ef0632b5042 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:29.617364 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1429/2880] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:50:29.621220 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fab3f-f1b6-4d40-8b5f-95cbc8dad3ad admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:29.631869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fab3f-f1b6-4d40-8b5f-95cbc8dad3ad admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:29.638130 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042f85f-848f-4df6-837c-93c8a1b78482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:29.639037 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042f85f-848f-4df6-837c-93c8a1b78482 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:29.639318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042f85f-848f-4df6-837c-93c8a1b78482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:29.639594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042f85f-848f-4df6-837c-93c8a1b78482 admin admin] PATH_INFO: `/v3/projects/500ae9a048e644d584f93b49f1db3688/users/aea4780da2004d748e5f27287ee3960e/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:29.654953 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042f85f-848f-4df6-837c-93c8a1b78482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=500ae9a048e644d584f93b49f1db3688, user_id=aea4780da2004d748e5f27287ee3960e, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:29.658380 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042f85f-848f-4df6-837c-93c8a1b78482 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:29.671143 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1452/2881] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:50:29 2022] PUT /identity/v3/projects/500ae9a048e644d584f93b49f1db3688/users/aea4780da2004d748e5f27287ee3960e/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:50:29.676191 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b1017-fc2f-46e7-ae00-b23598b24cee None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:29.676481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b1017-fc2f-46e7-ae00-b23598b24cee None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:29.676760 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b1017-fc2f-46e7-ae00-b23598b24cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:29.694461 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-770b1017-fc2f-46e7-ae00-b23598b24cee None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:29.695720 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-770b1017-fc2f-46e7-ae00-b23598b24cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:29.755101 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1430/2882] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:29.764768 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042f85f-848f-4df6-837c-93c8a1b78482 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:29.767187 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6042f85f-848f-4df6-837c-93c8a1b78482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:29.824255 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042f85f-848f-4df6-837c-93c8a1b78482 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:29.828877 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d58afd-4105-4caa-a998-e9eecf70e773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:29.829552 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d58afd-4105-4caa-a998-e9eecf70e773 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:29.829831 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d58afd-4105-4caa-a998-e9eecf70e773 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:29.830102 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d58afd-4105-4caa-a998-e9eecf70e773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:29.839285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d58afd-4105-4caa-a998-e9eecf70e773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:29.840701 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d58afd-4105-4caa-a998-e9eecf70e773 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:29.851201 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1453/2883] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:50:30.450924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e66aeb-3b9a-4f1e-8841-cdd92c71b46e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:30.451432 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e66aeb-3b9a-4f1e-8841-cdd92c71b46e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:30.451531 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e66aeb-3b9a-4f1e-8841-cdd92c71b46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:30.480387 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-70e66aeb-3b9a-4f1e-8841-cdd92c71b46e None None] MFA Rules not processed for user `aea4780da2004d748e5f27287ee3960e`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:30.481687 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-70e66aeb-3b9a-4f1e-8841-cdd92c71b46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:30.547929 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1431/2884] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:30.559474 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d58afd-4105-4caa-a998-e9eecf70e773 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:30.560923 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-50d58afd-4105-4caa-a998-e9eecf70e773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:30.620802 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d58afd-4105-4caa-a998-e9eecf70e773 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:30.625633 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e931a5-6e52-4a24-bcc4-e2b0170d141f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '726c2035855c444b88ec07a7811ea711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:30.626225 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e931a5-6e52-4a24-bcc4-e2b0170d141f service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:30.626502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e931a5-6e52-4a24-bcc4-e2b0170d141f service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:30.626827 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e931a5-6e52-4a24-bcc4-e2b0170d141f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:30.632183 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:30.637040 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e931a5-6e52-4a24-bcc4-e2b0170d141f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:30.639317 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e931a5-6e52-4a24-bcc4-e2b0170d141f service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:30.649399 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1454/2885] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:50:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:50:31.994886 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0b5f3-ab57-4903-9ab4-fedafb4af9cc None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:31.995393 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0b5f3-ab57-4903-9ab4-fedafb4af9cc None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:31.995509 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0b5f3-ab57-4903-9ab4-fedafb4af9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:32.013588 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9bc0b5f3-ab57-4903-9ab4-fedafb4af9cc None None] MFA Rules not processed for user `aea4780da2004d748e5f27287ee3960e`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:32.014810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9bc0b5f3-ab57-4903-9ab4-fedafb4af9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:32.022370 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1432/2886] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:32.272948 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e931a5-6e52-4a24-bcc4-e2b0170d141f service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:32.282991 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e931a5-6e52-4a24-bcc4-e2b0170d141f service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:32.288140 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c58614-c47d-41cd-96c0-ce815bb7fa25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:32.289234 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c58614-c47d-41cd-96c0-ce815bb7fa25 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:32.289784 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c58614-c47d-41cd-96c0-ce815bb7fa25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:32.290275 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c58614-c47d-41cd-96c0-ce815bb7fa25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:32.292197 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-71c58614-c47d-41cd-96c0-ce815bb7fa25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:32.304623 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c58614-c47d-41cd-96c0-ce815bb7fa25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:32.306132 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c58614-c47d-41cd-96c0-ce815bb7fa25 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:32.315349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1455/2887] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:50:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:50:42.007845 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:42.310902 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=9 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:46.213565 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3876-6e05-4736-8154-1a6b81dea10f None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:46.214027 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3876-6e05-4736-8154-1a6b81dea10f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:46.214136 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3876-6e05-4736-8154-1a6b81dea10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:46.231819 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7fab3876-6e05-4736-8154-1a6b81dea10f None None] MFA Rules not processed for user `aea4780da2004d748e5f27287ee3960e`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:50:46.232998 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7fab3876-6e05-4736-8154-1a6b81dea10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:46.240830 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1433/2888] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:50:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:50:56.226759 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:51:02.808142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd0f2e-f999-46b8-9214-340b37756f3e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:02.808672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd0f2e-f999-46b8-9214-340b37756f3e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:02.808672 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd0f2e-f999-46b8-9214-340b37756f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:02.839162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f1dd0f2e-f999-46b8-9214-340b37756f3e None None] MFA Rules not processed for user `18030043de1942779baf3ad94aec4071`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:51:02.840354 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f1dd0f2e-f999-46b8-9214-340b37756f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:51:02.896125 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1456/2889] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Jul 19 12:51:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:51:02.942938 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab3876-6e05-4736-8154-1a6b81dea10f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:02.945050 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7fab3876-6e05-4736-8154-1a6b81dea10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:51:03.014655 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab3876-6e05-4736-8154-1a6b81dea10f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:03.020278 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b5206-504b-4e11-95e6-977e1f874f68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc2e1079d34745a279588028945c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:03.020948 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b5206-504b-4e11-95e6-977e1f874f68 service swift] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:03.021226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b5206-504b-4e11-95e6-977e1f874f68 service swift] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:03.021496 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b5206-504b-4e11-95e6-977e1f874f68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:03.029803 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b5206-504b-4e11-95e6-977e1f874f68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:03.031401 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b5206-504b-4e11-95e6-977e1f874f68 service swift] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:03.040032 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1434/2890] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 19 12:51:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:51:12.889215 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=29 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:51:13.037000 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=32 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:51:17.529861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3176e1-bce4-460f-890e-013fd447810f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:17.530295 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3176e1-bce4-460f-890e-013fd447810f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:17.530432 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3176e1-bce4-460f-890e-013fd447810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:17.548824 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cd3176e1-bce4-460f-890e-013fd447810f None None] MFA Rules not processed for user `18030043de1942779baf3ad94aec4071`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:51:17.550284 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cd3176e1-bce4-460f-890e-013fd447810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:51:17.557753 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1457/2891] 10.222.0.25 () {58 vars in 967 bytes} [Tue Jul 19 12:51:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:51:17.570298 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b5206-504b-4e11-95e6-977e1f874f68 service swift] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:17.581147 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b5206-504b-4e11-95e6-977e1f874f68 service swift] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:17.586149 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f1edb-87eb-4a91-b29c-65d2b165abbc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35cc2e1079d34745a279588028945c3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:17.586810 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f1edb-87eb-4a91-b29c-65d2b165abbc service swift] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:17.587093 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f1edb-87eb-4a91-b29c-65d2b165abbc service swift] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:17.587391 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f1edb-87eb-4a91-b29c-65d2b165abbc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:17.596001 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f1edb-87eb-4a91-b29c-65d2b165abbc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:17.597558 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f1edb-87eb-4a91-b29c-65d2b165abbc service swift] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:17.605847 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1435/2892] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Jul 19 12:51:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:51:19.458348 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3176e1-bce4-460f-890e-013fd447810f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:19.459815 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cd3176e1-bce4-460f-890e-013fd447810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:51:19.511015 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f1edb-87eb-4a91-b29c-65d2b165abbc service swift] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:19.527382 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f1edb-87eb-4a91-b29c-65d2b165abbc service swift] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:19.531932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e56f6c-9c6e-4217-a425-bc2368ecc7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:19.533491 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e56f6c-9c6e-4217-a425-bc2368ecc7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:19.533889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e56f6c-9c6e-4217-a425-bc2368ecc7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:19.534168 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e56f6c-9c6e-4217-a425-bc2368ecc7c3 admin admin] PATH_INFO: `/v3/users/aea4780da2004d748e5f27287ee3960e` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:19.535403 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e56f6c-9c6e-4217-a425-bc2368ecc7c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea4780da2004d748e5f27287ee3960e)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:19.537185 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3176e1-bce4-460f-890e-013fd447810f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:19.537316 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e56f6c-9c6e-4217-a425-bc2368ecc7c3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:19.542271 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d84ced-bbe7-4cad-baf9-c39863bd21ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:19.542945 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d84ced-bbe7-4cad-baf9-c39863bd21ec service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:19.543223 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d84ced-bbe7-4cad-baf9-c39863bd21ec service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:19.543502 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d84ced-bbe7-4cad-baf9-c39863bd21ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:19.545234 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d7d84ced-bbe7-4cad-baf9-c39863bd21ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:51:19.557978 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d84ced-bbe7-4cad-baf9-c39863bd21ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:19.559577 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d84ced-bbe7-4cad-baf9-c39863bd21ec service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:19.570825 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1458/2893] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:51:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:51:19.585336 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-09e56f6c-9c6e-4217-a425-bc2368ecc7c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea4780da2004d748e5f27287ee3960e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:51:19.592480 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-09e56f6c-9c6e-4217-a425-bc2368ecc7c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea4780da2004d748e5f27287ee3960e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:51:19.605370 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-09e56f6c-9c6e-4217-a425-bc2368ecc7c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea4780da2004d748e5f27287ee3960e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:51:19.613098 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-09e56f6c-9c6e-4217-a425-bc2368ecc7c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea4780da2004d748e5f27287ee3960e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:51:19.613820 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-09e56f6c-9c6e-4217-a425-bc2368ecc7c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea4780da2004d748e5f27287ee3960e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:51:19.619879 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1436/2894] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:51:19 2022] DELETE /identity/v3/users/aea4780da2004d748e5f27287ee3960e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:51:19.803111 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d84ced-bbe7-4cad-baf9-c39863bd21ec service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:19.814450 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d84ced-bbe7-4cad-baf9-c39863bd21ec service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:19.873064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7939247-e4dc-4b6e-b411-e9a0c0907bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:19.873924 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7939247-e4dc-4b6e-b411-e9a0c0907bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:19.874208 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7939247-e4dc-4b6e-b411-e9a0c0907bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:19.874483 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7939247-e4dc-4b6e-b411-e9a0c0907bde admin admin] PATH_INFO: `/v3/projects/500ae9a048e644d584f93b49f1db3688` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:19.875700 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7939247-e4dc-4b6e-b411-e9a0c0907bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=500ae9a048e644d584f93b49f1db3688)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:19.878106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7939247-e4dc-4b6e-b411-e9a0c0907bde admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:19.924318 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e7939247-e4dc-4b6e-b411-e9a0c0907bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '500ae9a048e644d584f93b49f1db3688', 'request_id': 'req-e7939247-e4dc-4b6e-b411-e9a0c0907bde'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:51:19.930014 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e7939247-e4dc-4b6e-b411-e9a0c0907bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '500ae9a048e644d584f93b49f1db3688', 'request_id': 'req-e7939247-e4dc-4b6e-b411-e9a0c0907bde'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:51:19.937074 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e7939247-e4dc-4b6e-b411-e9a0c0907bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '500ae9a048e644d584f93b49f1db3688', 'request_id': 'req-e7939247-e4dc-4b6e-b411-e9a0c0907bde'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:51:19.948850 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e7939247-e4dc-4b6e-b411-e9a0c0907bde admin admin] The token cache is being invalidate because project 500ae9a048e644d584f93b49f1db3688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:51:19.949136 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e7939247-e4dc-4b6e-b411-e9a0c0907bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:51:19.949760 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e7939247-e4dc-4b6e-b411-e9a0c0907bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:51:19.951319 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1459/2895] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:51:19 2022] DELETE /identity/v3/projects/500ae9a048e644d584f93b49f1db3688 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:51:19.956838 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd77363-04c1-49a9-a194-4cdf5f94e693 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:19.957124 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd77363-04c1-49a9-a194-4cdf5f94e693 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:19.957396 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd77363-04c1-49a9-a194-4cdf5f94e693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:19.975693 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9dd77363-04c1-49a9-a194-4cdf5f94e693 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:51:19.976909 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9dd77363-04c1-49a9-a194-4cdf5f94e693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:51:20.036377 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1437/2896] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:51:20.044249 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a137bc-06b9-4b60-af55-c9139410af69 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:20.044536 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a137bc-06b9-4b60-af55-c9139410af69 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:20.044814 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a137bc-06b9-4b60-af55-c9139410af69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:20.065093 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e7a137bc-06b9-4b60-af55-c9139410af69 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:51:20.066209 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e7a137bc-06b9-4b60-af55-c9139410af69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:51:20.074082 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1460/2897] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:51:20.078211 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd77363-04c1-49a9-a194-4cdf5f94e693 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:20.088640 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd77363-04c1-49a9-a194-4cdf5f94e693 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:20.093270 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b1c3e-3540-41c9-9b14-4cc9e61effc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:20.093920 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b1c3e-3540-41c9-9b14-4cc9e61effc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:20.094201 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b1c3e-3540-41c9-9b14-4cc9e61effc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:20.094476 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b1c3e-3540-41c9-9b14-4cc9e61effc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:20.095471 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b1c3e-3540-41c9-9b14-4cc9e61effc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:51:20.095777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b1c3e-3540-41c9-9b14-4cc9e61effc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:20.097343 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b1c3e-3540-41c9-9b14-4cc9e61effc0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:20.108709 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1438/2898] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Jul 19 12:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:51:20.113275 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a137bc-06b9-4b60-af55-c9139410af69 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:20.122504 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a137bc-06b9-4b60-af55-c9139410af69 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:20.127726 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea5be5-0616-4724-bdf9-400b9f2584cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:20.128367 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea5be5-0616-4724-bdf9-400b9f2584cc admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:20.128645 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea5be5-0616-4724-bdf9-400b9f2584cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:20.128911 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea5be5-0616-4724-bdf9-400b9f2584cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:20.129592 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea5be5-0616-4724-bdf9-400b9f2584cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:20.131500 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea5be5-0616-4724-bdf9-400b9f2584cc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:20.134655 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:51:20.162904 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1461/2899] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:51:20 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:51:20.164325 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b1c3e-3540-41c9-9b14-4cc9e61effc0 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:20.174308 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b1c3e-3540-41c9-9b14-4cc9e61effc0 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:20.217301 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:51:20.231481 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf7e5-3763-49f8-a64f-17617b333896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:20.232147 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf7e5-3763-49f8-a64f-17617b333896 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:20.232430 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf7e5-3763-49f8-a64f-17617b333896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:20.232705 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf7e5-3763-49f8-a64f-17617b333896 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:20.233395 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbf7e5-3763-49f8-a64f-17617b333896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:20.235872 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbf7e5-3763-49f8-a64f-17617b333896 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:20.255653 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1439/2900] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:51:20 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:51:20.259799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea5be5-0616-4724-bdf9-400b9f2584cc admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:20.270402 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea5be5-0616-4724-bdf9-400b9f2584cc admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:20.275269 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538ac8f-57ab-4b77-a437-a02fcf55e96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:20.275917 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538ac8f-57ab-4b77-a437-a02fcf55e96b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:20.276197 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538ac8f-57ab-4b77-a437-a02fcf55e96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:20.276470 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538ac8f-57ab-4b77-a437-a02fcf55e96b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:20.277177 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538ac8f-57ab-4b77-a437-a02fcf55e96b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:20.278781 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538ac8f-57ab-4b77-a437-a02fcf55e96b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:20.289425 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1462/2901] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:51:20.293246 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf7e5-3763-49f8-a64f-17617b333896 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:20.303486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf7e5-3763-49f8-a64f-17617b333896 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:20.308081 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6a643-fcb0-4130-a300-51bd6fe73964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:20.308893 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6a643-fcb0-4130-a300-51bd6fe73964 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:20.309264 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6a643-fcb0-4130-a300-51bd6fe73964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:20.309657 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6a643-fcb0-4130-a300-51bd6fe73964 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:20.310486 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6a643-fcb0-4130-a300-51bd6fe73964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:20.312335 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6a643-fcb0-4130-a300-51bd6fe73964 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:20.322983 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1440/2902] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:51:20.326872 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538ac8f-57ab-4b77-a437-a02fcf55e96b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:20.337286 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538ac8f-57ab-4b77-a437-a02fcf55e96b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:20.341862 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468f866-cb9a-4730-9af2-21108bc5454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:20.342724 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468f866-cb9a-4730-9af2-21108bc5454e admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:20.343028 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468f866-cb9a-4730-9af2-21108bc5454e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:20.343300 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468f866-cb9a-4730-9af2-21108bc5454e admin admin] PATH_INFO: `/v3/projects/12166449feab4559960ea2ab1fc86510/users/e42ffaa86c894f05a8f1fe7b7ba4cfcd/roles/61c33763c453452d82531c56aeb67287` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:20.357697 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468f866-cb9a-4730-9af2-21108bc5454e admin admin] RBAC: Authorizing `identity:create_grant(project_id=12166449feab4559960ea2ab1fc86510, user_id=e42ffaa86c894f05a8f1fe7b7ba4cfcd, role_id=61c33763c453452d82531c56aeb67287)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:20.360885 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468f866-cb9a-4730-9af2-21108bc5454e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:20.373960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1463/2903] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:51:20 2022] PUT /identity/v3/projects/12166449feab4559960ea2ab1fc86510/users/e42ffaa86c894f05a8f1fe7b7ba4cfcd/roles/61c33763c453452d82531c56aeb67287 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:51:20.380075 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd246045-0112-4c33-872d-fad62bf256d7 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:20.380390 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd246045-0112-4c33-872d-fad62bf256d7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:20.380668 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd246045-0112-4c33-872d-fad62bf256d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:20.398839 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-fd246045-0112-4c33-872d-fad62bf256d7 None None] MFA Rules not processed for user `f6b1bae44b87419cac105e8b3296eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:51:20.400280 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fd246045-0112-4c33-872d-fad62bf256d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:51:20.458223 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1441/2904] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:51:20.467799 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468f866-cb9a-4730-9af2-21108bc5454e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:20.469625 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d468f866-cb9a-4730-9af2-21108bc5454e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:51:20.527452 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468f866-cb9a-4730-9af2-21108bc5454e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:20.531112 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c147cc1-5882-47d5-becc-424a2f4c4924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:20.531748 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c147cc1-5882-47d5-becc-424a2f4c4924 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:20.532029 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c147cc1-5882-47d5-becc-424a2f4c4924 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:20.532888 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c147cc1-5882-47d5-becc-424a2f4c4924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:20.541921 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c147cc1-5882-47d5-becc-424a2f4c4924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:20.543384 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c147cc1-5882-47d5-becc-424a2f4c4924 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:20.553142 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1464/2905] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:51:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:51:24.624048 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc96e5-6d5b-49fb-b90b-ae0f2f5b6cd2 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:24.624547 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc96e5-6d5b-49fb-b90b-ae0f2f5b6cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:24.624673 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc96e5-6d5b-49fb-b90b-ae0f2f5b6cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:24.662169 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-38dc96e5-6d5b-49fb-b90b-ae0f2f5b6cd2 None None] MFA Rules not processed for user `e42ffaa86c894f05a8f1fe7b7ba4cfcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:51:24.663443 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-38dc96e5-6d5b-49fb-b90b-ae0f2f5b6cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:51:24.742574 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1442/2906] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:51:24.747285 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c147cc1-5882-47d5-becc-424a2f4c4924 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:24.757648 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c147cc1-5882-47d5-becc-424a2f4c4924 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:24.762420 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae2c66-3884-4cba-b970-92fcaf1cde55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:24.763121 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae2c66-3884-4cba-b970-92fcaf1cde55 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:24.763401 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae2c66-3884-4cba-b970-92fcaf1cde55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:24.763673 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae2c66-3884-4cba-b970-92fcaf1cde55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:24.764365 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae2c66-3884-4cba-b970-92fcaf1cde55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:24.766304 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae2c66-3884-4cba-b970-92fcaf1cde55 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:24.796846 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1465/2907] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Jul 19 12:51:24 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:51:24.801341 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc96e5-6d5b-49fb-b90b-ae0f2f5b6cd2 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:24.812530 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc96e5-6d5b-49fb-b90b-ae0f2f5b6cd2 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:24.870160 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:51:24.879251 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476e363-0441-4c3b-8638-e139eb73c0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:24.879932 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476e363-0441-4c3b-8638-e139eb73c0ac admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:24.880218 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476e363-0441-4c3b-8638-e139eb73c0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:24.880495 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476e363-0441-4c3b-8638-e139eb73c0ac admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:24.881182 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476e363-0441-4c3b-8638-e139eb73c0ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:24.883117 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476e363-0441-4c3b-8638-e139eb73c0ac admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:24.909852 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1443/2908] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Jul 19 12:51:24 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:51:24.911162 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae2c66-3884-4cba-b970-92fcaf1cde55 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:24.921958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae2c66-3884-4cba-b970-92fcaf1cde55 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:24.927847 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ef566-bbe1-47e6-bd01-a0a57b08410c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:24.928511 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ef566-bbe1-47e6-bd01-a0a57b08410c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:24.928789 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ef566-bbe1-47e6-bd01-a0a57b08410c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:24.929057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ef566-bbe1-47e6-bd01-a0a57b08410c admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:24.929773 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ef566-bbe1-47e6-bd01-a0a57b08410c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:24.931513 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ef566-bbe1-47e6-bd01-a0a57b08410c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:24.943263 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1466/2909] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:51:24.947475 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476e363-0441-4c3b-8638-e139eb73c0ac admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:24.958057 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476e363-0441-4c3b-8638-e139eb73c0ac admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:24.962830 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89a7f1-2530-466c-88d3-0499529af8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:24.963701 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89a7f1-2530-466c-88d3-0499529af8c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:24.964093 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89a7f1-2530-466c-88d3-0499529af8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:24.964368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89a7f1-2530-466c-88d3-0499529af8c5 admin admin] PATH_INFO: `/v3/projects/aadc41f0658349948677fabf7223075a/users/01939a9f5b3048e2a0e5b187fe8725ce/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:24.979924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89a7f1-2530-466c-88d3-0499529af8c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aadc41f0658349948677fabf7223075a, user_id=01939a9f5b3048e2a0e5b187fe8725ce, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:24.982557 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89a7f1-2530-466c-88d3-0499529af8c5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:24.995312 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1444/2910] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:51:24 2022] PUT /identity/v3/projects/aadc41f0658349948677fabf7223075a/users/01939a9f5b3048e2a0e5b187fe8725ce/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:51:24.999351 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ef566-bbe1-47e6-bd01-a0a57b08410c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:25.009299 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ef566-bbe1-47e6-bd01-a0a57b08410c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:25.065830 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905670f-745b-46b9-b44d-040cb69c527b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:25.066422 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905670f-745b-46b9-b44d-040cb69c527b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:25.066693 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905670f-745b-46b9-b44d-040cb69c527b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:25.066996 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905670f-745b-46b9-b44d-040cb69c527b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:25.067706 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905670f-745b-46b9-b44d-040cb69c527b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:25.069279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905670f-745b-46b9-b44d-040cb69c527b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:25.078826 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1467/2911] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Jul 19 12:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:51:25.083658 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89a7f1-2530-466c-88d3-0499529af8c5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:25.093931 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89a7f1-2530-466c-88d3-0499529af8c5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:25.099311 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7880e24-e285-4611-9090-1cf28d5f953a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:25.100176 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7880e24-e285-4611-9090-1cf28d5f953a admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:25.100451 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7880e24-e285-4611-9090-1cf28d5f953a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:25.100723 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7880e24-e285-4611-9090-1cf28d5f953a admin admin] PATH_INFO: `/v3/projects/aadc41f0658349948677fabf7223075a/users/01939a9f5b3048e2a0e5b187fe8725ce/roles/386cb814e8464fda8832b13c75eabdaf` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:25.102690 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7880e24-e285-4611-9090-1cf28d5f953a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aadc41f0658349948677fabf7223075a, user_id=01939a9f5b3048e2a0e5b187fe8725ce, role_id=386cb814e8464fda8832b13c75eabdaf)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:25.105368 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7880e24-e285-4611-9090-1cf28d5f953a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:25.115905 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1445/2912] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Jul 19 12:51:25 2022] PUT /identity/v3/projects/aadc41f0658349948677fabf7223075a/users/01939a9f5b3048e2a0e5b187fe8725ce/roles/386cb814e8464fda8832b13c75eabdaf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:51:29.309879 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62109b79-c52d-44ab-b44e-7e2c834e3a49 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:29.310409 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62109b79-c52d-44ab-b44e-7e2c834e3a49 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:29.310409 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62109b79-c52d-44ab-b44e-7e2c834e3a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:29.395208 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-62109b79-c52d-44ab-b44e-7e2c834e3a49 None None] MFA Rules not processed for user `01939a9f5b3048e2a0e5b187fe8725ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:51:29.397135 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-62109b79-c52d-44ab-b44e-7e2c834e3a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:51:29.412582 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:51:29.560785 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1468/2913] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:51:29.576964 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7880e24-e285-4611-9090-1cf28d5f953a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:29.585152 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f7880e24-e285-4611-9090-1cf28d5f953a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:51:29.681322 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7880e24-e285-4611-9090-1cf28d5f953a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:29.693502 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154b549-b5eb-4083-be60-f65464062816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:29.694184 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154b549-b5eb-4083-be60-f65464062816 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:29.694464 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154b549-b5eb-4083-be60-f65464062816 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:29.694752 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154b549-b5eb-4083-be60-f65464062816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:29.765384 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154b549-b5eb-4083-be60-f65464062816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:29.767345 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154b549-b5eb-4083-be60-f65464062816 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:29.777651 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1446/2914] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:51:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:51:30.796663 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52635d-219c-4809-ad86-dc4b717fd9ad None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:30.797166 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52635d-219c-4809-ad86-dc4b717fd9ad None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:30.797277 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52635d-219c-4809-ad86-dc4b717fd9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:30.816004 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cf52635d-219c-4809-ad86-dc4b717fd9ad None None] MFA Rules not processed for user `e42ffaa86c894f05a8f1fe7b7ba4cfcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:51:30.817207 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cf52635d-219c-4809-ad86-dc4b717fd9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:51:30.824505 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1469/2915] 10.222.0.25 () {58 vars in 957 bytes} [Tue Jul 19 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:51:39.773124 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=75,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:51:40.809982 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=30 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:51:47.778271 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154b549-b5eb-4083-be60-f65464062816 service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:47.834629 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154b549-b5eb-4083-be60-f65464062816 service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:47.838223 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76448d56-2c79-42d5-b723-c1897cc24983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:47.838897 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76448d56-2c79-42d5-b723-c1897cc24983 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:47.839192 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76448d56-2c79-42d5-b723-c1897cc24983 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:47.839457 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76448d56-2c79-42d5-b723-c1897cc24983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:47.841257 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-76448d56-2c79-42d5-b723-c1897cc24983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:51:47.854930 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76448d56-2c79-42d5-b723-c1897cc24983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:47.856346 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76448d56-2c79-42d5-b723-c1897cc24983 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:47.868350 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1447/2916] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:51:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:51:57.850137 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52635d-219c-4809-ad86-dc4b717fd9ad None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:51:57.851661 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cf52635d-219c-4809-ad86-dc4b717fd9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:51:57.863022 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=26 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:51:57.864022 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52635d-219c-4809-ad86-dc4b717fd9ad None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:51:57.868017 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf47aa-6f97-44ec-bddb-4bad259a6ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:51:57.868664 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf47aa-6f97-44ec-bddb-4bad259a6ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:51:57.868951 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf47aa-6f97-44ec-bddb-4bad259a6ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:51:57.869224 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf47aa-6f97-44ec-bddb-4bad259a6ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:51:57.879034 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf47aa-6f97-44ec-bddb-4bad259a6ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:51:57.880469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf47aa-6f97-44ec-bddb-4bad259a6ab7 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:51:57.890000 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1470/2917] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:51:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:52:07.885717 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:52:36.636392 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76448d56-2c79-42d5-b723-c1897cc24983 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:52:36.646868 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76448d56-2c79-42d5-b723-c1897cc24983 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:52:36.650865 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fe131-2b79-47bf-a2ef-811dae742c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:52:36.651505 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fe131-2b79-47bf-a2ef-811dae742c41 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:52:36.651789 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fe131-2b79-47bf-a2ef-811dae742c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:52:36.652062 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fe131-2b79-47bf-a2ef-811dae742c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:52:36.653853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fe1fe131-2b79-47bf-a2ef-811dae742c41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:52:36.664009 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fe131-2b79-47bf-a2ef-811dae742c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:52:36.665419 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fe131-2b79-47bf-a2ef-811dae742c41 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:52:36.673409 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1448/2918] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:52:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:52:46.669759 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=6 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:54:23.732186 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf47aa-6f97-44ec-bddb-4bad259a6ab7 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:54:23.740752 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf47aa-6f97-44ec-bddb-4bad259a6ab7 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:54:23.744331 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9b587-58a5-4532-8741-f0aac1fa4f23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:54:23.744957 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9b587-58a5-4532-8741-f0aac1fa4f23 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:54:23.745252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9b587-58a5-4532-8741-f0aac1fa4f23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:54:23.745519 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9b587-58a5-4532-8741-f0aac1fa4f23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:54:23.747290 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-14d9b587-58a5-4532-8741-f0aac1fa4f23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:54:23.761279 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9b587-58a5-4532-8741-f0aac1fa4f23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:54:23.762680 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9b587-58a5-4532-8741-f0aac1fa4f23 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:54:23.774527 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1471/2919] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:54:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:54:33.768898 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:54:34.391226 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fe131-2b79-47bf-a2ef-811dae742c41 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:54:34.392570 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fe1fe131-2b79-47bf-a2ef-811dae742c41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:54:34.466967 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fe131-2b79-47bf-a2ef-811dae742c41 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:54:34.472566 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575c4d9-6737-4548-9e73-50219d7eea0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:54:34.473217 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575c4d9-6737-4548-9e73-50219d7eea0e service placement] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:54:34.473523 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575c4d9-6737-4548-9e73-50219d7eea0e service placement] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:54:34.473781 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575c4d9-6737-4548-9e73-50219d7eea0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:54:34.476315 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3575c4d9-6737-4548-9e73-50219d7eea0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:54:34.488929 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575c4d9-6737-4548-9e73-50219d7eea0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:54:34.491145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575c4d9-6737-4548-9e73-50219d7eea0e service placement] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:54:34.501535 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1449/2920] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:54:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:54:35.605559 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9b587-58a5-4532-8741-f0aac1fa4f23 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:54:35.614157 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9b587-58a5-4532-8741-f0aac1fa4f23 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:54:35.618346 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e4e16-2f48-4bc3-b6da-95d89d48fb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:54:35.619023 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e4e16-2f48-4bc3-b6da-95d89d48fb4e service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:54:35.619305 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e4e16-2f48-4bc3-b6da-95d89d48fb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:54:35.619580 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e4e16-2f48-4bc3-b6da-95d89d48fb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:54:35.621352 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a80e4e16-2f48-4bc3-b6da-95d89d48fb4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:54:35.631368 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e4e16-2f48-4bc3-b6da-95d89d48fb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:54:35.632958 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e4e16-2f48-4bc3-b6da-95d89d48fb4e service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:54:35.641039 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1472/2921] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:54:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:54:36.746438 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575c4d9-6737-4548-9e73-50219d7eea0e service placement] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:54:36.756421 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575c4d9-6737-4548-9e73-50219d7eea0e service placement] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:54:36.760147 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e65d6-ebc9-45f1-be9b-c4f11e07cd6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:54:36.760786 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e65d6-ebc9-45f1-be9b-c4f11e07cd6c service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:54:36.761066 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e65d6-ebc9-45f1-be9b-c4f11e07cd6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:54:36.761340 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e65d6-ebc9-45f1-be9b-c4f11e07cd6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:54:36.763269 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-411e65d6-ebc9-45f1-be9b-c4f11e07cd6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:54:36.774053 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e65d6-ebc9-45f1-be9b-c4f11e07cd6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:54:36.775509 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e65d6-ebc9-45f1-be9b-c4f11e07cd6c service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:54:36.783972 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1450/2922] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:54:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:54:36.894198 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e4e16-2f48-4bc3-b6da-95d89d48fb4e service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:54:36.904491 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e4e16-2f48-4bc3-b6da-95d89d48fb4e service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:54:36.908230 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d8f95-ddfd-401a-80c0-12424630fcda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:54:36.908866 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d8f95-ddfd-401a-80c0-12424630fcda service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:54:36.909145 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d8f95-ddfd-401a-80c0-12424630fcda service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:54:36.909412 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d8f95-ddfd-401a-80c0-12424630fcda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:54:36.911233 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-083d8f95-ddfd-401a-80c0-12424630fcda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:54:36.924941 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d8f95-ddfd-401a-80c0-12424630fcda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:54:36.926379 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d8f95-ddfd-401a-80c0-12424630fcda service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:54:36.938293 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1473/2923] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:54:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:54:36.998692 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e65d6-ebc9-45f1-be9b-c4f11e07cd6c service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:54:37.011670 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e65d6-ebc9-45f1-be9b-c4f11e07cd6c service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:54:37.016613 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf1a85-651c-43e4-a58f-7430f514c426 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:54:37.017242 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf1a85-651c-43e4-a58f-7430f514c426 service placement] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:54:37.017520 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf1a85-651c-43e4-a58f-7430f514c426 service placement] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:54:37.017790 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf1a85-651c-43e4-a58f-7430f514c426 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:54:37.019563 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-eebf1a85-651c-43e4-a58f-7430f514c426 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:54:37.031516 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf1a85-651c-43e4-a58f-7430f514c426 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:54:37.033104 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf1a85-651c-43e4-a58f-7430f514c426 service placement] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:54:37.043292 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1451/2924] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:54:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:54:37.461344 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d8f95-ddfd-401a-80c0-12424630fcda service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:54:37.475817 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d8f95-ddfd-401a-80c0-12424630fcda service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:54:37.481597 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e53811-2b2d-42a5-b17a-0061239db3ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:54:37.482250 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e53811-2b2d-42a5-b17a-0061239db3ab service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:54:37.482532 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e53811-2b2d-42a5-b17a-0061239db3ab service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:54:37.482837 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e53811-2b2d-42a5-b17a-0061239db3ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:54:37.484650 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-11e53811-2b2d-42a5-b17a-0061239db3ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:54:37.498158 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e53811-2b2d-42a5-b17a-0061239db3ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:54:37.499766 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e53811-2b2d-42a5-b17a-0061239db3ab service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:54:37.511738 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1474/2925] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:54:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:54:47.039158 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=44 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:54:47.506347 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=18 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:56:32.025825 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf1a85-651c-43e4-a58f-7430f514c426 service placement] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:56:32.035777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf1a85-651c-43e4-a58f-7430f514c426 service placement] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:56:32.039389 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ba8af-e437-42ab-ac53-b6a143ded944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:56:32.040058 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ba8af-e437-42ab-ac53-b6a143ded944 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:56:32.040341 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ba8af-e437-42ab-ac53-b6a143ded944 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:56:32.040613 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ba8af-e437-42ab-ac53-b6a143ded944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:56:32.049501 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ba8af-e437-42ab-ac53-b6a143ded944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:56:32.050936 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ba8af-e437-42ab-ac53-b6a143ded944 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:56:32.059696 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1452/2926] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:56:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:56:32.885557 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e53811-2b2d-42a5-b17a-0061239db3ab service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:56:32.887690 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-11e53811-2b2d-42a5-b17a-0061239db3ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:56:32.908105 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e53811-2b2d-42a5-b17a-0061239db3ab service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:56:32.913822 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0298e2-2083-4471-98b1-1d6a44445065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:56:32.914476 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0298e2-2083-4471-98b1-1d6a44445065 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:56:32.914782 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0298e2-2083-4471-98b1-1d6a44445065 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:56:32.915064 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0298e2-2083-4471-98b1-1d6a44445065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:56:32.916952 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9a0298e2-2083-4471-98b1-1d6a44445065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:56:32.930119 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0298e2-2083-4471-98b1-1d6a44445065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:56:32.931816 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0298e2-2083-4471-98b1-1d6a44445065 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:56:32.944204 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1475/2927] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:56:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:56:35.001553 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ba8af-e437-42ab-ac53-b6a143ded944 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:56:35.015316 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ba8af-e437-42ab-ac53-b6a143ded944 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:56:35.021647 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adf713-2265-4144-b9fd-f276d0dc1032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d9543657e1e4a6d85632bf57f6ba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:56:35.022294 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adf713-2265-4144-b9fd-f276d0dc1032 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:56:35.022583 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adf713-2265-4144-b9fd-f276d0dc1032 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:56:35.022889 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adf713-2265-4144-b9fd-f276d0dc1032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:56:35.024669 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-76adf713-2265-4144-b9fd-f276d0dc1032 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:56:35.039582 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adf713-2265-4144-b9fd-f276d0dc1032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:56:35.041240 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adf713-2265-4144-b9fd-f276d0dc1032 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:56:35.053601 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1453/2928] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:56:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:56:37.735611 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0298e2-2083-4471-98b1-1d6a44445065 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:56:37.745265 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0298e2-2083-4471-98b1-1d6a44445065 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:56:37.748960 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7beded-2541-402c-8e8e-ec9930e4acf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '977392666b5a4076884416489b935ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:56:37.749591 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7beded-2541-402c-8e8e-ec9930e4acf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:56:37.749869 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7beded-2541-402c-8e8e-ec9930e4acf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:56:37.750153 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7beded-2541-402c-8e8e-ec9930e4acf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:56:37.810251 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7beded-2541-402c-8e8e-ec9930e4acf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:56:37.811861 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7beded-2541-402c-8e8e-ec9930e4acf7 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:56:37.821656 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1476/2929] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:56:40.900339 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adf713-2265-4144-b9fd-f276d0dc1032 service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:56:40.901823 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-76adf713-2265-4144-b9fd-f276d0dc1032 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:56:40.918979 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adf713-2265-4144-b9fd-f276d0dc1032 service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:56:40.925332 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457d481-f81e-4e0e-8776-b97e03de01fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:56:40.926006 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457d481-f81e-4e0e-8776-b97e03de01fe service placement] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:56:40.926361 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457d481-f81e-4e0e-8776-b97e03de01fe service placement] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:56:40.926706 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457d481-f81e-4e0e-8776-b97e03de01fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:56:40.928594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d457d481-f81e-4e0e-8776-b97e03de01fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:56:40.942055 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457d481-f81e-4e0e-8776-b97e03de01fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:56:40.943828 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457d481-f81e-4e0e-8776-b97e03de01fe service placement] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:56:40.955975 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1454/2930] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:56:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:56:44.011717 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7beded-2541-402c-8e8e-ec9930e4acf7 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:56:44.024057 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7beded-2541-402c-8e8e-ec9930e4acf7 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:56:44.029357 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770ce8a-fb6f-4f8e-b778-aa042efe9df7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:56:44.029922 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770ce8a-fb6f-4f8e-b778-aa042efe9df7 service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:56:44.030199 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770ce8a-fb6f-4f8e-b778-aa042efe9df7 service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:56:44.030469 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770ce8a-fb6f-4f8e-b778-aa042efe9df7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:56:44.032941 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1770ce8a-fb6f-4f8e-b778-aa042efe9df7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:56:44.044682 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770ce8a-fb6f-4f8e-b778-aa042efe9df7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:56:44.046243 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770ce8a-fb6f-4f8e-b778-aa042efe9df7 service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:56:44.057252 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1477/2931] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:56:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:56:44.077604 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457d481-f81e-4e0e-8776-b97e03de01fe service placement] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:56:44.088915 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457d481-f81e-4e0e-8776-b97e03de01fe service placement] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:56:44.096216 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805a67a-702d-48ce-b07c-b785b62458c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:56:44.097507 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805a67a-702d-48ce-b07c-b785b62458c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:56:44.097853 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805a67a-702d-48ce-b07c-b785b62458c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:56:44.098196 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805a67a-702d-48ce-b07c-b785b62458c0 admin admin] PATH_INFO: `/v3/users/e42ffaa86c894f05a8f1fe7b7ba4cfcd` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:56:44.099642 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805a67a-702d-48ce-b07c-b785b62458c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e42ffaa86c894f05a8f1fe7b7ba4cfcd)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:56:44.101598 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805a67a-702d-48ce-b07c-b785b62458c0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:56:44.148974 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8805a67a-702d-48ce-b07c-b785b62458c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e42ffaa86c894f05a8f1fe7b7ba4cfcd'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:44.156123 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8805a67a-702d-48ce-b07c-b785b62458c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e42ffaa86c894f05a8f1fe7b7ba4cfcd'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:44.168950 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8805a67a-702d-48ce-b07c-b785b62458c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e42ffaa86c894f05a8f1fe7b7ba4cfcd'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:44.176916 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8805a67a-702d-48ce-b07c-b785b62458c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e42ffaa86c894f05a8f1fe7b7ba4cfcd'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:44.177538 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8805a67a-702d-48ce-b07c-b785b62458c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e42ffaa86c894f05a8f1fe7b7ba4cfcd'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:44.183581 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1455/2932] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:56:44 2022] DELETE /identity/v3/users/e42ffaa86c894f05a8f1fe7b7ba4cfcd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:56:44.356594 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770ce8a-fb6f-4f8e-b778-aa042efe9df7 service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:56:44.369966 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770ce8a-fb6f-4f8e-b778-aa042efe9df7 service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:56:44.431492 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fd04b-c658-446e-ba9e-58858d3f3374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:56:44.432349 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fd04b-c658-446e-ba9e-58858d3f3374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:56:44.432627 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fd04b-c658-446e-ba9e-58858d3f3374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:56:44.432895 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fd04b-c658-446e-ba9e-58858d3f3374 admin admin] PATH_INFO: `/v3/projects/12166449feab4559960ea2ab1fc86510` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:56:44.434053 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fd04b-c658-446e-ba9e-58858d3f3374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12166449feab4559960ea2ab1fc86510)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:56:44.435973 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fd04b-c658-446e-ba9e-58858d3f3374 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:56:44.481375 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e84fd04b-c658-446e-ba9e-58858d3f3374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12166449feab4559960ea2ab1fc86510', 'request_id': 'req-e84fd04b-c658-446e-ba9e-58858d3f3374'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:44.487661 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e84fd04b-c658-446e-ba9e-58858d3f3374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12166449feab4559960ea2ab1fc86510', 'request_id': 'req-e84fd04b-c658-446e-ba9e-58858d3f3374'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:44.494604 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e84fd04b-c658-446e-ba9e-58858d3f3374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12166449feab4559960ea2ab1fc86510', 'request_id': 'req-e84fd04b-c658-446e-ba9e-58858d3f3374'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:44.501795 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:56:44.506600 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e84fd04b-c658-446e-ba9e-58858d3f3374 admin admin] The token cache is being invalidate because project 12166449feab4559960ea2ab1fc86510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:56:44.507181 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e84fd04b-c658-446e-ba9e-58858d3f3374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:44.508218 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e84fd04b-c658-446e-ba9e-58858d3f3374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:44.510106 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1478/2933] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:56:44 2022] DELETE /identity/v3/projects/12166449feab4559960ea2ab1fc86510 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:56:44.513858 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805a67a-702d-48ce-b07c-b785b62458c0 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:56:44.515397 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8805a67a-702d-48ce-b07c-b785b62458c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:56:44.528982 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805a67a-702d-48ce-b07c-b785b62458c0 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:56:44.586659 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb03c32-7354-449f-9710-49e779d3e59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:56:44.587488 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb03c32-7354-449f-9710-49e779d3e59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:56:44.587768 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb03c32-7354-449f-9710-49e779d3e59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:56:44.588040 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb03c32-7354-449f-9710-49e779d3e59f admin admin] PATH_INFO: `/v3/users/01939a9f5b3048e2a0e5b187fe8725ce` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:56:44.589235 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb03c32-7354-449f-9710-49e779d3e59f admin admin] RBAC: Authorizing `identity:delete_user(user_id=01939a9f5b3048e2a0e5b187fe8725ce)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:56:44.591153 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb03c32-7354-449f-9710-49e779d3e59f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:56:44.628404 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:56:44.639112 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3fb03c32-7354-449f-9710-49e779d3e59f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01939a9f5b3048e2a0e5b187fe8725ce'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:44.646541 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3fb03c32-7354-449f-9710-49e779d3e59f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01939a9f5b3048e2a0e5b187fe8725ce'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:44.659109 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3fb03c32-7354-449f-9710-49e779d3e59f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01939a9f5b3048e2a0e5b187fe8725ce'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:44.667145 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3fb03c32-7354-449f-9710-49e779d3e59f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01939a9f5b3048e2a0e5b187fe8725ce'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:44.667777 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3fb03c32-7354-449f-9710-49e779d3e59f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01939a9f5b3048e2a0e5b187fe8725ce'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:44.674418 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1456/2934] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Jul 19 12:56:44 2022] DELETE /identity/v3/users/01939a9f5b3048e2a0e5b187fe8725ce => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:56:44.846719 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fd04b-c658-446e-ba9e-58858d3f3374 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:56:44.848190 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e84fd04b-c658-446e-ba9e-58858d3f3374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:56:44.861192 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fd04b-c658-446e-ba9e-58858d3f3374 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:56:44.926113 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c553e8d-89fd-4e2e-ba01-7406d68a6bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b1bae44b87419cac105e8b3296eaae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a118b268db6472d8ac22365fb14ce5a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:56:44.927005 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c553e8d-89fd-4e2e-ba01-7406d68a6bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:56:44.927293 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c553e8d-89fd-4e2e-ba01-7406d68a6bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:56:44.927564 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c553e8d-89fd-4e2e-ba01-7406d68a6bd3 admin admin] PATH_INFO: `/v3/projects/aadc41f0658349948677fabf7223075a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:56:44.928796 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c553e8d-89fd-4e2e-ba01-7406d68a6bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aadc41f0658349948677fabf7223075a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:56:44.930697 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c553e8d-89fd-4e2e-ba01-7406d68a6bd3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:56:44.976823 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9c553e8d-89fd-4e2e-ba01-7406d68a6bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aadc41f0658349948677fabf7223075a', 'request_id': 'req-9c553e8d-89fd-4e2e-ba01-7406d68a6bd3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:44.982258 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9c553e8d-89fd-4e2e-ba01-7406d68a6bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aadc41f0658349948677fabf7223075a', 'request_id': 'req-9c553e8d-89fd-4e2e-ba01-7406d68a6bd3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:44.989267 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9c553e8d-89fd-4e2e-ba01-7406d68a6bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aadc41f0658349948677fabf7223075a', 'request_id': 'req-9c553e8d-89fd-4e2e-ba01-7406d68a6bd3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:45.000819 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9c553e8d-89fd-4e2e-ba01-7406d68a6bd3 admin admin] The token cache is being invalidate because project aadc41f0658349948677fabf7223075a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:56:45.001135 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9c553e8d-89fd-4e2e-ba01-7406d68a6bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:45.001809 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9c553e8d-89fd-4e2e-ba01-7406d68a6bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:56:45.003366 dv-cinder-820994-4-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1479/2935] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Jul 19 12:56:44 2022] DELETE /identity/v3/projects/aadc41f0658349948677fabf7223075a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:56:54.670155 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:56:54.997270 dv-cinder-820994-4-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:59:35.915437 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb03c32-7354-449f-9710-49e779d3e59f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:59:35.916843 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3fb03c32-7354-449f-9710-49e779d3e59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:59:36.019771 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb03c32-7354-449f-9710-49e779d3e59f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:59:36.078942 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75af303-650f-495c-bd13-cb758cf1c483 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11a51c42a4094d9b97eb636c57225dd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ba395a1e22f430084089947e47a622d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:59:36.079594 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75af303-650f-495c-bd13-cb758cf1c483 service placement] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:59:36.079878 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75af303-650f-495c-bd13-cb758cf1c483 service placement] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:59:36.080152 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75af303-650f-495c-bd13-cb758cf1c483 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:59:36.081924 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a75af303-650f-495c-bd13-cb758cf1c483 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:59:36.093028 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75af303-650f-495c-bd13-cb758cf1c483 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:59:36.094577 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75af303-650f-495c-bd13-cb758cf1c483 service placement] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:59:36.105063 dv-cinder-820994-4-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1457/2936] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Jul 19 12:59:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:59:46.100802 dv-cinder-820994-4-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=71 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}